• 设为首页
  • 点击收藏
  • 手机版
    手机扫一扫访问
    迪恩网络手机版
  • 关注官方公众号
    微信扫一扫关注
    迪恩网络公众号

Java MultipleFileUpload类代码示例

原作者: [db:作者] 来自: [db:来源] 收藏 邀请

本文整理汇总了Java中com.amazonaws.services.s3.transfer.MultipleFileUpload的典型用法代码示例。如果您正苦于以下问题:Java MultipleFileUpload类的具体用法?Java MultipleFileUpload怎么用?Java MultipleFileUpload使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。



MultipleFileUpload类属于com.amazonaws.services.s3.transfer包,在下文中一共展示了MultipleFileUpload类的16个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于我们的系统推荐出更棒的Java代码示例。

示例1: uploadDir

import com.amazonaws.services.s3.transfer.MultipleFileUpload; //导入依赖的package包/类
public static void uploadDir(String dir_path, String bucket_name,
        String key_prefix, boolean recursive, boolean pause)
{
    System.out.println("directory: " + dir_path + (recursive ?
                " (recursive)" : "") + (pause ? " (pause)" : ""));

    TransferManager xfer_mgr = new TransferManager();
    try {
        MultipleFileUpload xfer = xfer_mgr.uploadDirectory(bucket_name,
                key_prefix, new File(dir_path), recursive);
        // loop with Transfer.isDone()
        XferMgrProgress.showTransferProgress(xfer);
        // or block with Transfer.waitForCompletion()
        XferMgrProgress.waitForCompletion(xfer);
    } catch (AmazonServiceException e) {
        System.err.println(e.getErrorMessage());
        System.exit(1);
    }
    xfer_mgr.shutdownNow();
}
 
开发者ID:awsdocs,项目名称:aws-doc-sdk-examples,代码行数:21,代码来源:XferMgrUpload.java


示例2: uploadDirWithSubprogress

import com.amazonaws.services.s3.transfer.MultipleFileUpload; //导入依赖的package包/类
public static void uploadDirWithSubprogress(String dir_path,
        String bucket_name, String key_prefix, boolean recursive,
        boolean pause)
{
    System.out.println("directory: " + dir_path + (recursive ?
                " (recursive)" : "") + (pause ? " (pause)" : ""));

    TransferManager xfer_mgr = new TransferManager();
    try {
        MultipleFileUpload multi_upload = xfer_mgr.uploadDirectory(
                bucket_name, key_prefix, new File(dir_path), recursive);
        // loop with Transfer.isDone()
        XferMgrProgress.showMultiUploadProgress(multi_upload);
        // or block with Transfer.waitForCompletion()
        XferMgrProgress.waitForCompletion(multi_upload);
    } catch (AmazonServiceException e) {
        System.err.println(e.getErrorMessage());
        System.exit(1);
    }
    xfer_mgr.shutdownNow();
}
 
开发者ID:awsdocs,项目名称:aws-doc-sdk-examples,代码行数:22,代码来源:XferMgrProgress.java


示例3: uploadFileList

import com.amazonaws.services.s3.transfer.MultipleFileUpload; //导入依赖的package包/类
public static void uploadFileList(String[] file_paths, String bucket_name,
        String key_prefix, boolean pause)
{
    System.out.println("file list: " + Arrays.toString(file_paths) +
            (pause ? " (pause)" : ""));
    // convert the file paths to a list of File objects (required by the
    // uploadFileList method)
    ArrayList<File> files = new ArrayList<File>();
    for (String path : file_paths) {
        files.add(new File(path));
    }

    TransferManager xfer_mgr = new TransferManager();
    try {
        MultipleFileUpload xfer = xfer_mgr.uploadFileList(bucket_name,
                key_prefix, new File("."), files);
        // loop with Transfer.isDone()
        XferMgrProgress.showTransferProgress(xfer);
        // or block with Transfer.waitForCompletion()
        XferMgrProgress.waitForCompletion(xfer);
    } catch (AmazonServiceException e) {
        System.err.println(e.getErrorMessage());
        System.exit(1);
    }
    xfer_mgr.shutdownNow();
}
 
开发者ID:awsdocs,项目名称:aws-doc-sdk-examples,代码行数:27,代码来源:XferMgrUpload.java


示例4: verifyMultiPartUpload

import com.amazonaws.services.s3.transfer.MultipleFileUpload; //导入依赖的package包/类
private Map<String, String> verifyMultiPartUpload(MultipleFileUpload uploadDirectory) throws AmazonClientException {
    Collection<? extends Upload> uploadResults = uploadDirectory.getSubTransfers();
    Iterator<? extends Upload> iterator = uploadResults.iterator();

    Map<String, String> fileModifyMap = new HashMap<String, String>();
    while (iterator.hasNext()) {
        UploadResult uploadResult = null;

        try {
            uploadResult = iterator.next().waitForUploadResult();
        } catch (Exception e) {
                LOGGER.error(e.getMessage());
                throw new AmazonClientException(e.getMessage());
        }

        if (uploadResult != null) {
            LOGGER.info(String.format("Multipart upload success for file " + uploadResult.getKey() + " to Amazon S3 bucket " + uploadResult.getBucketName()));
        }
    }
    
    return fileModifyMap;
}
 
开发者ID:ktenzer,项目名称:snap2cloud,代码行数:23,代码来源:S3Backup.java


示例5: transferDir

import com.amazonaws.services.s3.transfer.MultipleFileUpload; //导入依赖的package包/类
protected void transferDir(String shardDestinationBucket, String localShardPath, String shard) {
	MultipleFileUpload mfu = tx.uploadDirectory(shardDestinationBucket + shard, null, new File(localShardPath), true, objectMetadataProvider);
	
	/**
	 * TODO: Hadoop has a configurable timeout for how long a reducer can be non-responsive (usually 600s). If 
	 * this takes >600s hadoop will kill the task. We need to ping the reporter to let it know it's alive
	 * in the case where the file transfer is taking a while.
	 */
	while(!mfu.isDone()) {
		logger.info("Transfering to S3 completed %" + mfu.getProgress().getPercentTransferred());
		try {
			Thread.sleep(1000);
		} catch (InterruptedException e) {
			Thread.currentThread().interrupt();
		}
	}
}
 
开发者ID:MyPureCloud,项目名称:elasticsearch-lambda,代码行数:18,代码来源:S3SnapshotTransport.java


示例6: uploadDirectory

import com.amazonaws.services.s3.transfer.MultipleFileUpload; //导入依赖的package包/类
private void uploadDirectory(TransferManager tx,
                             String bucketName,
                             String key,
                             String keyspaceName,
                             String cfName,
                             File snapshotDirectory) throws Exception {
    try {
        final String fileKey = key + "/" + keyspaceName + "/" + cfName + "/";
        final MultipleFileUpload myUpload = tx.uploadDirectory(bucketName, fileKey, snapshotDirectory, true);
        myUpload.waitForCompletion();
    } catch (Exception e) {
        LOGGER.error("Error occurred on uploading directory {} : {}", snapshotDirectory.getName(), e);
        throw new Exception(e);
    }
}
 
开发者ID:mesosphere,项目名称:dcos-cassandra-service,代码行数:16,代码来源:S3StorageDriver.java


示例7: run

import com.amazonaws.services.s3.transfer.MultipleFileUpload; //导入依赖的package包/类
@Override
public void run(final PublishDashboardCommand command) {
    final URL artifactUrl = command.getArtifactUrl();
    final URL overrideArtifactUrl = command.getOverrideArtifactUrl();

    final BaseOutputs outputParameters = configStore.getBaseStackOutputs();
    final String dashboardBucketName = outputParameters.getDashboardBucketName();

    if (StringUtils.isBlank(dashboardBucketName)) {
        final String errorMessage = "The specified environment isn't configured properly!";
        logger.error(errorMessage);
        throw new IllegalStateException(errorMessage);
    }

    initClient(dashboardBucketName);

    final File extractedDirectory = extractArtifact(artifactUrl, overrideArtifactUrl);

    try {
        final MultipleFileUpload multipleFileUpload =
                transferManager.uploadDirectory(dashboardBucketName, "", extractedDirectory, true, new DashboardMetaDataProvider());
        logger.info("Uploading dashboard files.");
        multipleFileUpload.waitForCompletion();
        logger.info("Uploading complete.");
    } catch (InterruptedException e) {
        logger.error("Interrupted while waiting for upload to complete!", e);
    } finally {
        transferManager.shutdownNow(false);
    }
}
 
开发者ID:Nike-Inc,项目名称:cerberus-lifecycle-cli,代码行数:31,代码来源:PublishDashboardOperation.java


示例8: uploadDirectory

import com.amazonaws.services.s3.transfer.MultipleFileUpload; //导入依赖的package包/类
@Override
public MultipleFileUpload uploadDirectory(String bucketName, String virtualDirectoryKeyPrefix, File directory, boolean includeSubdirectories,
    ObjectMetadataProvider metadataProvider, TransferManager transferManager)
{
    LOGGER.debug(
        "uploadDirectory(): bucketName = " + bucketName + ", virtualDirectoryKeyPrefix = " + virtualDirectoryKeyPrefix + ", directory = " + directory +
            ", includeSubdirectories = " + includeSubdirectories);

    List<File> files = new ArrayList<>();
    listFiles(directory, files, includeSubdirectories);

    return uploadFileList(bucketName, virtualDirectoryKeyPrefix, directory, files, metadataProvider, transferManager);
}
 
开发者ID:FINRAOS,项目名称:herd,代码行数:14,代码来源:MockS3OperationsImpl.java


示例9: uploadDirectory

import com.amazonaws.services.s3.transfer.MultipleFileUpload; //导入依赖的package包/类
@Override
public MultipleFileUpload uploadDirectory(String s3BucketName, String virtualDirectoryKeyPrefix, File directory, boolean includeSubdirectories,
    ObjectMetadataProvider metadataProvider, TransferManager transferManager)
{
    return transferManager.uploadDirectory(s3BucketName, virtualDirectoryKeyPrefix, directory, includeSubdirectories, metadataProvider);
}
 
开发者ID:FINRAOS,项目名称:herd,代码行数:7,代码来源:S3OperationsImpl.java


示例10: uploadFileList

import com.amazonaws.services.s3.transfer.MultipleFileUpload; //导入依赖的package包/类
@Override
public MultipleFileUpload uploadFileList(String s3BucketName, String virtualDirectoryKeyPrefix, File directory, List<File> files,
    ObjectMetadataProvider metadataProvider, TransferManager transferManager)
{
    return transferManager.uploadFileList(s3BucketName, virtualDirectoryKeyPrefix, directory, files, metadataProvider);
}
 
开发者ID:FINRAOS,项目名称:herd,代码行数:7,代码来源:S3OperationsImpl.java


示例11: uploadFileList

import com.amazonaws.services.s3.transfer.MultipleFileUpload; //导入依赖的package包/类
@Override
public MultipleFileUpload uploadFileList(String bucketName, String virtualDirectoryKeyPrefix, File directory, List<File> files,
    ObjectMetadataProvider metadataProvider, TransferManager transferManager)
{
    LOGGER.debug(
        "uploadFileList(): bucketName = " + bucketName + ", virtualDirectoryKeyPrefix = " + virtualDirectoryKeyPrefix + ", directory = " + directory +
            ", files = " + files);

    String directoryPath = directory.getAbsolutePath();

    long totalFileLength = 0;
    List<Upload> subTransfers = new ArrayList<>();
    for (File file : files)
    {
        // Get path to file relative to the specified directory
        String relativeFilePath = file.getAbsolutePath().substring(directoryPath.length());

        // Replace any backslashes (i.e. Windows separator) with a forward slash.
        relativeFilePath = relativeFilePath.replace("\\", "/");

        // Remove any leading slashes
        relativeFilePath = relativeFilePath.replaceAll("^/+", "");

        long fileLength = file.length();

        // Remove any trailing slashes
        virtualDirectoryKeyPrefix = virtualDirectoryKeyPrefix.replaceAll("/+$", "");

        String s3ObjectKey = virtualDirectoryKeyPrefix + "/" + relativeFilePath;
        totalFileLength += fileLength;

        PutObjectRequest putObjectRequest = new PutObjectRequest(bucketName, s3ObjectKey, file);

        ObjectMetadata objectMetadata = new ObjectMetadata();
        metadataProvider.provideObjectMetadata(null, objectMetadata);
        putObjectRequest.setMetadata(objectMetadata);

        putObject(putObjectRequest, transferManager.getAmazonS3Client());

        subTransfers.add(new UploadImpl(null, null, null, null));
    }

    TransferProgress progress = new TransferProgress();
    progress.setTotalBytesToTransfer(totalFileLength);
    progress.updateProgress(totalFileLength);

    MultipleFileUploadImpl multipleFileUpload = new MultipleFileUploadImpl(null, progress, null, virtualDirectoryKeyPrefix, bucketName, subTransfers);
    multipleFileUpload.setState(TransferState.Completed);
    return multipleFileUpload;
}
 
开发者ID:FINRAOS,项目名称:herd,代码行数:51,代码来源:MockS3OperationsImpl.java


示例12: uploadFolder

import com.amazonaws.services.s3.transfer.MultipleFileUpload; //导入依赖的package包/类
public void uploadFolder(File folder, String key) throws AmazonServiceException,
    AmazonClientException, InterruptedException {
  TransferManager tm = new TransferManager(new Aws().getAwsCredentials());
  MultipleFileUpload upload = tm.uploadDirectory(getUserProperty(REPO_BUCKET), key, folder, true);
  waitForUpload(upload, tm);
}
 
开发者ID:tuhrig,项目名称:DeployMan,代码行数:7,代码来源:RemoteRepository.java


示例13: uploadFolder

import com.amazonaws.services.s3.transfer.MultipleFileUpload; //导入依赖的package包/类
public MultipleFileUpload uploadFolder(String bucketName, String keyPrefix, File folderPath,
                boolean includeSubDir) {
    TransferManager transfer = new TransferManager(getClient());
    return transfer.uploadDirectory(bucketName, keyPrefix, folderPath, includeSubDir);
}
 
开发者ID:deeplearning4j,项目名称:deeplearning4j,代码行数:6,代码来源:S3Uploader.java


示例14: uploadFileList

import com.amazonaws.services.s3.transfer.MultipleFileUpload; //导入依赖的package包/类
public MultipleFileUpload uploadFileList(String bucketName, File folderPath, List<File> fileList,
                String keyPrefix) {
    TransferManager transfer = new TransferManager(getClient());
    return transfer.uploadFileList(bucketName, keyPrefix, folderPath, fileList);
}
 
开发者ID:deeplearning4j,项目名称:deeplearning4j,代码行数:6,代码来源:S3Uploader.java


示例15: uploadDirectory

import com.amazonaws.services.s3.transfer.MultipleFileUpload; //导入依赖的package包/类
/**
 * Uploads all files in the directory given to the bucket named, optionally recursing for all subdirectories.
 *
 * @param s3BucketName the S3 bucket name
 * @param virtualDirectoryKeyPrefix the key prefix of the virtual directory to upload to
 * @param directory the directory to upload
 * @param includeSubdirectories specified whether to include subdirectories in the upload. If true, files found in subdirectories will be included with an
 * appropriate concatenation to the key prefix
 * @param metadataProvider the callback of type <code>ObjectMetadataProvider</code> which is used to provide metadata for each file being uploaded
 * @param transferManager the transfer manager implementation to use
 *
 * @return the multiple file upload information
 */
public MultipleFileUpload uploadDirectory(String s3BucketName, String virtualDirectoryKeyPrefix, File directory, boolean includeSubdirectories,
    ObjectMetadataProvider metadataProvider, TransferManager transferManager);
 
开发者ID:FINRAOS,项目名称:herd,代码行数:16,代码来源:S3Operations.java


示例16: uploadFileList

import com.amazonaws.services.s3.transfer.MultipleFileUpload; //导入依赖的package包/类
/**
 * Uploads all specified files to the bucket named, constructing relative keys depending on the common parent directory given.
 *
 * @param s3BucketName the S3 bucket name
 * @param virtualDirectoryKeyPrefix the key prefix of the virtual directory to upload to
 * @param directory the common parent directory of files to upload. The keys of the files in the list of files are constructed relative to this directory
 * and the virtualDirectoryKeyPrefix
 * @param files the list of files to upload. The keys of the files are calculated relative to the common parent directory and the virtualDirectoryKeyPrefix
 * @param metadataProvider the callback of type <code>ObjectMetadataProvider</code> which is used to provide metadata for each file being uploaded
 * @param transferManager the transfer manager implementation to use
 *
 * @return the multiple file upload information
 */
public MultipleFileUpload uploadFileList(String s3BucketName, String virtualDirectoryKeyPrefix, File directory, List<File> files,
    ObjectMetadataProvider metadataProvider, TransferManager transferManager);
 
开发者ID:FINRAOS,项目名称:herd,代码行数:16,代码来源:S3Operations.java



注:本文中的com.amazonaws.services.s3.transfer.MultipleFileUpload类示例整理自Github/MSDocs等源码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。


鲜花

握手

雷人

路过

鸡蛋
该文章已有0人参与评论

请发表评论

全部评论

专题导读
上一篇:
Java ServerException类代码示例发布时间:2022-05-22
下一篇:
Java Int32Value类代码示例发布时间:2022-05-22
热门推荐
阅读排行榜

扫描微信二维码

查看手机版网站

随时了解更新最新资讯

139-2527-9053

在线客服(服务时间 9:00~18:00)

在线QQ客服
地址:深圳市南山区西丽大学城创智工业园
电邮:jeky_zhao#qq.com
移动电话:139-2527-9053

Powered by 互联科技 X3.4© 2001-2213 极客世界.|Sitemap