本文整理汇总了Java中com.amazonaws.services.s3.model.ListObjectsV2Result类的典型用法代码示例。如果您正苦于以下问题:Java ListObjectsV2Result类的具体用法?Java ListObjectsV2Result怎么用?Java ListObjectsV2Result使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。
ListObjectsV2Result类属于com.amazonaws.services.s3.model包,在下文中一共展示了ListObjectsV2Result类的6个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于我们的系统推荐出更棒的Java代码示例。
示例1: clearDest
import com.amazonaws.services.s3.model.ListObjectsV2Result; //导入依赖的package包/类
private void clearDest(AWSCredentials credentials, RedshiftConnection.UnloadConfig unloadConfig)
{
try {
RetryExecutor.retryExecutor() .run(() -> {
AmazonS3Client s3Client = new AmazonS3Client(credentials);
ListObjectsV2Request req = new ListObjectsV2Request().withBucketName(unloadConfig.s3Bucket).withPrefix(unloadConfig.s3Prefix);
ListObjectsV2Result result;
// This operation shouldn't be skipped since remaining files created by other operation can cause duplicated data
do {
result = s3Client.listObjectsV2(req);
for (S3ObjectSummary objectSummary : result.getObjectSummaries()) {
s3Client.deleteObject(unloadConfig.s3Bucket, objectSummary.getKey());
}
req.setContinuationToken(result.getNextContinuationToken());
} while (result.isTruncated());
});
}
catch (RetryExecutor.RetryGiveupException e) {
throw Throwables.propagate(e);
}
}
开发者ID:treasure-data,项目名称:digdag,代码行数:23,代码来源:RedshiftUnloadOperatorFactory.java
示例2: listObjectsV2
import com.amazonaws.services.s3.model.ListObjectsV2Result; //导入依赖的package包/类
@Override
public ListObjectsV2Result listObjectsV2(ListObjectsV2Request listObjectsV2Request)
throws SdkClientException, AmazonServiceException {
listObjectsV2Request = beforeClientExecution(listObjectsV2Request);
rejectNull(listObjectsV2Request.getBucketName(), "The bucket name parameter must be specified when listing objects in a bucket");
Request<ListObjectsV2Request> request = createRequest(listObjectsV2Request.getBucketName(), null, listObjectsV2Request, HttpMethodName.GET);
/**
* List type '2' is required to opt-in to listObjectsV2.
*/
request.addParameter("list-type", "2");
addParameterIfNotNull(request, "start-after", listObjectsV2Request.getStartAfter());
addParameterIfNotNull(request, "continuation-token", listObjectsV2Request.getContinuationToken());
addParameterIfNotNull(request, "delimiter", listObjectsV2Request.getDelimiter());
addParameterIfNotNull(request, "max-keys", listObjectsV2Request.getMaxKeys());
addParameterIfNotNull(request, "prefix", listObjectsV2Request.getPrefix());
addParameterIfNotNull(request, "encoding-type", listObjectsV2Request.getEncodingType());
request.addParameter("fetch-owner", Boolean.toString(listObjectsV2Request.isFetchOwner()));
/**
* If URL encoding has been requested from S3 we'll automatically decode the response.
*/
final boolean shouldSDKDecodeResponse = listObjectsV2Request.getEncodingType() == Constants.URL_ENCODING;
return invoke(request, new Unmarshallers.ListObjectsV2Unmarshaller(shouldSDKDecodeResponse), listObjectsV2Request.getBucketName(), null);
}
开发者ID:IBM,项目名称:ibm-cos-sdk-java,代码行数:28,代码来源:AmazonS3Client.java
示例3: getFilenames
import com.amazonaws.services.s3.model.ListObjectsV2Result; //导入依赖的package包/类
@Override public Collection<String> getFilenames() {
Collection<String> names = new ArrayList<>();
final ListObjectsV2Request req = new ListObjectsV2Request().withBucketName(bucket);
ListObjectsV2Result listing;
do {
listing = client.listObjectsV2(req);
names.addAll(listing.getObjectSummaries().stream().map(S3ObjectSummary::getKey).collect(Collectors.toList()));
} while (listing.isTruncated());
return names;
}
开发者ID:yrashk,项目名称:etcetera,代码行数:12,代码来源:S3ConfigBackend.java
示例4: listObjectsV2
import com.amazonaws.services.s3.model.ListObjectsV2Result; //导入依赖的package包/类
@Override
public ListObjectsV2Result listObjectsV2(String bucketName) throws SdkClientException, AmazonServiceException {
return call(() -> getDelegate().listObjectsV2(bucketName));
}
开发者ID:HubSpot,项目名称:S3Decorators,代码行数:5,代码来源:S3Decorator.java
示例5: listAll
import com.amazonaws.services.s3.model.ListObjectsV2Result; //导入依赖的package包/类
@Override
public Iterator<LogHandle> listAll() {
final ListObjectsV2Request req = new ListObjectsV2Request()
.withBucketName(connector.getBucket()).withPrefix(prefix);
return new Iterator<LogHandle>() {
ListObjectsV2Result result;
Iterator<S3ObjectSummary> i;
@Override
public boolean hasNext() {
if (i == null || !i.hasNext()) {
return loadIfRequired();
} else {
return i.hasNext();
}
}
@Override
public LogHandle next() {
S3ObjectSummary s = i.next();
String key = s.getKey().replace(prefix, "");
if (key.startsWith("-") || key.startsWith("/")) {
key = key.substring(key.indexOf('/') + 1);
}
String[] parts = key.split("/");
if (parts.length == 4) {
return new LogHandle(parts[3], fromBase64(parts[0]), parts[1], parts[2]);
} else {
return LogHandle.INVALID_LOG;
}
}
private boolean loadIfRequired() {
if (result != null && (result.isTruncated() || result.getContinuationToken() == null)) {
return false;
} else {
result = client().listObjectsV2(req);
req.setContinuationToken(result.getNextContinuationToken());
i = result.getObjectSummaries().iterator();
return i.hasNext();
}
}
};
}
开发者ID:dmart28,项目名称:gcplot,代码行数:45,代码来源:S3LogsStorage.java
示例6: assertS3Contents
import com.amazonaws.services.s3.model.ListObjectsV2Result; //导入依赖的package包/类
private void assertS3Contents(List<Map<String, Object>> expected)
throws IOException
{
ListObjectsV2Request req = new ListObjectsV2Request().withBucketName(s3Bucket).withPrefix(s3ParentKey);
ListObjectsV2Result result;
List<String> lines = new ArrayList<>();
do {
result = s3Client.listObjectsV2(req);
for (S3ObjectSummary objectSummary : result.getObjectSummaries()) {
if (objectSummary.getKey().endsWith("_part_00")) {
try (BufferedReader reader =
new BufferedReader(
new InputStreamReader(
s3Client.getObject(
objectSummary.getBucketName(),
objectSummary.getKey()).getObjectContent()))) {
lines.addAll(reader.lines().collect(Collectors.toList()));
}
}
else {
assertThat(objectSummary.getKey(), endsWith("_manifest"));
}
try {
s3Client.deleteObject(objectSummary.getBucketName(), objectSummary.getKey());
}
catch (Exception e) {
logger.warn("Failed to delete S3 object: bucket={}, key={}", s3Bucket, objectSummary.getKey(), e);
}
}
req.setContinuationToken(result.getNextContinuationToken());
} while (result.isTruncated());
List<ImmutableMap<String, ? extends Serializable>> actual =
lines.stream()
.map(
l -> {
String[] values = l.split("\\|");
assertThat(values.length, is(3));
return ImmutableMap.of(
"id", Integer.valueOf(values[0]),
"name", values[1],
"score", Float.valueOf(values[2]));
}
)
.sorted((o1, o2) -> ((Integer)o1.get("id")) - ((Integer) o2.get("id")))
.collect(Collectors.toList());
assertThat(actual, is(expected));
}
开发者ID:treasure-data,项目名称:digdag,代码行数:51,代码来源:RedshiftIT.java
注:本文中的com.amazonaws.services.s3.model.ListObjectsV2Result类示例整理自Github/MSDocs等源码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。 |
请发表评论