本文整理汇总了Java中org.apache.hadoop.yarn.server.applicationhistoryservice.records.ApplicationAttemptFinishData类的典型用法代码示例。如果您正苦于以下问题:Java ApplicationAttemptFinishData类的具体用法?Java ApplicationAttemptFinishData怎么用?Java ApplicationAttemptFinishData使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。
ApplicationAttemptFinishData类属于org.apache.hadoop.yarn.server.applicationhistoryservice.records包,在下文中一共展示了ApplicationAttemptFinishData类的11个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于我们的系统推荐出更棒的Java代码示例。
示例1: applicationAttemptFinished
import org.apache.hadoop.yarn.server.applicationhistoryservice.records.ApplicationAttemptFinishData; //导入依赖的package包/类
@Override
public void applicationAttemptFinished(
ApplicationAttemptFinishData appAttemptFinish) throws IOException {
ConcurrentMap<ApplicationAttemptId, ApplicationAttemptHistoryData> subMap =
getSubMap(appAttemptFinish.getApplicationAttemptId().getApplicationId());
ApplicationAttemptHistoryData data =
subMap.get(appAttemptFinish.getApplicationAttemptId());
if (data == null) {
throw new IOException("The finish information of application attempt "
+ appAttemptFinish.getApplicationAttemptId() + " is stored before"
+ " the start information.");
}
// Make the assumption that YarnApplicationAttemptState should not be null
// if the finish information is already recorded
if (data.getYarnApplicationAttemptState() != null) {
throw new IOException("The finish information of application attempt "
+ appAttemptFinish.getApplicationAttemptId() + " is already stored.");
}
data.setTrackingURL(appAttemptFinish.getTrackingURL());
data.setDiagnosticsInfo(appAttemptFinish.getDiagnosticsInfo());
data
.setFinalApplicationStatus(appAttemptFinish.getFinalApplicationStatus());
data.setYarnApplicationAttemptState(appAttemptFinish
.getYarnApplicationAttemptState());
}
开发者ID:naver,项目名称:hadoop,代码行数:26,代码来源:MemoryApplicationHistoryStore.java
示例2: applicationAttemptFinished
import org.apache.hadoop.yarn.server.applicationhistoryservice.records.ApplicationAttemptFinishData; //导入依赖的package包/类
@Override
public void applicationAttemptFinished(
ApplicationAttemptFinishData appAttemptFinish) throws IOException {
HistoryFileWriter hfWriter =
getHistoryFileWriter(appAttemptFinish.getApplicationAttemptId()
.getApplicationId());
assert appAttemptFinish instanceof ApplicationAttemptFinishDataPBImpl;
try {
hfWriter.writeHistoryData(new HistoryDataKey(appAttemptFinish
.getApplicationAttemptId().toString(), FINISH_DATA_SUFFIX),
((ApplicationAttemptFinishDataPBImpl) appAttemptFinish).getProto()
.toByteArray());
LOG.info("Finish information of application attempt "
+ appAttemptFinish.getApplicationAttemptId() + " is written");
} catch (IOException e) {
LOG.error("Error when writing finish information of application attempt "
+ appAttemptFinish.getApplicationAttemptId(), e);
throw e;
}
}
开发者ID:naver,项目名称:hadoop,代码行数:21,代码来源:FileSystemApplicationHistoryStore.java
示例3: applicationAttemptFinished
import org.apache.hadoop.yarn.server.applicationhistoryservice.records.ApplicationAttemptFinishData; //导入依赖的package包/类
@Override
public void applicationAttemptFinished(
ApplicationAttemptFinishData appAttemptFinish) throws IOException {
HistoryFileWriter hfWriter =
getHistoryFileWriter(appAttemptFinish.getApplicationAttemptId()
.getApplicationId());
assert appAttemptFinish instanceof ApplicationAttemptFinishDataPBImpl;
try {
hfWriter.writeHistoryData(new HistoryDataKey(appAttemptFinish
.getApplicationAttemptId().toString(), FINISH_DATA_SUFFIX),
((ApplicationAttemptFinishDataPBImpl) appAttemptFinish).getProto()
.toByteArray());
LOG.info("Finish information of application attempt "
+ appAttemptFinish.getApplicationAttemptId() + " is written");
} catch (IOException e) {
LOG.error("Error when writing finish information of application attempt "
+ appAttemptFinish.getApplicationAttemptId());
throw e;
}
}
开发者ID:Seagate,项目名称:hadoop-on-lustre2,代码行数:21,代码来源:FileSystemApplicationHistoryStore.java
示例4: applicationAttemptFinished
import org.apache.hadoop.yarn.server.applicationhistoryservice.records.ApplicationAttemptFinishData; //导入依赖的package包/类
@SuppressWarnings("unchecked")
public void applicationAttemptFinished(RMAppAttempt appAttempt,
RMAppAttemptState finalState) {
if (historyServiceEnabled) {
dispatcher.getEventHandler().handle(
new WritingApplicationAttemptFinishEvent(appAttempt.getAppAttemptId(),
ApplicationAttemptFinishData.newInstance(
appAttempt.getAppAttemptId(), appAttempt.getDiagnostics()
.toString(), appAttempt.getTrackingUrl(), appAttempt
.getFinalApplicationStatus(),
RMServerUtils.createApplicationAttemptState(finalState))));
}
}
开发者ID:naver,项目名称:hadoop,代码行数:14,代码来源:RMApplicationHistoryWriter.java
示例5: WritingApplicationAttemptFinishEvent
import org.apache.hadoop.yarn.server.applicationhistoryservice.records.ApplicationAttemptFinishData; //导入依赖的package包/类
public WritingApplicationAttemptFinishEvent(
ApplicationAttemptId appAttemptId,
ApplicationAttemptFinishData appAttemptFinish) {
super(WritingHistoryEventType.APP_ATTEMPT_FINISH);
this.appAttemptId = appAttemptId;
this.appAttemptFinish = appAttemptFinish;
}
开发者ID:naver,项目名称:hadoop,代码行数:8,代码来源:WritingApplicationAttemptFinishEvent.java
示例6: mergeApplicationAttemptHistoryData
import org.apache.hadoop.yarn.server.applicationhistoryservice.records.ApplicationAttemptFinishData; //导入依赖的package包/类
private static void mergeApplicationAttemptHistoryData(
ApplicationAttemptHistoryData historyData,
ApplicationAttemptFinishData finishData) {
historyData.setDiagnosticsInfo(finishData.getDiagnosticsInfo());
historyData.setTrackingURL(finishData.getTrackingURL());
historyData.setFinalApplicationStatus(finishData
.getFinalApplicationStatus());
historyData.setYarnApplicationAttemptState(finishData
.getYarnApplicationAttemptState());
}
开发者ID:naver,项目名称:hadoop,代码行数:11,代码来源:FileSystemApplicationHistoryStore.java
示例7: getApplicationAttemptFinishData
import org.apache.hadoop.yarn.server.applicationhistoryservice.records.ApplicationAttemptFinishData; //导入依赖的package包/类
public ApplicationAttemptFinishData getApplicationAttemptFinishData() {
return appAttemptFinish;
}
开发者ID:naver,项目名称:hadoop,代码行数:4,代码来源:WritingApplicationAttemptFinishEvent.java
示例8: applicationAttemptFinished
import org.apache.hadoop.yarn.server.applicationhistoryservice.records.ApplicationAttemptFinishData; //导入依赖的package包/类
@Override
public void applicationAttemptFinished(
ApplicationAttemptFinishData appAttemptFinish) throws IOException {
}
开发者ID:naver,项目名称:hadoop,代码行数:5,代码来源:NullApplicationHistoryStore.java
示例9: getApplicationAttempt
import org.apache.hadoop.yarn.server.applicationhistoryservice.records.ApplicationAttemptFinishData; //导入依赖的package包/类
@Override
public ApplicationAttemptHistoryData getApplicationAttempt(
ApplicationAttemptId appAttemptId) throws IOException {
HistoryFileReader hfReader =
getHistoryFileReader(appAttemptId.getApplicationId());
try {
boolean readStartData = false;
boolean readFinishData = false;
ApplicationAttemptHistoryData historyData =
ApplicationAttemptHistoryData.newInstance(appAttemptId, null, -1,
null, null, null, FinalApplicationStatus.UNDEFINED, null);
while ((!readStartData || !readFinishData) && hfReader.hasNext()) {
HistoryFileReader.Entry entry = hfReader.next();
if (entry.key.id.equals(appAttemptId.toString())) {
if (entry.key.suffix.equals(START_DATA_SUFFIX)) {
ApplicationAttemptStartData startData =
parseApplicationAttemptStartData(entry.value);
mergeApplicationAttemptHistoryData(historyData, startData);
readStartData = true;
} else if (entry.key.suffix.equals(FINISH_DATA_SUFFIX)) {
ApplicationAttemptFinishData finishData =
parseApplicationAttemptFinishData(entry.value);
mergeApplicationAttemptHistoryData(historyData, finishData);
readFinishData = true;
}
}
}
if (!readStartData && !readFinishData) {
return null;
}
if (!readStartData) {
LOG.warn("Start information is missing for application attempt "
+ appAttemptId);
}
if (!readFinishData) {
LOG.warn("Finish information is missing for application attempt "
+ appAttemptId);
}
LOG.info("Completed reading history information of application attempt "
+ appAttemptId);
return historyData;
} catch (IOException e) {
LOG.error("Error when reading history file of application attempt"
+ appAttemptId, e);
throw e;
} finally {
hfReader.close();
}
}
开发者ID:naver,项目名称:hadoop,代码行数:50,代码来源:FileSystemApplicationHistoryStore.java
示例10: parseApplicationAttemptFinishData
import org.apache.hadoop.yarn.server.applicationhistoryservice.records.ApplicationAttemptFinishData; //导入依赖的package包/类
private static ApplicationAttemptFinishData
parseApplicationAttemptFinishData(byte[] value)
throws InvalidProtocolBufferException {
return new ApplicationAttemptFinishDataPBImpl(
ApplicationAttemptFinishDataProto.parseFrom(value));
}
开发者ID:naver,项目名称:hadoop,代码行数:7,代码来源:FileSystemApplicationHistoryStore.java
示例11: writeApplicationAttemptFinishData
import org.apache.hadoop.yarn.server.applicationhistoryservice.records.ApplicationAttemptFinishData; //导入依赖的package包/类
protected void writeApplicationAttemptFinishData(
ApplicationAttemptId appAttemptId) throws IOException {
store.applicationAttemptFinished(ApplicationAttemptFinishData.newInstance(
appAttemptId, appAttemptId.toString(), "test tracking url",
FinalApplicationStatus.UNDEFINED, YarnApplicationAttemptState.FINISHED));
}
开发者ID:naver,项目名称:hadoop,代码行数:7,代码来源:ApplicationHistoryStoreTestUtils.java
注:本文中的org.apache.hadoop.yarn.server.applicationhistoryservice.records.ApplicationAttemptFinishData类示例整理自Github/MSDocs等源码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。 |
请发表评论