• 设为首页
  • 点击收藏
  • 手机版
    手机扫一扫访问
    迪恩网络手机版
  • 关注官方公众号
    微信扫一扫关注
    迪恩网络公众号

Java ContainerFailedEvent类代码示例

原作者: [db:作者] 来自: [db:来源] 收藏 邀请

本文整理汇总了Java中org.apache.hadoop.mapreduce.v2.app.rm.ContainerFailedEvent的典型用法代码示例。如果您正苦于以下问题:Java ContainerFailedEvent类的具体用法?Java ContainerFailedEvent怎么用?Java ContainerFailedEvent使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。



ContainerFailedEvent类属于org.apache.hadoop.mapreduce.v2.app.rm包,在下文中一共展示了ContainerFailedEvent类的4个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于我们的系统推荐出更棒的Java代码示例。

示例1: createFailEvent

import org.apache.hadoop.mapreduce.v2.app.rm.ContainerFailedEvent; //导入依赖的package包/类
private ContainerFailedEvent createFailEvent(JobId jobId, int taskAttemptId,
    String host, boolean reduce) {
  TaskId taskId;
  if (reduce) {
    taskId = MRBuilderUtils.newTaskId(jobId, 0, TaskType.REDUCE);
  } else {
    taskId = MRBuilderUtils.newTaskId(jobId, 0, TaskType.MAP);
  }
  TaskAttemptId attemptId = MRBuilderUtils.newTaskAttemptId(taskId,
      taskAttemptId);
  return new ContainerFailedEvent(attemptId, host);    
}
 
开发者ID:ict-carch,项目名称:hadoop-plus,代码行数:13,代码来源:TestRMContainerAllocator.java


示例2: transition

import org.apache.hadoop.mapreduce.v2.app.rm.ContainerFailedEvent; //导入依赖的package包/类
@Override
public TaskStateInternal transition(TaskImpl task, TaskEvent event) {
  TaskTAttemptEvent castEvent = (TaskTAttemptEvent) event;
  TaskAttemptId taskAttemptId = castEvent.getTaskAttemptID();
  task.failedAttempts.add(taskAttemptId); 
  if (taskAttemptId.equals(task.commitAttempt)) {
    task.commitAttempt = null;
  }
  TaskAttempt attempt = task.attempts.get(taskAttemptId);
  if (attempt.getAssignedContainerMgrAddress() != null) {
    //container was assigned
    task.eventHandler.handle(new ContainerFailedEvent(attempt.getID(), 
        attempt.getAssignedContainerMgrAddress()));
  }
  
  task.finishedAttempts.add(taskAttemptId);
  if (task.failedAttempts.size() < task.maxAttempts) {
    task.handleTaskAttemptCompletion(
        taskAttemptId, 
        TaskAttemptCompletionEventStatus.FAILED);
    // we don't need a new event if we already have a spare
    task.inProgressAttempts.remove(taskAttemptId);
    if (task.inProgressAttempts.size() == 0
        && task.successfulAttempt == null) {
      task.addAndScheduleAttempt(Avataar.VIRGIN);
    }
  } else {
    task.handleTaskAttemptCompletion(
        taskAttemptId, 
        TaskAttemptCompletionEventStatus.TIPFAILED);

    // issue kill to all non finished attempts
    for (TaskAttempt taskAttempt : task.attempts.values()) {
      task.killUnfinishedAttempt
        (taskAttempt, "Task has failed. Killing attempt!");
    }
    task.inProgressAttempts.clear();
    
    if (task.historyTaskStartGenerated) {
    TaskFailedEvent taskFailedEvent = createTaskFailedEvent(task, attempt.getDiagnostics(),
        TaskStateInternal.FAILED, taskAttemptId);
    task.eventHandler.handle(new JobHistoryEvent(task.taskId.getJobId(),
        taskFailedEvent));
    } else {
      LOG.debug("Not generating HistoryFinish event since start event not" +
      		" generated for task: " + task.getID());
    }
    task.eventHandler.handle(
        new JobTaskEvent(task.taskId, TaskState.FAILED));
    return task.finished(TaskStateInternal.FAILED);
  }
  return getDefaultState(task);
}
 
开发者ID:naver,项目名称:hadoop,代码行数:54,代码来源:TaskImpl.java


示例3: transition

import org.apache.hadoop.mapreduce.v2.app.rm.ContainerFailedEvent; //导入依赖的package包/类
@Override
public TaskStateInternal transition(TaskImpl task, TaskEvent event) {
  TaskTAttemptEvent castEvent = (TaskTAttemptEvent) event;
  TaskAttemptId taskAttemptId = castEvent.getTaskAttemptID();
  task.failedAttempts.add(taskAttemptId); 
  if (taskAttemptId.equals(task.commitAttempt)) {
    task.commitAttempt = null;
  }
  TaskAttempt attempt = task.attempts.get(taskAttemptId);
  if (attempt.getAssignedContainerMgrAddress() != null) {
    //container was assigned
    task.eventHandler.handle(new ContainerFailedEvent(attempt.getID(), 
        attempt.getAssignedContainerMgrAddress()));
  }
  
  task.finishedAttempts.add(taskAttemptId);
  if (task.failedAttempts.size() < task.maxAttempts) {
    task.handleTaskAttemptCompletion(
        taskAttemptId, 
        TaskAttemptCompletionEventStatus.FAILED);
    // we don't need a new event if we already have a spare
    task.inProgressAttempts.remove(taskAttemptId);
    if (task.successfulAttempt == null) {
      boolean shouldAddNewAttempt = true;
      if (task.inProgressAttempts.size() > 0) {
        // if not all of the inProgressAttempts are hanging for resource
        for (TaskAttemptId attemptId : task.inProgressAttempts) {
          if (((TaskAttemptImpl) task.getAttempt(attemptId))
              .isContainerAssigned()) {
            shouldAddNewAttempt = false;
            break;
          }
        }
      }
      if (shouldAddNewAttempt) {
        task.addAndScheduleAttempt(Avataar.VIRGIN);
      }
    }
  } else {
    task.handleTaskAttemptCompletion(
        taskAttemptId, 
        TaskAttemptCompletionEventStatus.TIPFAILED);

    // issue kill to all non finished attempts
    for (TaskAttempt taskAttempt : task.attempts.values()) {
      task.killUnfinishedAttempt
        (taskAttempt, "Task has failed. Killing attempt!");
    }
    task.inProgressAttempts.clear();
    
    if (task.historyTaskStartGenerated) {
    TaskFailedEvent taskFailedEvent = createTaskFailedEvent(task, attempt.getDiagnostics(),
        TaskStateInternal.FAILED, taskAttemptId);
    task.eventHandler.handle(new JobHistoryEvent(task.taskId.getJobId(),
        taskFailedEvent));
    } else {
      LOG.debug("Not generating HistoryFinish event since start event not" +
          " generated for task: " + task.getID());
    }
    task.eventHandler.handle(
        new JobTaskEvent(task.taskId, TaskState.FAILED));
    return task.finished(TaskStateInternal.FAILED);
  }
  return getDefaultState(task);
}
 
开发者ID:aliyun-beta,项目名称:aliyun-oss-hadoop-fs,代码行数:66,代码来源:TaskImpl.java


示例4: sendFailure

import org.apache.hadoop.mapreduce.v2.app.rm.ContainerFailedEvent; //导入依赖的package包/类
public void sendFailure(ContainerFailedEvent f) {
  super.handleEvent(f);
}
 
开发者ID:ict-carch,项目名称:hadoop-plus,代码行数:4,代码来源:TestRMContainerAllocator.java



注:本文中的org.apache.hadoop.mapreduce.v2.app.rm.ContainerFailedEvent类示例整理自Github/MSDocs等源码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。


鲜花

握手

雷人

路过

鸡蛋
该文章已有0人参与评论

请发表评论

全部评论

专题导读
上一篇:
Java Request类代码示例发布时间:2022-05-22
下一篇:
Java ServiceCache类代码示例发布时间:2022-05-22
热门推荐
阅读排行榜

扫描微信二维码

查看手机版网站

随时了解更新最新资讯

139-2527-9053

在线客服(服务时间 9:00~18:00)

在线QQ客服
地址:深圳市南山区西丽大学城创智工业园
电邮:jeky_zhao#qq.com
移动电话:139-2527-9053

Powered by 互联科技 X3.4© 2001-2213 极客世界.|Sitemap