• 设为首页
  • 点击收藏
  • 手机版
    手机扫一扫访问
    迪恩网络手机版
  • 关注官方公众号
    微信扫一扫关注
    迪恩网络公众号
登陆 注册
描述文字

Java RMNodeCleanContainerEvent类代码示例

原作者: [db:作者] 来自: [db:来源] 收藏 邀请

本文整理汇总了Java中org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeCleanContainerEvent类的典型用法代码示例。如果您正苦于以下问题：Java RMNodeCleanContainerEvent类的具体用法？Java RMNodeCleanContainerEvent怎么用？Java RMNodeCleanContainerEvent使用的例子？那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。



RMNodeCleanContainerEvent类属于org.apache.hadoop.yarn.server.resourcemanager.rmnode包，在下文中一共展示了RMNodeCleanContainerEvent类的20个代码示例，这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞，您的评价将有助于我们的系统推荐出更棒的Java代码示例。

示例1: containerLaunchedOnNode

import org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeCleanContainerEvent; //导入依赖的package包/类
protected synchronized void containerLaunchedOnNode(
    ContainerId containerId, SchedulerNode node) {
  // Get the application for the finished container
  SchedulerApplicationAttempt application = getCurrentAttemptForContainer
      (containerId);
  if (application == null) {
    LOG.info("Unknown application "
        + containerId.getApplicationAttemptId().getApplicationId()
        + " launched container " + containerId + " on node: " + node);
    this.rmContext.getDispatcher().getEventHandler()
      .handle(new RMNodeCleanContainerEvent(node.getNodeID(), containerId));
    return;
  }

  application.containerLaunchedOnNode(containerId, node.getNodeID());
}
开发者ID:naver，项目名称:hadoop，代码行数:17，代码来源:AbstractYarnScheduler.java


示例2: containerLaunchedOnNode

import org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeCleanContainerEvent; //导入依赖的package包/类
protected synchronized void containerLaunchedOnNode(
    ContainerId containerId, SchedulerNode node) {
  // Get the application for the finished container
  SchedulerApplicationAttempt application =
      getCurrentAttemptForContainer(containerId);
  if (application == null) {
    LOG.info("Unknown application " + containerId.getApplicationAttemptId()
        .getApplicationId() + " launched container " + containerId
        + " on node: " + node);
    this.rmContext.getDispatcher().getEventHandler()
      .handle(new RMNodeCleanContainerEvent(node.getNodeID(), containerId));
    return;
  }

  application.containerLaunchedOnNode(containerId, node.getNodeID());
}
开发者ID:aliyun-beta，项目名称:aliyun-oss-hadoop-fs，代码行数:17，代码来源:AbstractYarnScheduler.java


示例3: containerLaunchedOnNode

import org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeCleanContainerEvent; //导入依赖的package包/类
protected synchronized void containerLaunchedOnNode(
     ContainerStatus containerStatus, SchedulerNode node) {
   // Get the application for the finished container
ContainerId containerId = containerStatus.getContainerId();
   SchedulerApplicationAttempt application = getCurrentAttemptForContainer
       (containerId);
   if (application == null) {
     LOG.info("Unknown application "
         + containerId.getApplicationAttemptId().getApplicationId()
         + " launched container " + containerId + " on node: " + node);
     this.rmContext.getDispatcher().getEventHandler()
       .handle(new RMNodeCleanContainerEvent(node.getNodeID(), containerId));
     return;
   }

   Set<Integer> cpuCores = containerStatus.getCpuCores();
   node.registerCoresToContainer(containerId, cpuCores);
   application.containerLaunchedOnNode(containerId, node.getNodeID());
 }
开发者ID:yncxcw，项目名称:big-c，代码行数:20，代码来源:AbstractYarnScheduler.java


示例4: containerLaunchedOnNode

import org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeCleanContainerEvent; //导入依赖的package包/类
protected void containerLaunchedOnNode(ContainerId containerId,
                                       SchedulerNode node) {
  // Get the application for the finished container
  SchedulerApplicationAttempt application = getCurrentAttemptForContainer
      (containerId);
  if (application == null) {
    LOG.info("Unknown application "
        + containerId.getApplicationAttemptId().getApplicationId()
        + " launched container " + containerId + " on node: " + node);
    this.rmContext.getDispatcher().getEventHandler()
      .handle(new RMNodeCleanContainerEvent(node.getNodeID(), containerId));
    return;
  }

  application.containerLaunchedOnNode(containerId, node.getNodeID());
}
开发者ID:Nextzero，项目名称:hadoop-2.6.0-cdh5.4.3，代码行数:17，代码来源:AbstractYarnScheduler.java


示例5: containerLaunchedOnNode

import org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeCleanContainerEvent; //导入依赖的package包/类
private void containerLaunchedOnNode(ContainerId containerId, FiCaSchedulerNode node) {
  // Get the application for the finished container
  ApplicationAttemptId applicationAttemptId = containerId.getApplicationAttemptId();
  FiCaSchedulerApp application = getApplication(applicationAttemptId);
  if (application == null) {
    LOG.info("Unknown application: " + applicationAttemptId + 
        " launched container " + containerId +
        " on node: " + node);
    // Some unknown container sneaked into the system. Kill it.
    this.rmContext.getDispatcher().getEventHandler()
      .handle(new RMNodeCleanContainerEvent(node.getNodeID(), containerId));

    return;
  }
  
  application.containerLaunchedOnNode(containerId, node.getNodeID());
}
开发者ID:ict-carch，项目名称:hadoop-plus，代码行数:18，代码来源:FifoScheduler.java


示例6: containerLaunchedOnNode

import org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeCleanContainerEvent; //导入依赖的package包/类
@SuppressWarnings("unchecked")
public synchronized void containerLaunchedOnNode(ContainerId containerId,
    NodeId nodeId) {
  // Inform the container
  RMContainer rmContainer = 
      getRMContainer(containerId);
  if (rmContainer == null) {
    // Some unknown container sneaked into the system. Kill it.
    rmContext.getDispatcher().getEventHandler()
      .handle(new RMNodeCleanContainerEvent(nodeId, containerId));
    return;
  }

  rmContainer.handle(new RMContainerEvent(containerId,
    RMContainerEventType.LAUNCHED));
}
开发者ID:ict-carch，项目名称:hadoop-plus，代码行数:17，代码来源:FSSchedulerApp.java


示例7: containerLaunchedOnNode

import org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeCleanContainerEvent; //导入依赖的package包/类
protected synchronized void containerLaunchedOnNode(
    ContainerId containerId, SchedulerNode node) {
  // Get the application for the finished container
  SchedulerApplicationAttempt application =
      getCurrentAttemptForContainer(containerId);
  if (application == null) {
    LOG.info("Unknown application " + containerId.getApplicationAttemptId()
        .getApplicationId() + " launched container " + containerId
        + " on node: " + node);
    this.rmContext.getDispatcher().getEventHandler()
      .handle(new RMNodeCleanContainerEvent(node.getNodeID(), containerId));
    return;
  }

  application.containerLaunchedOnNode(containerId, node.getNodeID());
  node.containerStarted(containerId);
}
开发者ID:hopshadoop，项目名称:hops，代码行数:18，代码来源:AbstractYarnScheduler.java


示例8: containerLaunchedOnNode

import org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeCleanContainerEvent; //导入依赖的package包/类
private void containerLaunchedOnNode(ContainerId containerId, FiCaSchedulerNode node) {
  // Get the application for the finished container
  FiCaSchedulerApp application = getCurrentAttemptForContainer(containerId);
  if (application == null) {
    LOG.info("Unknown application "
        + containerId.getApplicationAttemptId().getApplicationId()
        + " launched container " + containerId + " on node: " + node);
    // Some unknown container sneaked into the system. Kill it.
    this.rmContext.getDispatcher().getEventHandler()
      .handle(new RMNodeCleanContainerEvent(node.getNodeID(), containerId));

    return;
  }
  
  application.containerLaunchedOnNode(containerId, node.getNodeID());
}
开发者ID:Seagate，项目名称:hadoop-on-lustre2，代码行数:17，代码来源:FifoScheduler.java


示例9: transition

import org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeCleanContainerEvent; //导入依赖的package包/类
@Override
public void transition(RMContainerImpl container, RMContainerEvent event) {

  // Unregister from containerAllocationExpirer.
  container.containerAllocationExpirer.unregister(container
      .getContainerId());

  // Inform node
  container.eventHandler.handle(new RMNodeCleanContainerEvent(
      container.nodeId, container.containerId));

  // Inform appAttempt
  super.transition(container, event);
}
开发者ID:naver，项目名称:hadoop，代码行数:15，代码来源:RMContainerImpl.java


示例10: containerLaunchedOnNode

import org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeCleanContainerEvent; //导入依赖的package包/类
@SuppressWarnings("unchecked")
public synchronized void containerLaunchedOnNode(ContainerId containerId,
    NodeId nodeId) {
  // Inform the container
  RMContainer rmContainer = getRMContainer(containerId);
  if (rmContainer == null) {
    // Some unknown container sneaked into the system. Kill it.
    rmContext.getDispatcher().getEventHandler()
      .handle(new RMNodeCleanContainerEvent(nodeId, containerId));
    return;
  }

  rmContainer.handle(new RMContainerEvent(containerId,
      RMContainerEventType.LAUNCHED));
}
开发者ID:naver，项目名称:hadoop，代码行数:16，代码来源:SchedulerApplicationAttempt.java


示例11: killOrphanContainerOnNode

import org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeCleanContainerEvent; //导入依赖的package包/类
private void killOrphanContainerOnNode(RMNode node,
    NMContainerStatus container) {
  if (!container.getContainerState().equals(ContainerState.COMPLETE)) {
    this.rmContext.getDispatcher().getEventHandler().handle(
      new RMNodeCleanContainerEvent(node.getNodeID(),
        container.getContainerId()));
  }
}
开发者ID:naver，项目名称:hadoop，代码行数:9，代码来源:AbstractYarnScheduler.java


示例12: testExpiredContainer

import org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeCleanContainerEvent; //导入依赖的package包/类
@Test (timeout = 5000)
public void testExpiredContainer() {
  // Start the node
  node.handle(new RMNodeStartedEvent(null, null, null));
  verify(scheduler).handle(any(NodeAddedSchedulerEvent.class));
  
  // Expire a container
  ContainerId completedContainerId = BuilderUtils.newContainerId(
      BuilderUtils.newApplicationAttemptId(
          BuilderUtils.newApplicationId(0, 0), 0), 0);
  node.handle(new RMNodeCleanContainerEvent(null, completedContainerId));
  Assert.assertEquals(1, node.getContainersToCleanUp().size());
  
  // Now verify that scheduler isn't notified of an expired container
  // by checking number of 'completedContainers' it got in the previous event
  RMNodeStatusEvent statusEvent = getMockRMNodeStatusEvent();
  ContainerStatus containerStatus = mock(ContainerStatus.class);
  doReturn(completedContainerId).when(containerStatus).getContainerId();
  doReturn(Collections.singletonList(containerStatus)).
      when(statusEvent).getContainers();
  node.handle(statusEvent);
  /* Expect the scheduler call handle function 2 times
   * 1. RMNode status from new to Running, handle the add_node event
   * 2. handle the node update event
   */
  verify(scheduler,times(2)).handle(any(NodeUpdateSchedulerEvent.class));     
}
开发者ID:naver，项目名称:hadoop，代码行数:28，代码来源:TestRMNodeTransitions.java


示例13: testUpdateHeartbeatResponseForCleanup

import org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeCleanContainerEvent; //导入依赖的package包/类
@Test(timeout=20000)
public void testUpdateHeartbeatResponseForCleanup() {
  RMNodeImpl node = getRunningNode();
  NodeId nodeId = node.getNodeID();

  // Expire a container
ContainerId completedContainerId = BuilderUtils.newContainerId(
		BuilderUtils.newApplicationAttemptId(
				BuilderUtils.newApplicationId(0, 0), 0), 0);
  node.handle(new RMNodeCleanContainerEvent(nodeId, completedContainerId));
  Assert.assertEquals(1, node.getContainersToCleanUp().size());

  // Finish an application
  ApplicationId finishedAppId = BuilderUtils.newApplicationId(0, 1);
  node.handle(new RMNodeCleanAppEvent(nodeId, finishedAppId));
  Assert.assertEquals(1, node.getAppsToCleanup().size());

  // Verify status update does not clear containers/apps to cleanup
  // but updating heartbeat response for cleanup does
  RMNodeStatusEvent statusEvent = getMockRMNodeStatusEvent();
  node.handle(statusEvent);
  Assert.assertEquals(1, node.getContainersToCleanUp().size());
  Assert.assertEquals(1, node.getAppsToCleanup().size());
  NodeHeartbeatResponse hbrsp = Records.newRecord(NodeHeartbeatResponse.class);
  node.updateNodeHeartbeatResponseForCleanup(hbrsp);
  Assert.assertEquals(0, node.getContainersToCleanUp().size());
  Assert.assertEquals(0, node.getAppsToCleanup().size());
  Assert.assertEquals(1, hbrsp.getContainersToCleanup().size());
  Assert.assertEquals(completedContainerId, hbrsp.getContainersToCleanup().get(0));
  Assert.assertEquals(1, hbrsp.getApplicationsToCleanup().size());
  Assert.assertEquals(finishedAppId, hbrsp.getApplicationsToCleanup().get(0));
}
开发者ID:naver，项目名称:hadoop，代码行数:33，代码来源:TestRMNodeTransitions.java


示例14: testExpiredContainer

import org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeCleanContainerEvent; //导入依赖的package包/类
@Test (timeout = 5000)
public void testExpiredContainer() {
  // Start the node
  node.handle(new RMNodeStartedEvent(null, null, null));
  verify(scheduler).handle(any(NodeAddedSchedulerEvent.class));
  
  // Expire a container
  ContainerId completedContainerId = BuilderUtils.newContainerId(
      BuilderUtils.newApplicationAttemptId(
          BuilderUtils.newApplicationId(0, 0), 0), 0);
  node.handle(new RMNodeCleanContainerEvent(null, completedContainerId));
  Assert.assertEquals(1, node.getContainersToCleanUp().size());
  
  // Now verify that scheduler isn't notified of an expired container
  // by checking number of 'completedContainers' it got in the previous event
  RMNodeStatusEvent statusEvent = getMockRMNodeStatusEvent(null);
  ContainerStatus containerStatus = mock(ContainerStatus.class);
  doReturn(completedContainerId).when(containerStatus).getContainerId();
  doReturn(Collections.singletonList(containerStatus)).
      when(statusEvent).getContainers();
  node.handle(statusEvent);
  /* Expect the scheduler call handle function 2 times
   * 1. RMNode status from new to Running, handle the add_node event
   * 2. handle the node update event
   */
  verify(scheduler,times(2)).handle(any(NodeUpdateSchedulerEvent.class));     
}
开发者ID:aliyun-beta，项目名称:aliyun-oss-hadoop-fs，代码行数:28，代码来源:TestRMNodeTransitions.java


示例15: testUpdateHeartbeatResponseForCleanup

import org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeCleanContainerEvent; //导入依赖的package包/类
@Test(timeout=20000)
public void testUpdateHeartbeatResponseForCleanup() {
  RMNodeImpl node = getRunningNode();
  NodeId nodeId = node.getNodeID();

  // Expire a container
  ContainerId completedContainerId = BuilderUtils.newContainerId(
      BuilderUtils.newApplicationAttemptId(
          BuilderUtils.newApplicationId(0, 0), 0), 0);
  node.handle(new RMNodeCleanContainerEvent(nodeId, completedContainerId));
  Assert.assertEquals(1, node.getContainersToCleanUp().size());

  // Finish an application
  ApplicationId finishedAppId = BuilderUtils.newApplicationId(0, 1);
  node.handle(new RMNodeCleanAppEvent(nodeId, finishedAppId));
  Assert.assertEquals(1, node.getAppsToCleanup().size());

  // Verify status update does not clear containers/apps to cleanup
  // but updating heartbeat response for cleanup does
  RMNodeStatusEvent statusEvent = getMockRMNodeStatusEvent(null);
  node.handle(statusEvent);
  Assert.assertEquals(1, node.getContainersToCleanUp().size());
  Assert.assertEquals(1, node.getAppsToCleanup().size());
  NodeHeartbeatResponse hbrsp = Records.newRecord(NodeHeartbeatResponse.class);
  node.updateNodeHeartbeatResponseForCleanup(hbrsp);
  Assert.assertEquals(0, node.getContainersToCleanUp().size());
  Assert.assertEquals(0, node.getAppsToCleanup().size());
  Assert.assertEquals(1, hbrsp.getContainersToCleanup().size());
  Assert.assertEquals(completedContainerId, hbrsp.getContainersToCleanup().get(0));
  Assert.assertEquals(1, hbrsp.getApplicationsToCleanup().size());
  Assert.assertEquals(finishedAppId, hbrsp.getApplicationsToCleanup().get(0));
}
开发者ID:aliyun-beta，项目名称:aliyun-oss-hadoop-fs，代码行数:33，代码来源:TestRMNodeTransitions.java


示例16: containerLaunchedOnNode

import org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeCleanContainerEvent; //导入依赖的package包/类
public synchronized void containerLaunchedOnNode(ContainerId containerId,
    NodeId nodeId) {
  // Inform the container
  RMContainer rmContainer = 
      getRMContainer(containerId);
  if (rmContainer == null) {
    // Some unknown container sneaked into the system. Kill it.
    this.rmContext.getDispatcher().getEventHandler()
      .handle(new RMNodeCleanContainerEvent(nodeId, containerId));
    return;
  }

  rmContainer.handle(new RMContainerEvent(containerId,
    RMContainerEventType.LAUNCHED));
}
开发者ID:ict-carch，项目名称:hadoop-plus，代码行数:16，代码来源:FiCaSchedulerApp.java


示例17: containerLaunchedOnNode

import org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeCleanContainerEvent; //导入依赖的package包/类
private void containerLaunchedOnNode(ContainerId containerId, FiCaSchedulerNode node) {
  // Get the application for the finished container
  ApplicationAttemptId applicationAttemptId = containerId.getApplicationAttemptId();
  FiCaSchedulerApp application = getApplication(applicationAttemptId);
  if (application == null) {
    LOG.info("Unknown application: " + applicationAttemptId + 
        " launched container " + containerId +
        " on node: " + node);
    this.rmContext.getDispatcher().getEventHandler()
      .handle(new RMNodeCleanContainerEvent(node.getNodeID(), containerId));
    return;
  }
  
  application.containerLaunchedOnNode(containerId, node.getNodeID());
}
开发者ID:ict-carch，项目名称:hadoop-plus，代码行数:16，代码来源:CapacityScheduler.java


示例18: testExpiredContainer

import org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeCleanContainerEvent; //导入依赖的package包/类
@Test (timeout = 5000)
public void testExpiredContainer() {
  // Start the node
  node.handle(new RMNodeEvent(null, RMNodeEventType.STARTED));
  verify(scheduler).handle(any(NodeAddedSchedulerEvent.class));
  
  // Expire a container
  ContainerId completedContainerId = BuilderUtils.newContainerId(
      BuilderUtils.newApplicationAttemptId(
          BuilderUtils.newApplicationId(0, 0), 0), 0);
  node.handle(new RMNodeCleanContainerEvent(null, completedContainerId));
  Assert.assertEquals(1, node.getContainersToCleanUp().size());
  
  // Now verify that scheduler isn't notified of an expired container
  // by checking number of 'completedContainers' it got in the previous event
  RMNodeStatusEvent statusEvent = getMockRMNodeStatusEvent();
  ContainerStatus containerStatus = mock(ContainerStatus.class);
  doReturn(completedContainerId).when(containerStatus).getContainerId();
  doReturn(Collections.singletonList(containerStatus)).
      when(statusEvent).getContainers();
  node.handle(statusEvent);
  /* Expect the scheduler call handle function 2 times
   * 1. RMNode status from new to Running, handle the add_node event
   * 2. handle the node update event
   */
  verify(scheduler,times(2)).handle(any(NodeUpdateSchedulerEvent.class));     
}
开发者ID:ict-carch，项目名称:hadoop-plus，代码行数:28，代码来源:TestRMNodeTransitions.java


示例19: transition

import org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeCleanContainerEvent; //导入依赖的package包/类
@Override
public void transition(RMContainerImpl container, RMContainerEvent event) {

  // Unregister from containerAllocationExpirer.
  container.containerAllocationExpirer.unregister(
      new AllocationExpirationInfo(container.getContainerId()));

  // Inform node
  container.eventHandler.handle(new RMNodeCleanContainerEvent(
      container.nodeId, container.containerId));

  // Inform appAttempt
  super.transition(container, event);
}
开发者ID:hopshadoop，项目名称:hops，代码行数:15，代码来源:RMContainerImpl.java


示例20: containerIncreasedOnNode

import org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeCleanContainerEvent; //导入依赖的package包/类
protected void containerIncreasedOnNode(ContainerId containerId,
    SchedulerNode node, Container increasedContainerReportedByNM) {
  // Get the application for the finished container
  SchedulerApplicationAttempt application =
      getCurrentAttemptForContainer(containerId);
  if (application == null) {
    LOG.info("Unknown application "
        + containerId.getApplicationAttemptId().getApplicationId()
        + " increased container " + containerId + " on node: " + node);
    this.rmContext.getDispatcher().getEventHandler()
        .handle(new RMNodeCleanContainerEvent(node.getNodeID(), containerId));
    return;
  }
  LeafQueue leafQueue = (LeafQueue) application.getQueue();
  synchronized (leafQueue) {
    RMContainer rmContainer = getRMContainer(containerId);
    if (rmContainer == null) {
      // Some unknown container sneaked into the system. Kill it.
      this.rmContext.getDispatcher().getEventHandler()
          .handle(new RMNodeCleanContainerEvent(
              node.getNodeID(), containerId));
      return;
    }
    rmContainer.handle(new RMContainerNMDoneChangeResourceEvent(
        containerId, increasedContainerReportedByNM.getResource()));
  }
}
开发者ID:hopshadoop，项目名称:hops，代码行数:28，代码来源:AbstractYarnScheduler.java



注：本文中的org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeCleanContainerEvent类示例整理自Github/MSDocs等源码及文档管理平台，相关代码片段筛选自各路编程大神贡献的开源项目，源码版权归原作者所有，传播和使用请参考对应项目的License；未经允许，请勿转载。

鲜花
握手
雷人
路过
鸡蛋
该文章已有0人参与评论

请发表评论

全部评论

专题导读
More+
上一篇：
Java ContentHandler类代码示例发布时间：2022-05-22
下一篇：
Java RelOptRuleOperand类代码示例发布时间：2022-05-22
热门推荐
More+
热门话题
More+
阅读排行榜

扫描微信二维码

查看手机版网站

随时了解更新最新资讯

139-2527-9053

在线客服（服务时间 9:00～18:00）

在线QQ客服
地址：深圳市南山区西丽大学城创智工业园
电邮：jeky_zhao#qq.com
移动电话：139-2527-9053

Powered by 互联科技 X3.4© 2001-2213 极客世界.|Sitemap