• 设为首页
  • 点击收藏
  • 手机版
    手机扫一扫访问
    迪恩网络手机版
  • 关注官方公众号
    微信扫一扫关注
    迪恩网络公众号

Java SchedulerAppUtils类代码示例

原作者: [db:作者] 来自: [db:来源] 收藏 邀请

本文整理汇总了Java中org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerAppUtils的典型用法代码示例。如果您正苦于以下问题:Java SchedulerAppUtils类的具体用法?Java SchedulerAppUtils怎么用?Java SchedulerAppUtils使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。



SchedulerAppUtils类属于org.apache.hadoop.yarn.server.resourcemanager.scheduler包,在下文中一共展示了SchedulerAppUtils类的5个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于我们的系统推荐出更棒的Java代码示例。

示例1: assignContainer

import org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerAppUtils; //导入依赖的package包/类
@Override
public Resource assignContainer(FSSchedulerNode node) {
  Resource assigned = Resources.none();
  if (LOG.isDebugEnabled()) {
    LOG.debug("Node " + node.getNodeName() + " offered to queue: " + getName());
  }

  if (!assignContainerPreCheck(node)) {
    return assigned;
  }

  Comparator<Schedulable> comparator = policy.getComparator();
  Collections.sort(runnableAppScheds, comparator);
  for (AppSchedulable sched : runnableAppScheds) {
    if (SchedulerAppUtils.isBlacklisted(sched.getApp(), node, LOG)) {
      continue;
    }

    assigned = sched.assignContainer(node);
    if (!assigned.equals(Resources.none())) {
      break;
    }
  }
  return assigned;
}
 
开发者ID:Seagate,项目名称:hadoop-on-lustre2,代码行数:26,代码来源:FSLeafQueue.java


示例2: assignContainer

import org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerAppUtils; //导入依赖的package包/类
@Override
public Resource assignContainer(FSSchedulerNode node) {
  Resource assigned = Resources.none();
  if (LOG.isDebugEnabled()) {
    LOG.debug("Node " + node.getNodeName() + " offered to queue: " +
        getName());
  }

  if (!assignContainerPreCheck(node)) {
    return assigned;
  }

  Comparator<Schedulable> comparator = policy.getComparator();
  writeLock.lock();
  try {
    Collections.sort(runnableApps, comparator);
  } finally {
    writeLock.unlock();
  }
  // Release write lock here for better performance and avoiding deadlocks.
  // runnableApps can be in unsorted state because of this section,
  // but we can accept it in practice since the probability is low.
  readLock.lock();
  try {
    for (FSAppAttempt sched : runnableApps) {
      if (SchedulerAppUtils.isBlacklisted(sched, node, LOG)) {
        continue;
      }

      assigned = sched.assignContainer(node);
      if (!assigned.equals(Resources.none())) {
        break;
      }
    }
  } finally {
    readLock.unlock();
  }
  return assigned;
}
 
开发者ID:naver,项目名称:hadoop,代码行数:40,代码来源:FSLeafQueue.java


示例3: assignContainer

import org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerAppUtils; //导入依赖的package包/类
@Override
public Resource assignContainer(FSSchedulerNode node) {
  Resource assigned = Resources.none();
  if (LOG.isDebugEnabled()) {
    LOG.debug("Node " + node.getNodeName() + " offered to queue: " +
        getName());
  }

  if (!assignContainerPreCheck(node)) {
    return assigned;
  }

  Comparator<Schedulable> comparator = policy.getComparator();
  writeLock.lock();
  try {
    Collections.sort(runnableApps, comparator);
  } finally {
    writeLock.unlock();
  }
  readLock.lock();
  try {
    for (FSAppAttempt sched : runnableApps) {
      if (SchedulerAppUtils.isBlacklisted(sched, node, LOG)) {
        continue;
      }

      assigned = sched.assignContainer(node);
      if (!assigned.equals(Resources.none())) {
        break;
      }
    }
  } finally {
    readLock.unlock();
  }
  return assigned;
}
 
开发者ID:Nextzero,项目名称:hadoop-2.6.0-cdh5.4.3,代码行数:37,代码来源:FSLeafQueue.java


示例4: assignContainer

import org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerAppUtils; //导入依赖的package包/类
@Override
public Resource assignContainer(FSSchedulerNode node) {
  Resource assigned = Resources.none();
  if (LOG.isDebugEnabled()) {
    LOG.debug("Node " + node.getNodeName() + " offered to queue: " +
        getName() + " fairShare: " + getFairShare());
  }

  if (!assignContainerPreCheck(node)) {
    return assigned;
  }

  // Apps that have resource demands.
  TreeSet<FSAppAttempt> pendingForResourceApps =
      new TreeSet<FSAppAttempt>(policy.getComparator());
  readLock.lock();
  try {
    for (FSAppAttempt app : runnableApps) {
      Resource pending = app.getAppAttemptResourceUsage().getPending();
      if (!pending.equals(Resources.none())) {
        pendingForResourceApps.add(app);
      }
    }
  } finally {
    readLock.unlock();
  }
  for (FSAppAttempt sched : pendingForResourceApps) {
    if (SchedulerAppUtils.isBlacklisted(sched, node, LOG)) {
      continue;
    }
    assigned = sched.assignContainer(node);
    if (!assigned.equals(Resources.none())) {
      if (LOG.isDebugEnabled()) {
        LOG.debug("Assigned container in queue:" + getName() + " " +
            "container:" + assigned);
      }
      break;
    }
  }
  return assigned;
}
 
开发者ID:aliyun-beta,项目名称:aliyun-oss-hadoop-fs,代码行数:42,代码来源:FSLeafQueue.java


示例5: assignContainer

import org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerAppUtils; //导入依赖的package包/类
@Override
public Resource assignContainer(FSSchedulerNode node) {
  Resource assigned = Resources.none();
  if (LOG.isDebugEnabled()) {
    LOG.debug("Node " + node.getNodeName() + " offered to queue: " +
        getName() + " fairShare: " + getFairShare());
  }

  if (!assignContainerPreCheck(node)) {
    return assigned;
  }

  // Apps that have resource demands.
  TreeSet<FSAppAttempt> pendingForResourceApps =
      new TreeSet<FSAppAttempt>(policy.getComparator());
  readLock.lock();
  try {
    for (FSAppAttempt app : runnableApps) {
      Resource pending = app.getAppAttemptResourceUsage().getPending();
      if (!pending.equals(Resources.none())) {
        pendingForResourceApps.add(app);
      }
    }
  } finally {
    readLock.unlock();
  }
  for (FSAppAttempt sched : pendingForResourceApps) {
    if (SchedulerAppUtils.isPlaceBlacklisted(sched, node, LOG)) {
      continue;
    }
    assigned = sched.assignContainer(node);
    if (!assigned.equals(Resources.none())) {
      if (LOG.isDebugEnabled()) {
        LOG.debug("Assigned container in queue:" + getName() + " " +
            "container:" + assigned);
      }
      break;
    }
  }
  return assigned;
}
 
开发者ID:hopshadoop,项目名称:hops,代码行数:42,代码来源:FSLeafQueue.java



注:本文中的org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerAppUtils类示例整理自Github/MSDocs等源码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。


鲜花

握手

雷人

路过

鸡蛋
该文章已有0人参与评论

请发表评论

全部评论

专题导读
上一篇:
Java CtBinaryOperator类代码示例发布时间:2022-05-23
下一篇:
Java QualifiedSuperReference类代码示例发布时间:2022-05-23
热门推荐
阅读排行榜

扫描微信二维码

查看手机版网站

随时了解更新最新资讯

139-2527-9053

在线客服(服务时间 9:00~18:00)

在线QQ客服
地址:深圳市南山区西丽大学城创智工业园
电邮:jeky_zhao#qq.com
移动电话:139-2527-9053

Powered by 互联科技 X3.4© 2001-2213 极客世界.|Sitemap