Java RetireJobInfo类代码示例

OGeek|极客世界-中国程序员成长平台 › 门户 › 编程› Java›Java编程经验

原作者: [db:作者] 来自: [db:来源] 收藏邀请

本文整理汇总了Java中org.apache.hadoop.mapred.JobTracker.RetireJobInfo类的典型用法代码示例。如果您正苦于以下问题：Java RetireJobInfo类的具体用法？Java RetireJobInfo怎么用？Java RetireJobInfo使用的例子？那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。

RetireJobInfo类属于org.apache.hadoop.mapred.JobTracker包，在下文中一共展示了RetireJobInfo类的8个代码示例，这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞，您的评价将有助于我们的系统推荐出更棒的Java代码示例。

示例1: validateJobRetire

import org.apache.hadoop.mapred.JobTracker.RetireJobInfo; //导入依赖的package包/类
private JobID validateJobRetire(JobConf jobConf, Path inDir, Path outDir,
    JobTracker jobtracker) throws IOException {

  RunningJob rj = UtilsForTests.runJob(jobConf, inDir, outDir, 0, 0);
  rj.waitForCompletion();
  assertTrue(rj.isSuccessful());
  JobID id = rj.getID();

  //wait for job to get retired
  waitTillRetire(id, jobtracker);
  RetireJobInfo retired = jobtracker.retireJobs.get(id);
  assertTrue("History url not set", retired.getHistoryFile() != null &&
    retired.getHistoryFile().length() > 0);
  assertNotNull("Job is not in cache", jobtracker.getJobStatus(id));

  // get the job conf filename
  String name = jobtracker.getLocalJobFilePath(id);
  File file = new File(name);

  assertFalse("JobConf file not deleted", file.exists());
  //test redirection
  URL jobUrl = new URL(rj.getTrackingURL());
  HttpURLConnection conn = (HttpURLConnection) jobUrl.openConnection();
  conn.setInstanceFollowRedirects(false);
  conn.connect();
  assertEquals(HttpURLConnection.HTTP_MOVED_TEMP, conn.getResponseCode());
  conn.disconnect();

  URL redirectedUrl = new URL(conn.getHeaderField("Location"));
  conn = (HttpURLConnection) redirectedUrl.openConnection();
  conn.connect();
  assertEquals(HttpURLConnection.HTTP_OK, conn.getResponseCode());
  conn.disconnect();

  return id;
}

开发者ID:Nextzero，项目名称:hadoop-2.6.0-cdh5.4.3，代码行数:37，代码来源:TestJobRetire.java

示例2: getJobDetailsHistoryLink

import org.apache.hadoop.mapred.JobTracker.RetireJobInfo; //导入依赖的package包/类
/**
 * Given jobId, resolve the link to jobdetailshistory.jsp
 * @param tracker JobTracker
 * @param jobId JobID
 * @return the link to the page jobdetailshistory.jsp for the job
 */
public static String getJobDetailsHistoryLink(JobTracker tracker,
                                              String jobId) {
  RetireJobInfo info = tracker.retireJobs.get(JobID.forName(jobId));
  String historyFileUrl = getHistoryFileUrl(info);
  String result =  (historyFileUrl == null ? "" :
            "jobdetailshistory.jsp?jobid=" + jobId + "&logFile=" +
            historyFileUrl);
  return result;
}

开发者ID:rhli，项目名称:hadoop-EAR，代码行数:16，代码来源:JSPUtil.java

示例3: getTaskDetailsHistoryLink

import org.apache.hadoop.mapred.JobTracker.RetireJobInfo; //导入依赖的package包/类
/**
 * Given jobId, taskid resolve the link to taskdetailshistory.jsp
 * @param tracker JobTracker
 * @param jobId JobID
 * @param tid String
 * @return the link to the page jobdetailshistory.jsp for the job
 */
public static String getTaskDetailsHistoryLink(JobTracker tracker,
                                               String jobId,
                                               String tid) {
  RetireJobInfo info = tracker.retireJobs.get(JobID.forName(jobId));
  String historyFileUrl = getHistoryFileUrl(info);
  String result =  (historyFileUrl == null ? "" :
            "taskdetailshistory.jsp?jobid=" + jobId + "&logFile=" +
            historyFileUrl + "&taskid=" + tid);
  return result;
}

开发者ID:rhli，项目名称:hadoop-EAR，代码行数:18，代码来源:JSPUtil.java

示例4: getHistoryFileUrl

import org.apache.hadoop.mapred.JobTracker.RetireJobInfo; //导入依赖的package包/类
/**
 * Obtain history file URL from RetireJobInfo
 * @param info RetireJobInfo
 * @return corresponding history file url, null if cannot creat one
 */
private static String getHistoryFileUrl(RetireJobInfo info) {
  String historyFile = info.getHistoryFile();
  String historyFileUrl = null;
  if (historyFile != null && !historyFile.equals("")) {
    try {
      historyFileUrl = URLEncoder.encode(info.getHistoryFile(), "UTF-8");
    } catch (UnsupportedEncodingException e) {
      LOG.warn("Can't create history url ", e);
    }
  }
  return historyFileUrl;
}

开发者ID:rhli，项目名称:hadoop-EAR，代码行数:18，代码来源:JSPUtil.java

示例5: generateRetiredJobXml

import org.apache.hadoop.mapred.JobTracker.RetireJobInfo; //导入依赖的package包/类
@SuppressWarnings("unchecked")
public static void generateRetiredJobXml(JspWriter out, JobTracker tracker, int rowId)
    throws IOException {

  Iterator<RetireJobInfo> iterator =
    tracker.retireJobs.getAll().descendingIterator();

  for (int i = 0; i < 100 && iterator.hasNext(); i++) {
    RetireJobInfo info = iterator.next();
    JobStatus status = info.status;
    StringBuilder sb = new StringBuilder();
    sb.append("<retired_job rowid=\"" + rowId + "\" jobid=\"" + status.getJobId() + "\">");
    sb.append("<jobid>" + status.getJobId() + "</jobid>");
    sb.append("<history_url>jobdetailshistory.jsp?jobid=" + status.getJobId()
        + "&amp;logFile="
        + URLEncoder.encode(info.getHistoryFile().toString(), "UTF-8")
        + "</history_url>");
    sb.append("<priority>" + status.getJobPriority().toString()
        + "</priority>");
    sb.append("<user>" + info.profile.getUser() + "</user>");
    sb.append("<name>" + info.profile.getJobName() + "</name>");
    sb.append("<run_state>" + JobStatus.getJobRunState(status.getRunState())
        + "</run_state>");
    sb.append("<start_time>" + new Date(status.getStartTime())
        + "</start_time>");
    sb.append("<finish_time>" + new Date(info.finishTime)
        + "</finish_time>");
    sb.append("<map_complete>" + StringUtils.formatPercent(
        status.mapProgress(), 2) + "</map_complete>");
    sb.append("<reduce_complete>" + StringUtils.formatPercent(
        status.reduceProgress(), 2) + "</reduce_complete>");
    sb.append("<scheduling_info>" + status.getSchedulingInfo() + "</scheduling_info>");
    sb.append("</retired_job>\n");
    out.write(sb.toString());
    rowId++;
  }
}

开发者ID:rhli，项目名称:hadoop-EAR，代码行数:38，代码来源:JSPUtil.java

示例6: generateRetiredJobTable

import org.apache.hadoop.mapred.JobTracker.RetireJobInfo; //导入依赖的package包/类
@SuppressWarnings("unchecked")
public static String generateRetiredJobTable(JobTracker tracker, int rowId) 
  throws IOException {

  StringBuffer sb = new StringBuffer();
  sb.append("<table border=\"1\" cellpadding=\"5\" cellspacing=\"0\" class=\"sortable\">\n");

  Iterator<RetireJobInfo> iterator = 
    tracker.retireJobs.getAll().descendingIterator();
  if (!iterator.hasNext()) {
    sb.append("<tr><td align=\"center\" colspan=\"8\"><i>none</i>" +
    "</td></tr>\n");
  } else {
    sb.append("<tr>");
    
    sb.append("<td><b>Jobid</b></td>");
    sb.append("<td><b>Priority</b></td>");
    sb.append("<td><b>User</b></td>");
    sb.append("<td><b>Name</b></td>");
    sb.append("<td><b>State</b></td>");
    sb.append("<td><b>Start Time</b></td>");
    sb.append("<td><b>Finish Time</b></td>");
    sb.append("<td><b>Map % Complete</b></td>");
    sb.append("<td><b>Reduce % Complete</b></td>");
    sb.append("<td><b>Job Scheduling Information</b></td>");
    sb.append("<td><b>Diagnostic Info </b></td>");
    sb.append("</tr>\n");
    for (int i = 0; i < 100 && iterator.hasNext(); i++) {
      RetireJobInfo info = iterator.next();
      String historyFile = info.getHistoryFile();
      String historyFileUrl = null;
      if (historyFile != null && !historyFile.equals("")) {
        try {
          historyFileUrl = URLEncoder.encode(info.getHistoryFile(), "UTF-8");
        } catch (UnsupportedEncodingException e) {
          LOG.warn("Can't create history url ", e);
        }
      }
      sb.append("<tr>");
      sb.append(
          "<td id=\"job_" + rowId + "\">" + 
          
            (historyFileUrl == null ? "" :
            "<a href=\"jobdetailshistory.jsp?logFile=" + historyFileUrl + "\">") + 
            
            info.status.getJobId() + "</a></td>" +
          
          "<td id=\"priority_" + rowId + "\">" + 
            info.status.getJobPriority().toString() + "</td>" +
          "<td id=\"user_" + rowId + "\">" +
            HtmlQuoting.quoteHtmlChars(info.profile.getUser()) + "</td>" +
          "<td id=\"name_" + rowId + "\">" +
            HtmlQuoting.quoteHtmlChars(info.profile.getJobName()) + "</td>" +
          "<td>" + JobStatus.getJobRunState(info.status.getRunState()) 
            + "</td>" +
          "<td>" + new Date(info.status.getStartTime()) + "</td>" +
          "<td>" + new Date(info.finishTime) + "</td>" +
          
          "<td>" + StringUtils.formatPercent(info.status.mapProgress(), 2)
          + ServletUtil.percentageGraph(info.status.mapProgress() * 100, 80) + 
            "</td>" +
          
          "<td>" + StringUtils.formatPercent(info.status.reduceProgress(), 2)
          + ServletUtil.percentageGraph(
             info.status.reduceProgress() * 100, 80) + 
            "</td>" +
          
          "<td>" +
          HtmlQuoting.quoteHtmlChars(info.status.getSchedulingInfo()) +
          "</td>" + 
          "<td>" + HtmlQuoting.quoteHtmlChars(info.status.getFailureInfo()) + 
          "</td></tr>\n");
      rowId++;
    }
  }
  sb.append("</table>\n");
  return sb.toString();
}

开发者ID:Nextzero，项目名称:hadoop-2.6.0-cdh5.4.3，代码行数:79，代码来源:JSPUtil.java

示例7: generateRetiredJobTable

import org.apache.hadoop.mapred.JobTracker.RetireJobInfo; //导入依赖的package包/类
@SuppressWarnings("unchecked")
public static String generateRetiredJobTable(JobTracker tracker, int rowId)
  throws IOException {

  StringBuffer sb = new StringBuffer();
  sb.append("<table border=\"1\" cellpadding=\"5\" cellspacing=\"0\" class=\"tablesorter\">\n");

  Iterator<RetireJobInfo> iterator =
    tracker.retireJobs.getAll().descendingIterator();
  if (!iterator.hasNext()) {
    sb.append("<tr><th align=\"center\" colspan=\"8\"><i>none</i>" +
    "</th></tr>\n");
  } else {
    sb.append("<thead><tr>");

    sb.append("<th><b>Jobid</b></th>");
    sb.append("<th><b>Priority</b></th>");
    sb.append("<th><b>User</b></th>");
    sb.append("<th><b>Name</b></th>");
    sb.append("<th><b>State</b></th>");
    sb.append("<th><b>Start Time</b></th>");
    sb.append("<th><b>Finish Time</b></th>");
    sb.append("<th><b>Map % Complete</b></th>");
    sb.append("<th><b>Reduce % Complete</b></th>");
    sb.append("<th><b>Job Scheduling Information</b></th>");
    sb.append("</tr></thead><tbody>\n");
    for (int i = 0; i < 100 && iterator.hasNext(); i++) {
      RetireJobInfo info = iterator.next();
      String historyFileUrl = getHistoryFileUrl(info);
      sb.append("<tr>");

      String name = info.profile.getJobName();
      String abbreviatedName
          = (name.length() > 76 ? name.substring(0,76) + "..." : name);

      sb.append(
          "<td id=\"job_" + rowId + "\">" +

            (historyFileUrl == null ? "" :
            "<a href=\"jobdetailshistory.jsp?jobid=" +
            info.status.getJobId() + "&logFile=" + historyFileUrl + "\">") +

            info.status.getJobId() + "</a></td>" +

          "<td id=\"priority_" + rowId + "\">" +
            info.status.getJobPriority().toString() + "</td>" +
          "<td id=\"user_" + rowId + "\">" + info.profile.getUser()
            + "</td>" +
          "<td id=\"name_" + rowId + "\">" + abbreviatedName
            + "</td>" +
          "<td>" + JobStatus.getJobRunState(info.status.getRunState())
            + "</td>" +
          "<td>" + new Date(info.status.getStartTime()) + "</td>" +
          "<td>" + new Date(info.finishTime) + "</td>" +

          "<td>" + StringUtils.formatPercent(info.status.mapProgress(), 2)
          + ServletUtil.percentageGraph(info.status.mapProgress() * 100, 80) +
            "</td>" +

          "<td>" + StringUtils.formatPercent(info.status.reduceProgress(), 2)
          + ServletUtil.percentageGraph(
             info.status.reduceProgress() * 100, 80) +
            "</td>" +

          "<td>" + info.status.getSchedulingInfo() + "</td>" +

          "</tr>\n");
      rowId++;
    }
    sb.append("</tbody>");
  }
  sb.append("</table>\n");
  return sb.toString();
}

开发者ID:rhli，项目名称:hadoop-EAR，代码行数:75，代码来源:JSPUtil.java

示例8: generateRetiredJobTable

import org.apache.hadoop.mapred.JobTracker.RetireJobInfo; //导入依赖的package包/类
@SuppressWarnings("unchecked")
public static String generateRetiredJobTable(JobTracker tracker, int rowId) 
  throws IOException {

  StringBuffer sb = new StringBuffer();
  sb.append("<table border=\"1\" cellpadding=\"5\" cellspacing=\"0\">\n");

  Iterator<RetireJobInfo> iterator = 
    tracker.retireJobs.getAll().descendingIterator();
  if (!iterator.hasNext()) {
    sb.append("<tr><td align=\"center\" colspan=\"8\"><i>none</i>" +
    "</td></tr>\n");
  } else {
    sb.append("<tr>");
    
    sb.append("<td><b>Jobid</b></td>");
    sb.append("<td><b>Priority</b></td>");
    sb.append("<td><b>User</b></td>");
    sb.append("<td><b>Name</b></td>");
    sb.append("<td><b>State</b></td>");
    sb.append("<td><b>Start Time</b></td>");
    sb.append("<td><b>Finish Time</b></td>");
    sb.append("<td><b>Map % Complete</b></td>");
    sb.append("<td><b>Reduce % Complete</b></td>");
    sb.append("<td><b>Job Scheduling Information</b></td>");
    sb.append("<td><b>Diagnostic Info </b></td>");
    sb.append("</tr>\n");
    for (int i = 0; i < 100 && iterator.hasNext(); i++) {
      RetireJobInfo info = iterator.next();
      String historyFile = info.getHistoryFile();
      String historyFileUrl = null;
      if (historyFile != null && !historyFile.equals("")) {
        try {
          historyFileUrl = URLEncoder.encode(info.getHistoryFile(), "UTF-8");
        } catch (UnsupportedEncodingException e) {
          LOG.warn("Can't create history url ", e);
        }
      }
      sb.append("<tr>");
      sb.append(
          "<td id=\"job_" + rowId + "\">" + 
          
            (historyFileUrl == null ? "" :
            "<a href=\"" + JobHistoryServer.getHistoryUrlPrefix(tracker.conf) +
                "/jobdetailshistory.jsp?logFile=" + historyFileUrl + "\">") +
            
            info.status.getJobId() + "</a></td>" +
          
          "<td id=\"priority_" + rowId + "\">" + 
            info.status.getJobPriority().toString() + "</td>" +
          "<td id=\"user_" + rowId + "\">" +
            HtmlQuoting.quoteHtmlChars(info.profile.getUser()) + "</td>" +
          "<td id=\"name_" + rowId + "\">" +
            HtmlQuoting.quoteHtmlChars(info.profile.getJobName()) + "</td>" +
          "<td>" + JobStatus.getJobRunState(info.status.getRunState()) 
            + "</td>" +
          "<td>" + new Date(info.status.getStartTime()) + "</td>" +
          "<td>" + new Date(info.finishTime) + "</td>" +
          
          "<td>" + StringUtils.formatPercent(info.status.mapProgress(), 2)
          + ServletUtil.percentageGraph(info.status.mapProgress() * 100, 80) + 
            "</td>" +
          
          "<td>" + StringUtils.formatPercent(info.status.reduceProgress(), 2)
          + ServletUtil.percentageGraph(
             info.status.reduceProgress() * 100, 80) + 
            "</td>" +
          
          "<td>" +
          HtmlQuoting.quoteHtmlChars(info.status.getSchedulingInfo()) +
          "</td>" + 
          "<td>" + HtmlQuoting.quoteHtmlChars(info.status.getFailureInfo()) + 
          "</td></tr>\n");
      rowId++;
    }
  }
  sb.append("</table>\n");
  return sb.toString();
}

开发者ID:Seagate，项目名称:hadoop-on-lustre，代码行数:80，代码来源:JSPUtil.java

注：本文中的org.apache.hadoop.mapred.JobTracker.RetireJobInfo类示例整理自Github/MSDocs等源码及文档管理平台，相关代码片段筛选自各路编程大神贡献的开源项目，源码版权归原作者所有，传播和使用请参考对应项目的License；未经允许，请勿转载。

鲜花

握手

雷人

路过

鸡蛋

该文章已有0人参与评论

请发表评论

全部评论

专题导读

More+

10-27 六六分期app的软件客服如何联系？(六六分期

11-06 可心卡盟:win10系统火狐flash插件崩溃怎么

11-06 亲亲特价:怎么删除回收站图标

11-06 济南大学虚拟社区:鲁大师节能降温的具体办

11-06 xlueops.exe:无线网络安装向导

11-06 女斗合众国:win7系统cf与主机连接不稳定怎

11-06 0xc000022-[cf烟雾头]cf怎么调烟雾头

11-06 qizideyouhuo:应用程序无法正常启动0xc0000

11-06 ipz-185:win7系统vcf文件怎么打开

11-06 傻哥蹦迪:win10系统s4怎么打开usb调试

11-06 八神浩树gtaste:回收站清空了怎么恢复

11-06 妖尾之黑色守护:win10系统电脑没有1440x900

11-06 校园至尊魔王小说:win7系统浏览网页时字体

11-06 女斗合众国:win10系统访问共享文件夹提示请

11-06 tokyo hot n0654:恢复win7系统默认字体一招

11-06 雨酷仙境:设置win7系统转移临时文件夹腾出

11-06 阿穆纳伊之杖:win7系统开始菜单在右边还原

11-06 tunespotting:win10系统火狐flash插件总是

11-06 甘尔葛分析师：计谋网站seo关键词暴涨有什

11-06 蔡贵霖: 计谋网站seo关键词暴涨有什么秘密

11-06 博益网首页:ao3网页版进入不了解决方法

11-06 漏斗子专栏: 网站数据分析小白易懂精华篇

11-06 见证双虹怎么做:win7系统开启telnet命令的

11-06 颾狐蝶蜋:系统资源不足无法完成请求的服务

11-06 国光中学校歌:提交网站到alexa查询详细步骤

11-06 西安有情天:静态网页和动态网页的区别

11-06 红木雅尚斋:外部链接构造对网站的好处

11-06 前官礼遇：防止域名劫持–增强域安全性的10

11-06 密传二转答案: 中文分词算法有哪些

11-06 金泉家园邮编:百度快照劫持的表现及应对方

Java PdfCopyFields类代码示例发布时间：2022-05-23

Java TaskResultBuilder类代码示例发布时间：2022-05-23

剪的笔顺,诠释剪的笔画,认识剪的部首

1 六六分期app的软件客服如何联系？(六六分期

六六分期app的软件客服如何联系？不知道吗？加qq群【895510560】即可！标题：六六分期

阅读：17952|2023-10-27

2 可心卡盟:win10系统火狐flash插件崩溃怎么

今天小编告诉大家如何处理win10系统火狐flash插件总是崩溃的问题，可能很多用户都不知

阅读：9564|2022-11-06

3 亲亲特价:怎么删除回收站图标

今天小编告诉大家如何对win10系统删除桌面回收站图标进行设置，可能很多用户都不知道

阅读：8127|2022-11-06

4 济南大学虚拟社区:鲁大师节能降温的具体办

今天小编告诉大家如何对win10系统电脑设置节能降温的设置方法，想必大家都遇到过需要

阅读：8508|2022-11-06

5 xlueops.exe:无线网络安装向导

我们在使用xp系统的过程中,经常需要对xp系统无线网络安装向导设置进行设置，可能很多

阅读：8411|2022-11-06

6 女斗合众国:win7系统cf与主机连接不稳定怎

今天小编告诉大家如何处理win7系统玩cf老是与主机连接不稳定的问题，可能很多用户都不

阅读：9303|2022-11-06

7 0xc000022-[cf烟雾头]cf怎么调烟雾头

电脑对日常生活的重要性小编就不多说了，可是一旦碰到win7系统设置cf烟雾头的问题，很

阅读：8375|2022-11-06

8 qizideyouhuo:应用程序无法正常启动0xc0000

我们在日常使用电脑的时候，有的小伙伴们可能在打开应用的时候会遇见提示应用程序无法

阅读：7807|2022-11-06

9 ipz-185:win7系统vcf文件怎么打开

今天小编告诉大家如何对win7系统打开vcf文件进行设置，可能很多用户都不知道怎么对win

阅读：8359|2022-11-06

10 傻哥蹦迪:win10系统s4怎么打开usb调试

今天小编告诉大家如何对win10系统s4开启USB调试模式进行设置，可能很多用户都不知道怎

阅读：7360|2022-11-06

客服电话

电子邮件

Java RetireJobInfo类代码示例

示例1: validateJobRetire

示例2: getJobDetailsHistoryLink

示例3: getTaskDetailsHistoryLink

示例4: getHistoryFileUrl

示例5: generateRetiredJobXml

示例6: generateRetiredJobTable

示例7: generateRetiredJobTable

示例8: generateRetiredJobTable

请发表评论

全部评论

上一篇：

下一篇：

xreef/PCF8574_library: i2c digital expan

librespeed/speedtest: Self-hosted Speedt

avehtari/BDA_m_demos: Bayesian Data Anal

四维彩超怎么看性别？四维看男孩女孩诀窍

medfreeman/markdown-it-toc-and-anchor: m

剪的笔顺,诠释剪的笔画,认识剪的部首

六六分期app的软件客服如何联系？(六六分期

florent37/ViewAnimator: A fluent Android

florent37/Shrine-MaterialDesign2: implem

CVE-2020-36276

SimpleSoftwareIO/simple-sms: Send and re

关于我们

产品与服务

解决方案

139-2527-9053