• 设为首页
  • 点击收藏
  • 手机版
    手机扫一扫访问
    迪恩网络手机版
  • 关注官方公众号
    微信扫一扫关注
    迪恩网络公众号

Java RollingUpgradeAction类代码示例

原作者: [db:作者] 来自: [db:来源] 收藏 邀请

本文整理汇总了Java中org.apache.hadoop.hdfs.protocol.HdfsConstants.RollingUpgradeAction的典型用法代码示例。如果您正苦于以下问题:Java RollingUpgradeAction类的具体用法?Java RollingUpgradeAction怎么用?Java RollingUpgradeAction使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。



RollingUpgradeAction类属于org.apache.hadoop.hdfs.protocol.HdfsConstants包,在下文中一共展示了RollingUpgradeAction类的15个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于我们的系统推荐出更棒的Java代码示例。

示例1: run

import org.apache.hadoop.hdfs.protocol.HdfsConstants.RollingUpgradeAction; //导入依赖的package包/类
static int run(DistributedFileSystem dfs, String[] argv, int idx) throws IOException {
  final RollingUpgradeAction action = RollingUpgradeAction.fromString(
      argv.length >= 2? argv[1]: "");
  if (action == null) {
    throw new IllegalArgumentException("Failed to covert \"" + argv[1]
        +"\" to " + RollingUpgradeAction.class.getSimpleName());
  }

  System.out.println(action + " rolling upgrade ...");

  final RollingUpgradeInfo info = dfs.rollingUpgrade(action);
  switch(action){
  case QUERY:
    break;
  case PREPARE:
    Preconditions.checkState(info.isStarted());
    break;
  case FINALIZE:
    Preconditions.checkState(info == null || info.isFinalized());
    break;
  }
  printMessage(info, System.out);
  return 0;
}
 
开发者ID:naver,项目名称:hadoop,代码行数:25,代码来源:DFSAdmin.java


示例2: startRollingUpgrade

import org.apache.hadoop.hdfs.protocol.HdfsConstants.RollingUpgradeAction; //导入依赖的package包/类
private static void startRollingUpgrade(Path foo, Path bar,
    Path file, byte[] data,
    MiniDFSCluster cluster) throws IOException {
  final DistributedFileSystem dfs = cluster.getFileSystem();

  //start rolling upgrade
  dfs.setSafeMode(SafeModeAction.SAFEMODE_ENTER);
  dfs.rollingUpgrade(RollingUpgradeAction.PREPARE);
  dfs.setSafeMode(SafeModeAction.SAFEMODE_LEAVE);

  dfs.mkdirs(bar);
  Assert.assertTrue(dfs.exists(foo));
  Assert.assertTrue(dfs.exists(bar));

  //truncate a file
  final int newLength = DFSUtil.getRandom().nextInt(data.length - 1) + 1;
  dfs.truncate(file, newLength);
  TestFileTruncate.checkBlockRecovery(file, dfs);
  AppendTestUtil.checkFullFile(dfs, file, newLength, data);
}
 
开发者ID:naver,项目名称:hadoop,代码行数:21,代码来源:TestRollingUpgrade.java


示例3: testQueryAfterRestart

import org.apache.hadoop.hdfs.protocol.HdfsConstants.RollingUpgradeAction; //导入依赖的package包/类
@Test (timeout = 300000)
public void testQueryAfterRestart() throws IOException, InterruptedException {
  final Configuration conf = new Configuration();
  MiniDFSCluster cluster = null;
  try {
    cluster = new MiniDFSCluster.Builder(conf).numDataNodes(0).build();
    cluster.waitActive();
    DistributedFileSystem dfs = cluster.getFileSystem();

    dfs.setSafeMode(SafeModeAction.SAFEMODE_ENTER);
    // start rolling upgrade
    dfs.rollingUpgrade(RollingUpgradeAction.PREPARE);
    queryForPreparation(dfs);
    dfs.setSafeMode(SafeModeAction.SAFEMODE_ENTER);
    dfs.saveNamespace();
    dfs.setSafeMode(SafeModeAction.SAFEMODE_LEAVE);

    cluster.restartNameNodes();
    dfs.rollingUpgrade(RollingUpgradeAction.QUERY);
  } finally {
    if (cluster != null) {
      cluster.shutdown();
    }
  }
}
 
开发者ID:naver,项目名称:hadoop,代码行数:26,代码来源:TestRollingUpgrade.java


示例4: queryForPreparation

import org.apache.hadoop.hdfs.protocol.HdfsConstants.RollingUpgradeAction; //导入依赖的package包/类
static void queryForPreparation(DistributedFileSystem dfs) throws IOException,
    InterruptedException {
  RollingUpgradeInfo info;
  int retries = 0;
  while (++retries < 10) {
    info = dfs.rollingUpgrade(RollingUpgradeAction.QUERY);
    if (info.createdRollbackImages()) {
      break;
    }
    Thread.sleep(1000);
  }

  if (retries >= 10) {
    Assert.fail("Query return false");
  }
}
 
开发者ID:naver,项目名称:hadoop,代码行数:17,代码来源:TestRollingUpgrade.java


示例5: rollingUpgrade

import org.apache.hadoop.hdfs.protocol.HdfsConstants.RollingUpgradeAction; //导入依赖的package包/类
@Override
public RollingUpgradeInfo rollingUpgrade(RollingUpgradeAction action)
    throws IOException {
  final RollingUpgradeRequestProto r = RollingUpgradeRequestProto.newBuilder()
      .setAction(PBHelperClient.convert(action)).build();
  try {
    final RollingUpgradeResponseProto proto =
        rpcProxy.rollingUpgrade(null, r);
    if (proto.hasRollingUpgradeInfo()) {
      return PBHelperClient.convert(proto.getRollingUpgradeInfo());
    }
    return null;
  } catch (ServiceException e) {
    throw ProtobufHelper.getRemoteException(e);
  }
}
 
开发者ID:aliyun-beta,项目名称:aliyun-oss-hadoop-fs,代码行数:17,代码来源:ClientNamenodeProtocolTranslatorPB.java


示例6: startRollingUpgrade

import org.apache.hadoop.hdfs.protocol.HdfsConstants.RollingUpgradeAction; //导入依赖的package包/类
private static void startRollingUpgrade(Path foo, Path bar,
    Path file, byte[] data,
    MiniDFSCluster cluster) throws IOException {
  final DistributedFileSystem dfs = cluster.getFileSystem();

  //start rolling upgrade
  dfs.setSafeMode(SafeModeAction.SAFEMODE_ENTER);
  dfs.rollingUpgrade(RollingUpgradeAction.PREPARE);
  dfs.setSafeMode(SafeModeAction.SAFEMODE_LEAVE);

  dfs.mkdirs(bar);
  Assert.assertTrue(dfs.exists(foo));
  Assert.assertTrue(dfs.exists(bar));

  //truncate a file
  final int newLength = ThreadLocalRandom.current().nextInt(data.length - 1)
      + 1;
  dfs.truncate(file, newLength);
  TestFileTruncate.checkBlockRecovery(file, dfs);
  AppendTestUtil.checkFullFile(dfs, file, newLength, data);
}
 
开发者ID:aliyun-beta,项目名称:aliyun-oss-hadoop-fs,代码行数:22,代码来源:TestRollingUpgrade.java


示例7: run

import org.apache.hadoop.hdfs.protocol.HdfsConstants.RollingUpgradeAction; //导入依赖的package包/类
static int run(DistributedFileSystem dfs, String[] argv, int idx) throws IOException {
  final RollingUpgradeAction action = RollingUpgradeAction.fromString(
      argv.length >= 2? argv[1]: "");
  if (action == null) {
    throw new IllegalArgumentException("Failed to covert \"" + argv[1]
        +"\" to " + RollingUpgradeAction.class.getSimpleName());
  }

  System.out.println(action + " rolling upgrade ...");

  final RollingUpgradeInfo info = dfs.rollingUpgrade(action);
  switch(action){
  case QUERY:
    break;
  case PREPARE:
    Preconditions.checkState(info.isStarted());
    break;
  case FINALIZE:
    Preconditions.checkState(info.isFinalized());
    break;
  }
  printMessage(info, System.out);
  return 0;
}
 
开发者ID:Seagate,项目名称:hadoop-on-lustre2,代码行数:25,代码来源:DFSAdmin.java


示例8: rollingUpgrade

import org.apache.hadoop.hdfs.protocol.HdfsConstants.RollingUpgradeAction; //导入依赖的package包/类
RollingUpgradeInfo rollingUpgrade(RollingUpgradeAction action) throws IOException {
  TraceScope scope = Trace.startSpan("rollingUpgrade", traceSampler);
  try {
    return namenode.rollingUpgrade(action);
  } finally {
    scope.close();
  }
}
 
开发者ID:naver,项目名称:hadoop,代码行数:9,代码来源:DFSClient.java


示例9: rollingUpgrade

import org.apache.hadoop.hdfs.protocol.HdfsConstants.RollingUpgradeAction; //导入依赖的package包/类
@Override // ClientProtocol
public RollingUpgradeInfo rollingUpgrade(RollingUpgradeAction action) throws IOException {
  checkNNStartup();
  LOG.info("rollingUpgrade " + action);
  switch(action) {
  case QUERY:
    return namesystem.queryRollingUpgrade();
  case PREPARE:
    return namesystem.startRollingUpgrade();
  case FINALIZE:
    return namesystem.finalizeRollingUpgrade();
  default:
    throw new UnsupportedActionException(action + " is not yet supported.");
  }
}
 
开发者ID:naver,项目名称:hadoop,代码行数:16,代码来源:NameNodeRpcServer.java


示例10: convert

import org.apache.hadoop.hdfs.protocol.HdfsConstants.RollingUpgradeAction; //导入依赖的package包/类
public static RollingUpgradeActionProto convert(RollingUpgradeAction a) {
  switch (a) {
  case QUERY:
    return RollingUpgradeActionProto.QUERY;
  case PREPARE:
    return RollingUpgradeActionProto.START;
  case FINALIZE:
    return RollingUpgradeActionProto.FINALIZE;
  default:
    throw new IllegalArgumentException("Unexpected value: " + a);
  }
}
 
开发者ID:naver,项目名称:hadoop,代码行数:13,代码来源:PBHelper.java


示例11: rollingUpgrade

import org.apache.hadoop.hdfs.protocol.HdfsConstants.RollingUpgradeAction; //导入依赖的package包/类
@Override
public RollingUpgradeInfo rollingUpgrade(RollingUpgradeAction action) throws IOException {
  final RollingUpgradeRequestProto r = RollingUpgradeRequestProto.newBuilder()
      .setAction(PBHelper.convert(action)).build();
  try {
    final RollingUpgradeResponseProto proto = rpcProxy.rollingUpgrade(null, r);
    if (proto.hasRollingUpgradeInfo()) {
      return PBHelper.convert(proto.getRollingUpgradeInfo());
    }
    return null;
  } catch (ServiceException e) {
    throw ProtobufHelper.getRemoteException(e);
  }
}
 
开发者ID:naver,项目名称:hadoop,代码行数:15,代码来源:ClientNamenodeProtocolTranslatorPB.java


示例12: testQuery

import org.apache.hadoop.hdfs.protocol.HdfsConstants.RollingUpgradeAction; //导入依赖的package包/类
@Test (timeout = 300000)
public void testQuery() throws Exception {
  final Configuration conf = new Configuration();
  MiniQJMHACluster cluster = null;
  try {
    cluster = new MiniQJMHACluster.Builder(conf).build();
    MiniDFSCluster dfsCluster = cluster.getDfsCluster();
    dfsCluster.waitActive();

    dfsCluster.transitionToActive(0);
    DistributedFileSystem dfs = dfsCluster.getFileSystem(0);

    dfsCluster.shutdownNameNode(1);

    // start rolling upgrade
    RollingUpgradeInfo info = dfs
        .rollingUpgrade(RollingUpgradeAction.PREPARE);
    Assert.assertTrue(info.isStarted());

    info = dfs.rollingUpgrade(RollingUpgradeAction.QUERY);
    Assert.assertFalse(info.createdRollbackImages());

    dfsCluster.restartNameNode(1);

    queryForPreparation(dfs);

    // The NN should have a copy of the fsimage in case of rollbacks.
    Assert.assertTrue(dfsCluster.getNamesystem(0).getFSImage()
        .hasRollbackFSImage());
  } finally {
    if (cluster != null) {
      cluster.shutdown();
    }
  }
}
 
开发者ID:naver,项目名称:hadoop,代码行数:36,代码来源:TestRollingUpgrade.java


示例13: rollingUpgrade

import org.apache.hadoop.hdfs.protocol.HdfsConstants.RollingUpgradeAction; //导入依赖的package包/类
RollingUpgradeInfo rollingUpgrade(RollingUpgradeAction action)
    throws IOException {
  checkOpen();
  try (TraceScope ignored = tracer.newScope("rollingUpgrade")) {
    return namenode.rollingUpgrade(action);
  }
}
 
开发者ID:aliyun-beta,项目名称:aliyun-oss-hadoop-fs,代码行数:8,代码来源:DFSClient.java


示例14: testQuery

import org.apache.hadoop.hdfs.protocol.HdfsConstants.RollingUpgradeAction; //导入依赖的package包/类
private void testQuery(int nnCount) throws Exception{
  final Configuration conf = new Configuration();
  MiniQJMHACluster cluster = null;
  try {
    cluster = new MiniQJMHACluster.Builder(conf).setNumNameNodes(nnCount).build();
    MiniDFSCluster dfsCluster = cluster.getDfsCluster();
    dfsCluster.waitActive();

    dfsCluster.transitionToActive(0);
    DistributedFileSystem dfs = dfsCluster.getFileSystem(0);

    // shutdown other NNs
    for (int i = 1; i < nnCount; i++) {
      dfsCluster.shutdownNameNode(i);
    }

    // start rolling upgrade
    RollingUpgradeInfo info = dfs
        .rollingUpgrade(RollingUpgradeAction.PREPARE);
    Assert.assertTrue(info.isStarted());

    info = dfs.rollingUpgrade(RollingUpgradeAction.QUERY);
    Assert.assertFalse(info.createdRollbackImages());

    // restart other NNs
    for (int i = 1; i < nnCount; i++) {
      dfsCluster.restartNameNode(i);
    }
    // check that one of the other NNs has created the rollback image and uploaded it
    queryForPreparation(dfs);

    // The NN should have a copy of the fsimage in case of rollbacks.
    Assert.assertTrue(dfsCluster.getNamesystem(0).getFSImage()
            .hasRollbackFSImage());
  } finally {
    if (cluster != null) {
      cluster.shutdown();
    }
  }
}
 
开发者ID:aliyun-beta,项目名称:aliyun-oss-hadoop-fs,代码行数:41,代码来源:TestRollingUpgrade.java


示例15: testCheckpoint

import org.apache.hadoop.hdfs.protocol.HdfsConstants.RollingUpgradeAction; //导入依赖的package包/类
public void testCheckpoint(int nnCount) throws IOException, InterruptedException {
  final Configuration conf = new Configuration();
  conf.setInt(DFSConfigKeys.DFS_HA_TAILEDITS_PERIOD_KEY, 1);
  conf.setInt(DFSConfigKeys.DFS_NAMENODE_CHECKPOINT_PERIOD_KEY, 1);

  MiniQJMHACluster cluster = null;
  final Path foo = new Path("/foo");

  try {
    cluster = new MiniQJMHACluster.Builder(conf).setNumNameNodes(nnCount).build();
    MiniDFSCluster dfsCluster = cluster.getDfsCluster();
    dfsCluster.waitActive();

    dfsCluster.transitionToActive(0);
    DistributedFileSystem dfs = dfsCluster.getFileSystem(0);

    // start rolling upgrade
    RollingUpgradeInfo info = dfs
        .rollingUpgrade(RollingUpgradeAction.PREPARE);
    Assert.assertTrue(info.isStarted());

    queryForPreparation(dfs);

    dfs.mkdirs(foo);
    long txid = dfs.rollEdits();
    Assert.assertTrue(txid > 0);

    for(int i=1; i< nnCount; i++) {
      verifyNNCheckpoint(dfsCluster, txid, i);
    }

  } finally {
    if (cluster != null) {
      cluster.shutdown();
    }
  }
}
 
开发者ID:aliyun-beta,项目名称:aliyun-oss-hadoop-fs,代码行数:38,代码来源:TestRollingUpgrade.java



注:本文中的org.apache.hadoop.hdfs.protocol.HdfsConstants.RollingUpgradeAction类示例整理自Github/MSDocs等源码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。


鲜花

握手

雷人

路过

鸡蛋
该文章已有0人参与评论

请发表评论

全部评论

专题导读
上一篇:
Java BooleanSerializer类代码示例发布时间:1970-01-01
下一篇:
Java ListUtils类代码示例发布时间:1970-01-01
热门推荐
阅读排行榜

扫描微信二维码

查看手机版网站

随时了解更新最新资讯

139-2527-9053

在线客服(服务时间 9:00~18:00)

在线QQ客服
地址:深圳市南山区西丽大学城创智工业园
电邮:jeky_zhao#qq.com
移动电话:139-2527-9053

Powered by 互联科技 X3.4© 2001-2213 极客世界.|Sitemap