Java DataTransferEncryptor类代码示例

OGeek|极客世界-中国程序员成长平台 › 门户 › 编程› Java›Java编程经验

原作者: [db:作者] 来自: [db:来源] 收藏邀请

本文整理汇总了Java中org.apache.hadoop.hdfs.protocol.datatransfer.DataTransferEncryptor类的典型用法代码示例。如果您正苦于以下问题：Java DataTransferEncryptor类的具体用法？Java DataTransferEncryptor怎么用？Java DataTransferEncryptor使用的例子？那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。

DataTransferEncryptor类属于org.apache.hadoop.hdfs.protocol.datatransfer包，在下文中一共展示了DataTransferEncryptor类的7个代码示例，这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞，您的评价将有助于我们的系统推荐出更棒的Java代码示例。

示例1: transfer

import org.apache.hadoop.hdfs.protocol.datatransfer.DataTransferEncryptor; //导入依赖的package包/类
private void transfer(final DatanodeInfo src, final DatanodeInfo[] targets,
    final Token<BlockTokenIdentifier> blockToken) throws IOException {
  //transfer replica to the new datanode
  Socket sock = null;
  DataOutputStream out = null;
  DataInputStream in = null;
  try {
    sock = createSocketForPipeline(src, 2, dfsClient);
    final long writeTimeout = dfsClient.getDatanodeWriteTimeout(2);
    
    OutputStream unbufOut = NetUtils.getOutputStream(sock, writeTimeout);
    InputStream unbufIn = NetUtils.getInputStream(sock);
    if (dfsClient.shouldEncryptData()) {
      IOStreamPair encryptedStreams =
          DataTransferEncryptor.getEncryptedStreams(
              unbufOut, unbufIn, dfsClient.getDataEncryptionKey());
      unbufOut = encryptedStreams.out;
      unbufIn = encryptedStreams.in;
    }
    out = new DataOutputStream(new BufferedOutputStream(unbufOut,
        HdfsConstants.SMALL_BUFFER_SIZE));
    in = new DataInputStream(unbufIn);

    //send the TRANSFER_BLOCK request
    new Sender(out).transferBlock(block, blockToken, dfsClient.clientName,
        targets);
    out.flush();

    //ack
    BlockOpResponseProto response =
      BlockOpResponseProto.parseFrom(PBHelper.vintPrefixed(in));
    if (SUCCESS != response.getStatus()) {
      throw new IOException("Failed to add a datanode");
    }
  } finally {
    IOUtils.closeStream(in);
    IOUtils.closeStream(out);
    IOUtils.closeSocket(sock);
  }
}

开发者ID:ict-carch，项目名称:hadoop-plus，代码行数:41，代码来源:DFSOutputStream.java

示例2: EncryptedPeer

import org.apache.hadoop.hdfs.protocol.datatransfer.DataTransferEncryptor; //导入依赖的package包/类
public EncryptedPeer(Peer enclosedPeer, DataEncryptionKey key)
    throws IOException {
  this.enclosedPeer = enclosedPeer;
  IOStreamPair ios = DataTransferEncryptor.getEncryptedStreams(
      enclosedPeer.getOutputStream(), enclosedPeer.getInputStream(), key);
  this.in = ios.in;
  this.out = ios.out;
  this.channel = ios.in instanceof ReadableByteChannel ? 
      (ReadableByteChannel)ios.in : null;
}

开发者ID:ict-carch，项目名称:hadoop-plus，代码行数:11，代码来源:EncryptedPeer.java

示例3: transfer

import org.apache.hadoop.hdfs.protocol.datatransfer.DataTransferEncryptor; //导入依赖的package包/类
private void transfer(final DatanodeInfo src, final DatanodeInfo[] targets,
                      final Token<BlockTokenIdentifier> blockToken) throws IOException {
  //transfer replica to the new datanode
  Socket sock = null;
  DataOutputStream out = null;
  DataInputStream in = null;
  try {
    sock = createSocketForPipeline(src, 2, dfsClient);
    final long writeTimeout = dfsClient.getDatanodeWriteTimeout(2);

    OutputStream unbufOut = NetUtils.getOutputStream(sock, writeTimeout);
    InputStream unbufIn = NetUtils.getInputStream(sock);
    if (dfsClient.shouldEncryptData()) {
      IOStreamPair encryptedStreams = DataTransferEncryptor
              .getEncryptedStreams(unbufOut, unbufIn,
                      dfsClient.getDataEncryptionKey());
      unbufOut = encryptedStreams.out;
      unbufIn = encryptedStreams.in;
    }
    out = new DataOutputStream(new BufferedOutputStream(unbufOut,
            HdfsConstants.SMALL_BUFFER_SIZE));
    in = new DataInputStream(unbufIn);

    //send the TRANSFER_BLOCK request
    new Sender(out)
            .transferBlock(block, blockToken, dfsClient.clientName, targets);
    out.flush();

    //ack
    BlockOpResponseProto response =
            BlockOpResponseProto.parseFrom(PBHelper.vintPrefixed(in));
    if (SUCCESS != response.getStatus()) {
      throw new IOException("Failed to add a datanode");
    }
  } finally {
    IOUtils.closeStream(in);
    IOUtils.closeStream(out);
    IOUtils.closeSocket(sock);
  }
}

开发者ID:hopshadoop，项目名称:hops，代码行数:41，代码来源:DFSOutputStream.java

示例4: dispatch

import org.apache.hadoop.hdfs.protocol.datatransfer.DataTransferEncryptor; //导入依赖的package包/类
private void dispatch() {
  Socket sock = new Socket();
  DataOutputStream out = null;
  DataInputStream in = null;
  try {
    sock.connect(
        NetUtils.createSocketAddr(target.datanode.getXferAddr()),
        HdfsServerConstants.READ_TIMEOUT);
    sock.setKeepAlive(true);
    
    OutputStream unbufOut = sock.getOutputStream();
    InputStream unbufIn = sock.getInputStream();
    if (nnc.getDataEncryptionKey() != null) {
      IOStreamPair encryptedStreams =
          DataTransferEncryptor.getEncryptedStreams(
              unbufOut, unbufIn, nnc.getDataEncryptionKey());
      unbufOut = encryptedStreams.out;
      unbufIn = encryptedStreams.in;
    }
    out = new DataOutputStream(new BufferedOutputStream(unbufOut,
        HdfsConstants.IO_FILE_BUFFER_SIZE));
    in = new DataInputStream(new BufferedInputStream(unbufIn,
        HdfsConstants.IO_FILE_BUFFER_SIZE));
    
    sendRequest(out);
    receiveResponse(in);
    bytesMoved.inc(block.getNumBytes());
    LOG.info( "Moving block " + block.getBlock().getBlockId() +
          " from "+ source.getDisplayName() + " to " +
          target.getDisplayName() + " through " +
          proxySource.getDisplayName() +
          " is succeeded." );
  } catch (IOException e) {
    LOG.warn("Error moving block "+block.getBlockId()+
        " from " + source.getDisplayName() + " to " +
        target.getDisplayName() + " through " +
        proxySource.getDisplayName() +
        ": "+e.getMessage());
  } finally {
    IOUtils.closeStream(out);
    IOUtils.closeStream(in);
    IOUtils.closeSocket(sock);
    
    proxySource.removePendingBlock(this);
    target.removePendingBlock(this);

    synchronized (this ) {
      reset();
    }
    synchronized (Balancer.this) {
      Balancer.this.notifyAll();
    }
  }
}

开发者ID:ict-carch，项目名称:hadoop-plus，代码行数:55，代码来源:Balancer.java

示例5: dispatch

import org.apache.hadoop.hdfs.protocol.datatransfer.DataTransferEncryptor; //导入依赖的package包/类
private void dispatch() {
  Socket sock = new Socket();
  DataOutputStream out = null;
  DataInputStream in = null;
  try {
    sock.connect(NetUtils.createSocketAddr(target.datanode.getXferAddr()),
        HdfsServerConstants.READ_TIMEOUT);
    sock.setKeepAlive(true);
    
    OutputStream unbufOut = sock.getOutputStream();
    InputStream unbufIn = sock.getInputStream();
    if (nnc.getDataEncryptionKey() != null) {
      IOStreamPair encryptedStreams = DataTransferEncryptor
          .getEncryptedStreams(unbufOut, unbufIn,
              nnc.getDataEncryptionKey());
      unbufOut = encryptedStreams.out;
      unbufIn = encryptedStreams.in;
    }
    out = new DataOutputStream(new BufferedOutputStream(unbufOut,
        HdfsConstants.IO_FILE_BUFFER_SIZE));
    in = new DataInputStream(new BufferedInputStream(unbufIn,
        HdfsConstants.IO_FILE_BUFFER_SIZE));
    
    sendRequest(out);
    receiveResponse(in);
    bytesMoved.inc(block.getNumBytes());
    LOG.info("Moving block " + block.getBlock().getBlockId() +
        " from " + source.getDisplayName() + " to " +
        target.getDisplayName() + " through " +
        proxySource.getDisplayName() +
        " is succeeded.");
  } catch (IOException e) {
    LOG.warn("Error moving block " + block.getBlockId() +
        " from " + source.getDisplayName() + " to " +
        target.getDisplayName() + " through " +
        proxySource.getDisplayName() +
        ": " + e.getMessage());
  } finally {
    IOUtils.closeStream(out);
    IOUtils.closeStream(in);
    IOUtils.closeSocket(sock);
    
    proxySource.removePendingBlock(this);
    target.removePendingBlock(this);

    synchronized (this) {
      reset();
    }
    synchronized (Balancer.this) {
      Balancer.this.notifyAll();
    }
  }
}

开发者ID:hopshadoop，项目名称:hops，代码行数:54，代码来源:Balancer.java

示例6: transfer

import org.apache.hadoop.hdfs.protocol.datatransfer.DataTransferEncryptor; //导入依赖的package包/类
private void transfer(final DatanodeInfo src, final DatanodeInfo[] targets,
    final Token<BlockTokenIdentifier> blockToken) throws IOException {
  //transfer replica to the new datanode
  Socket sock = null;
  DataOutputStream out = null;
  DataInputStream in = null;
  try {
    sock = createSocketForPipeline(src, 2, dfsClient);
    final long writeTimeout = dfsClient.getDatanodeWriteTimeout(2);
    
    OutputStream unbufOut = NetUtils.getOutputStream(sock, writeTimeout);
    InputStream unbufIn = NetUtils.getInputStream(sock);
    if (dfsClient.shouldEncryptData() && 
        !dfsClient.trustedChannelResolver.isTrusted(sock.getInetAddress())) {
      IOStreamPair encryptedStreams =
          DataTransferEncryptor.getEncryptedStreams(
              unbufOut, unbufIn, dfsClient.getDataEncryptionKey());
      unbufOut = encryptedStreams.out;
      unbufIn = encryptedStreams.in;
    }
    out = new DataOutputStream(new BufferedOutputStream(unbufOut,
        HdfsConstants.SMALL_BUFFER_SIZE));
    in = new DataInputStream(unbufIn);

    //send the TRANSFER_BLOCK request
    new Sender(out).transferBlock(block, blockToken, dfsClient.clientName,
        targets);
    out.flush();

    //ack
    BlockOpResponseProto response =
      BlockOpResponseProto.parseFrom(PBHelper.vintPrefixed(in));
    if (SUCCESS != response.getStatus()) {
      throw new IOException("Failed to add a datanode");
    }
  } finally {
    IOUtils.closeStream(in);
    IOUtils.closeStream(out);
    IOUtils.closeSocket(sock);
  }
}

开发者ID:Seagate，项目名称:hadoop-on-lustre2，代码行数:42，代码来源:DFSOutputStream.java

示例7: dispatch

import org.apache.hadoop.hdfs.protocol.datatransfer.DataTransferEncryptor; //导入依赖的package包/类
private void dispatch() {
  Socket sock = new Socket();
  DataOutputStream out = null;
  DataInputStream in = null;
  try {
    sock.connect(
        NetUtils.createSocketAddr(target.datanode.getXferAddr()),
        HdfsServerConstants.READ_TIMEOUT);
    /* Unfortunately we don't have a good way to know if the Datanode is
     * taking a really long time to move a block, OR something has
     * gone wrong and it's never going to finish. To deal with this 
     * scenario, we set a long timeout (20 minutes) to avoid hanging
     * the balancer indefinitely.
     */
    sock.setSoTimeout(BLOCK_MOVE_READ_TIMEOUT);

    sock.setKeepAlive(true);
    
    OutputStream unbufOut = sock.getOutputStream();
    InputStream unbufIn = sock.getInputStream();
    if (nnc.getDataEncryptionKey() != null) {
      IOStreamPair encryptedStreams =
          DataTransferEncryptor.getEncryptedStreams(
              unbufOut, unbufIn, nnc.getDataEncryptionKey());
      unbufOut = encryptedStreams.out;
      unbufIn = encryptedStreams.in;
    }
    out = new DataOutputStream(new BufferedOutputStream(unbufOut,
        HdfsConstants.IO_FILE_BUFFER_SIZE));
    in = new DataInputStream(new BufferedInputStream(unbufIn,
        HdfsConstants.IO_FILE_BUFFER_SIZE));
    
    sendRequest(out);
    receiveResponse(in);
    bytesMoved.inc(block.getNumBytes());
    LOG.info("Successfully moved " + this);
  } catch (IOException e) {
    LOG.warn("Failed to move " + this + ": " + e.getMessage());
    /* proxy or target may have an issue, insert a small delay
     * before using these nodes further. This avoids a potential storm
     * of "threads quota exceeded" Warnings when the balancer
     * gets out of sync with work going on in datanode.
     */
    proxySource.activateDelay(DELAY_AFTER_ERROR);
    target.activateDelay(DELAY_AFTER_ERROR);
  } finally {
    IOUtils.closeStream(out);
    IOUtils.closeStream(in);
    IOUtils.closeSocket(sock);
    
    proxySource.removePendingBlock(this);
    target.removePendingBlock(this);

    synchronized (this ) {
      reset();
    }
    synchronized (Balancer.this) {
      Balancer.this.notifyAll();
    }
  }
}

开发者ID:Seagate，项目名称:hadoop-on-lustre2，代码行数:62，代码来源:Balancer.java

注：本文中的org.apache.hadoop.hdfs.protocol.datatransfer.DataTransferEncryptor类示例整理自Github/MSDocs等源码及文档管理平台，相关代码片段筛选自各路编程大神贡献的开源项目，源码版权归原作者所有，传播和使用请参考对应项目的License；未经允许，请勿转载。

鲜花

握手

雷人

路过

鸡蛋

该文章已有0人参与评论

请发表评论

全部评论

专题导读

More+

10-27 六六分期app的软件客服如何联系？(六六分期

11-06 可心卡盟:win10系统火狐flash插件崩溃怎么

11-06 亲亲特价:怎么删除回收站图标

11-06 济南大学虚拟社区:鲁大师节能降温的具体办

11-06 xlueops.exe:无线网络安装向导

11-06 女斗合众国:win7系统cf与主机连接不稳定怎

11-06 0xc000022-[cf烟雾头]cf怎么调烟雾头

11-06 qizideyouhuo:应用程序无法正常启动0xc0000

11-06 ipz-185:win7系统vcf文件怎么打开

11-06 傻哥蹦迪:win10系统s4怎么打开usb调试

11-06 八神浩树gtaste:回收站清空了怎么恢复

11-06 妖尾之黑色守护:win10系统电脑没有1440x900

11-06 校园至尊魔王小说:win7系统浏览网页时字体

11-06 女斗合众国:win10系统访问共享文件夹提示请

11-06 tokyo hot n0654:恢复win7系统默认字体一招

11-06 雨酷仙境:设置win7系统转移临时文件夹腾出

11-06 阿穆纳伊之杖:win7系统开始菜单在右边还原

11-06 tunespotting:win10系统火狐flash插件总是

11-06 甘尔葛分析师：计谋网站seo关键词暴涨有什

11-06 蔡贵霖: 计谋网站seo关键词暴涨有什么秘密

11-06 博益网首页:ao3网页版进入不了解决方法

11-06 漏斗子专栏: 网站数据分析小白易懂精华篇

11-06 见证双虹怎么做:win7系统开启telnet命令的

11-06 颾狐蝶蜋:系统资源不足无法完成请求的服务

11-06 国光中学校歌:提交网站到alexa查询详细步骤

11-06 西安有情天:静态网页和动态网页的区别

11-06 红木雅尚斋:外部链接构造对网站的好处

11-06 前官礼遇：防止域名劫持–增强域安全性的10

11-06 密传二转答案: 中文分词算法有哪些

11-06 金泉家园邮编:百度快照劫持的表现及应对方

Java DateTimeField类代码示例发布时间：2022-05-23

Java PersistentEntity类代码示例发布时间：2022-05-23

剪的笔顺,诠释剪的笔画,认识剪的部首

1 六六分期app的软件客服如何联系？(六六分期

六六分期app的软件客服如何联系？不知道吗？加qq群【895510560】即可！标题：六六分期

阅读：17929|2023-10-27

2 可心卡盟:win10系统火狐flash插件崩溃怎么

今天小编告诉大家如何处理win10系统火狐flash插件总是崩溃的问题，可能很多用户都不知

阅读：9555|2022-11-06

3 亲亲特价:怎么删除回收站图标

今天小编告诉大家如何对win10系统删除桌面回收站图标进行设置，可能很多用户都不知道

阅读：8120|2022-11-06

4 济南大学虚拟社区:鲁大师节能降温的具体办

今天小编告诉大家如何对win10系统电脑设置节能降温的设置方法，想必大家都遇到过需要

阅读：8500|2022-11-06

5 xlueops.exe:无线网络安装向导

我们在使用xp系统的过程中,经常需要对xp系统无线网络安装向导设置进行设置，可能很多

阅读：8405|2022-11-06

6 女斗合众国:win7系统cf与主机连接不稳定怎

今天小编告诉大家如何处理win7系统玩cf老是与主机连接不稳定的问题，可能很多用户都不

阅读：9292|2022-11-06

7 0xc000022-[cf烟雾头]cf怎么调烟雾头

电脑对日常生活的重要性小编就不多说了，可是一旦碰到win7系统设置cf烟雾头的问题，很

阅读：8369|2022-11-06

8 qizideyouhuo:应用程序无法正常启动0xc0000

我们在日常使用电脑的时候，有的小伙伴们可能在打开应用的时候会遇见提示应用程序无法

阅读：7796|2022-11-06

9 ipz-185:win7系统vcf文件怎么打开

今天小编告诉大家如何对win7系统打开vcf文件进行设置，可能很多用户都不知道怎么对win

阅读：8350|2022-11-06

10 傻哥蹦迪:win10系统s4怎么打开usb调试

今天小编告诉大家如何对win10系统s4开启USB调试模式进行设置，可能很多用户都不知道怎

阅读：7354|2022-11-06

客服电话

电子邮件

Java DataTransferEncryptor类代码示例

示例1: transfer

示例2: EncryptedPeer

示例3: transfer

示例4: dispatch

示例5: dispatch

示例6: transfer

示例7: dispatch

请发表评论

全部评论

上一篇：

下一篇：

CVE-2022-34275

GaloyMoney/galoy-mobile

swcarpentry/matlab-novice-inflammation:

美国三一学院字怎么样？专业特色有哪些？

Twzy/MarkWord: a markdown editer

剪的笔顺,诠释剪的笔画,认识剪的部首

六六分期app的软件客服如何联系？(六六分期

florent37/ViewAnimator: A fluent Android

florent37/Shrine-MaterialDesign2: implem

CVE-2020-36276

SimpleSoftwareIO/simple-sms: Send and re

关于我们

产品与服务

解决方案

139-2527-9053