• 设为首页
  • 点击收藏
  • 手机版
    手机扫一扫访问
    迪恩网络手机版
  • 关注官方公众号
    微信扫一扫关注
    迪恩网络公众号

Java LoadPushDown类代码示例

原作者: [db:作者] 来自: [db:来源] 收藏 邀请

本文整理汇总了Java中org.apache.pig.LoadPushDown的典型用法代码示例。如果您正苦于以下问题:Java LoadPushDown类的具体用法?Java LoadPushDown怎么用?Java LoadPushDown使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。



LoadPushDown类属于org.apache.pig包,在下文中一共展示了LoadPushDown类的9个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于我们的系统推荐出更棒的Java代码示例。

示例1: getFeatures

import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public List<OperatorSet> getFeatures() {
    return Arrays.asList(LoadPushDown.OperatorSet.PROJECTION);
}
 
开发者ID:xushjie1987,项目名称:es-hadoop-v2.2.0,代码行数:5,代码来源:EsStorage.java


示例2: getFeatures

import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public List<OperatorSet> getFeatures() {
    return Lists.newArrayList(LoadPushDown.OperatorSet.PROJECTION);
}
 
开发者ID:sigmoidanalytics,项目名称:spork-streaming,代码行数:5,代码来源:AvroStorage.java


示例3: getFeatures

import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public List<OperatorSet> getFeatures() {
    List<OperatorSet> features = new ArrayList<OperatorSet>(1);
    features.add( LoadPushDown.OperatorSet.PROJECTION );
    return features;
}
 
开发者ID:sigmoidanalytics,项目名称:spork-streaming,代码行数:7,代码来源:TableLoader.java


示例4: prepareToRead

import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public void prepareToRead(
        @SuppressWarnings("rawtypes") RecordReader reader, PigSplit split)
        throws IOException {

    AllReader allReader = (AllReader) reader;

    if (currentPath == null || !(currentPath.equals(allReader.path))) {
        currentPathPartitionKeyMap = (partitionColumns == null) ? null
                : pathPartitionerHelper
                        .getPathPartitionKeyValues(allReader.path
                                .toString());
        currentPath = allReader.path;
    }

    childLoadFunc = allReader.prepareLoadFuncForReading(split);

    String projectProperty = getUDFContext().getProperty(PROJECTION_ID);

    if (projectProperty != null) {

        // load the required field list from the current UDF context
        ByteArrayInputStream input = new ByteArrayInputStream(
                Base64.decodeBase64(projectProperty.getBytes("UTF-8")));

        ObjectInputStream objInput = new ObjectInputStream(input);

        try {
            requiredFieldList = (RequiredFieldList) objInput.readObject();
        } catch (ClassNotFoundException e) {
            throw new FrontendException(e.toString(), e);
        } finally {
            IOUtils.closeStream(objInput);
        }

        if (childLoadFunc.getClass().isAssignableFrom(LoadPushDown.class)) {
            supportPushDownProjection = true;
            ((LoadPushDown) childLoadFunc)
                    .pushProjection(requiredFieldList);
        } else {
            if (requiredFieldList != null) {
                requiredFieldHashSet = new TreeSet<Integer>();
                for (RequiredField requiredField : requiredFieldList
                        .getFields()) {
                    requiredFieldHashSet.add(requiredField.getIndex());
                }
            }
        }

    }

}
 
开发者ID:sigmoidanalytics,项目名称:spork-streaming,代码行数:53,代码来源:AllLoader.java


示例5: getFeatures

import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
   public List<OperatorSet> getFeatures() {
return Arrays.asList(LoadPushDown.OperatorSet.PROJECTION);
   }
 
开发者ID:sigmoidanalytics,项目名称:spork-streaming,代码行数:5,代码来源:HiveColumnarLoader.java


示例6: getFeatures

import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public List<OperatorSet> getFeatures() {
  return asList(LoadPushDown.OperatorSet.PROJECTION);
}
 
开发者ID:apache,项目名称:parquet-mr,代码行数:5,代码来源:ParquetLoader.java


示例7: getFeatures

import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public List<OperatorSet> getFeatures() {
    return ((LoadPushDown)super.loadFunc()).getFeatures();
}
 
开发者ID:sigmoidanalytics,项目名称:spork,代码行数:5,代码来源:ParquetLoader.java


示例8: pushProjection

import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public RequiredFieldResponse pushProjection(RequiredFieldList requiredFieldList)
        throws FrontendException {
    return ((LoadPushDown)super.loadFunc()).pushProjection(requiredFieldList);
}
 
开发者ID:sigmoidanalytics,项目名称:spork,代码行数:6,代码来源:ParquetLoader.java


示例9: getFeatures

import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public List<OperatorSet> getFeatures() {
	return Arrays.asList(LoadPushDown.OperatorSet.PROJECTION);
}
 
开发者ID:data-tsunami,项目名称:cobol-dump-parser,代码行数:5,代码来源:FixedWidthLoader.java



注:本文中的org.apache.pig.LoadPushDown类示例整理自Github/MSDocs等源码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。


鲜花

握手

雷人

路过

鸡蛋
该文章已有0人参与评论

请发表评论

全部评论

专题导读
上一篇:
Java TransExecutionConfiguration类代码示例发布时间:2022-05-22
下一篇:
Java ValueUpdater类代码示例发布时间:2022-05-22
热门推荐
阅读排行榜

扫描微信二维码

查看手机版网站

随时了解更新最新资讯

139-2527-9053

在线客服(服务时间 9:00~18:00)

在线QQ客服
地址:深圳市南山区西丽大学城创智工业园
电邮:jeky_zhao#qq.com
移动电话:139-2527-9053

Powered by 互联科技 X3.4© 2001-2213 极客世界.|Sitemap