• 设为首页
  • 点击收藏
  • 手机版
    手机扫一扫访问
    迪恩网络手机版
  • 关注官方公众号
    微信扫一扫关注
    迪恩网络公众号

Java StemmerOverrideFilter类代码示例

原作者: [db:作者] 来自: [db:来源] 收藏 邀请

本文整理汇总了Java中org.apache.lucene.analysis.miscellaneous.StemmerOverrideFilter的典型用法代码示例。如果您正苦于以下问题:Java StemmerOverrideFilter类的具体用法?Java StemmerOverrideFilter怎么用?Java StemmerOverrideFilter使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。



StemmerOverrideFilter类属于org.apache.lucene.analysis.miscellaneous包,在下文中一共展示了StemmerOverrideFilter类的9个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于我们的系统推荐出更棒的Java代码示例。

示例1: parseRules

import org.apache.lucene.analysis.miscellaneous.StemmerOverrideFilter; //导入依赖的package包/类
static void parseRules(List<String> rules, StemmerOverrideFilter.Builder builder, String mappingSep) {
    for (String rule : rules) {
        String key, override;
        List<String> mapping = Strings.splitSmart(rule, mappingSep, false);
        if (mapping.size() == 2) {
            key = mapping.get(0).trim();
            override = mapping.get(1).trim();
        } else {
            throw new RuntimeException("Invalid Keyword override Rule:" + rule);
        }

        if (key.isEmpty() || override.isEmpty()) {
            throw new RuntimeException("Invalid Keyword override Rule:" + rule);
        } else {
            builder.add(key, override);
        }
    }
}
 
开发者ID:justor,项目名称:elasticsearch_my,代码行数:19,代码来源:StemmerOverrideTokenFilterFactory.java


示例2: create

import org.apache.lucene.analysis.miscellaneous.StemmerOverrideFilter; //导入依赖的package包/类
@Override public Object create(Random random) {
  int num = random.nextInt(10);
  StemmerOverrideFilter.Builder builder = new StemmerOverrideFilter.Builder(random.nextBoolean());
  for (int i = 0; i < num; i++) {
    String input = ""; 
    do {
      input = TestUtil.randomRealisticUnicodeString(random);
    } while(input.isEmpty());
    String out = ""; TestUtil.randomSimpleString(random);
    do {
      out = TestUtil.randomRealisticUnicodeString(random);
    } while(out.isEmpty());
    builder.add(input, out);
  }
  try {
    return builder.build();
  } catch (Exception ex) {
    Rethrow.rethrow(ex);
    return null; // unreachable code
  }
}
 
开发者ID:europeana,项目名称:search,代码行数:22,代码来源:TestRandomChains.java


示例3: DutchAnalyzer

import org.apache.lucene.analysis.miscellaneous.StemmerOverrideFilter; //导入依赖的package包/类
public DutchAnalyzer(Version matchVersion, CharArraySet stopwords, CharArraySet stemExclusionTable, CharArrayMap<String> stemOverrideDict) {
  this.matchVersion = matchVersion;
  this.stoptable = CharArraySet.unmodifiableSet(CharArraySet.copy(matchVersion, stopwords));
  this.excltable = CharArraySet.unmodifiableSet(CharArraySet.copy(matchVersion, stemExclusionTable));
  if (stemOverrideDict.isEmpty() || !matchVersion.onOrAfter(Version.LUCENE_31)) {
    this.stemdict = null;
    this.origStemdict = CharArrayMap.unmodifiableMap(CharArrayMap.copy(matchVersion, stemOverrideDict));
  } else {
    this.origStemdict = null;
    // we don't need to ignore case here since we lowercase in this analyzer anyway
    StemmerOverrideFilter.Builder builder = new StemmerOverrideFilter.Builder(false);
    CharArrayMap<String>.EntryIterator iter = stemOverrideDict.entrySet().iterator();
    CharsRef spare = new CharsRef();
    while (iter.hasNext()) {
      char[] nextKey = iter.nextKey();
      spare.copyChars(nextKey, 0, nextKey.length);
      builder.add(spare, iter.currentValue());
    }
    try {
      this.stemdict = builder.build();
    } catch (IOException ex) {
      throw new RuntimeException("can not build stem dict", ex);
    }
  }
}
 
开发者ID:yintaoxue,项目名称:read-open-source-code,代码行数:26,代码来源:DutchAnalyzer.java


示例4: create

import org.apache.lucene.analysis.miscellaneous.StemmerOverrideFilter; //导入依赖的package包/类
@Override public Object create(Random random) {
  int num = random.nextInt(10);
  StemmerOverrideFilter.Builder builder = new StemmerOverrideFilter.Builder(random.nextBoolean());
  for (int i = 0; i < num; i++) {
    String input = ""; 
    do {
      input = _TestUtil.randomRealisticUnicodeString(random);
    } while(input.isEmpty());
    String out = ""; _TestUtil.randomSimpleString(random);
    do {
      out = _TestUtil.randomRealisticUnicodeString(random);
    } while(out.isEmpty());
    builder.add(input, out);
  }
  try {
    return builder.build();
  } catch (Exception ex) {
    Rethrow.rethrow(ex);
    return null; // unreachable code
  }
}
 
开发者ID:jimaguere,项目名称:Maskana-Gestor-de-Conocimiento,代码行数:22,代码来源:TestRandomChains.java


示例5: StemmerOverrideTokenFilterFactory

import org.apache.lucene.analysis.miscellaneous.StemmerOverrideFilter; //导入依赖的package包/类
public StemmerOverrideTokenFilterFactory(IndexSettings indexSettings, Environment env, String name, Settings settings) throws IOException {
    super(indexSettings, name, settings);

    List<String> rules = Analysis.getWordList(env, settings, "rules");
    if (rules == null) {
        throw new IllegalArgumentException("stemmer override filter requires either `rules` or `rules_path` to be configured");
    }

    StemmerOverrideFilter.Builder builder = new StemmerOverrideFilter.Builder(false);
    parseRules(rules, builder, "=>");
    overrideMap = builder.build();

}
 
开发者ID:justor,项目名称:elasticsearch_my,代码行数:14,代码来源:StemmerOverrideTokenFilterFactory.java


示例6: DutchAnalyzer

import org.apache.lucene.analysis.miscellaneous.StemmerOverrideFilter; //导入依赖的package包/类
/**
 * @deprecated Use {@link #DutchAnalyzer(CharArraySet,CharArraySet,CharArrayMap)}
 */
@Deprecated
public DutchAnalyzer(Version matchVersion, CharArraySet stopwords, CharArraySet stemExclusionTable, CharArrayMap<String> stemOverrideDict) {
  setVersion(matchVersion);
  this.stoptable = CharArraySet.unmodifiableSet(CharArraySet.copy(matchVersion, stopwords));
  this.excltable = CharArraySet.unmodifiableSet(CharArraySet.copy(matchVersion, stemExclusionTable));
  if (stemOverrideDict.isEmpty() || !matchVersion.onOrAfter(Version.LUCENE_3_1)) {
    this.stemdict = null;
    this.origStemdict = CharArrayMap.unmodifiableMap(CharArrayMap.copy(matchVersion, stemOverrideDict));
  } else {
    this.origStemdict = null;
    // we don't need to ignore case here since we lowercase in this analyzer anyway
    StemmerOverrideFilter.Builder builder = new StemmerOverrideFilter.Builder(false);
    CharArrayMap<String>.EntryIterator iter = stemOverrideDict.entrySet().iterator();
    CharsRefBuilder spare = new CharsRefBuilder();
    while (iter.hasNext()) {
      char[] nextKey = iter.nextKey();
      spare.copyChars(nextKey, 0, nextKey.length);
      builder.add(spare.get(), iter.currentValue());
    }
    try {
      this.stemdict = builder.build();
    } catch (IOException ex) {
      throw new RuntimeException("can not build stem dict", ex);
    }
  }
}
 
开发者ID:lamsfoundation,项目名称:lams,代码行数:30,代码来源:DutchAnalyzer.java


示例7: StemmerOverrideTokenFilterFactory

import org.apache.lucene.analysis.miscellaneous.StemmerOverrideFilter; //导入依赖的package包/类
@Inject
public StemmerOverrideTokenFilterFactory(Index index, IndexSettingsService indexSettingsService, Environment env, @Assisted String name, @Assisted Settings settings) throws IOException {
    super(index, indexSettingsService.getSettings(), name, settings);

    List<String> rules = Analysis.getWordList(env, settings, "rules");
    if (rules == null) {
        throw new IllegalArgumentException("stemmer override filter requires either `rules` or `rules_path` to be configured");
    }
    
    StemmerOverrideFilter.Builder builder = new StemmerOverrideFilter.Builder(false);
    parseRules(rules, builder, "=>");
    overrideMap = builder.build();

}
 
开发者ID:baidu,项目名称:Elasticsearch,代码行数:15,代码来源:StemmerOverrideTokenFilterFactory.java


示例8: create

import org.apache.lucene.analysis.miscellaneous.StemmerOverrideFilter; //导入依赖的package包/类
@Override
public TokenStream create(TokenStream tokenStream) {
    return new StemmerOverrideFilter(tokenStream, overrideMap);
}
 
开发者ID:justor,项目名称:elasticsearch_my,代码行数:5,代码来源:StemmerOverrideTokenFilterFactory.java


示例9: create

import org.apache.lucene.analysis.miscellaneous.StemmerOverrideFilter; //导入依赖的package包/类
@Override
public TokenStream create(TokenStream input) {
  return dictionary == null ? input : new StemmerOverrideFilter(input, dictionary);
}
 
开发者ID:pkarmstr,项目名称:NYBC,代码行数:5,代码来源:StemmerOverrideFilterFactory.java



注:本文中的org.apache.lucene.analysis.miscellaneous.StemmerOverrideFilter类示例整理自Github/MSDocs等源码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。


鲜花

握手

雷人

路过

鸡蛋
该文章已有0人参与评论

请发表评论

全部评论

专题导读
上一篇:
Java SendMessageResult类代码示例发布时间:2022-05-22
下一篇:
Java Function类代码示例发布时间:2022-05-22
热门推荐
阅读排行榜

扫描微信二维码

查看手机版网站

随时了解更新最新资讯

139-2527-9053

在线客服(服务时间 9:00~18:00)

在线QQ客服
地址:深圳市南山区西丽大学城创智工业园
电邮:jeky_zhao#qq.com
移动电话:139-2527-9053

Powered by 互联科技 X3.4© 2001-2213 极客世界.|Sitemap