本文整理汇总了Java中com.univocity.parsers.common.ParsingContext类的典型用法代码示例。如果您正苦于以下问题:Java ParsingContext类的具体用法?Java ParsingContext怎么用?Java ParsingContext使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。
ParsingContext类属于com.univocity.parsers.common包,在下文中一共展示了ParsingContext类的20个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于我们的系统推荐出更棒的Java代码示例。
示例1: mapCsv
import com.univocity.parsers.common.ParsingContext; //导入依赖的package包/类
@Benchmark
public void mapCsv(Blackhole blackhole, CsvParam csvParam) throws IOException {
CsvParserSettings settings = new CsvParserSettings();
//turning off features enabled by default
settings.setIgnoreLeadingWhitespaces(false);
settings.setIgnoreTrailingWhitespaces(false);
settings.setSkipEmptyLines(false);
settings.setColumnReorderingEnabled(false);
settings.setReadInputOnSeparateThread(false);
settings.setRowProcessor(new BeanProcessor<City>(City.class) {
@Override
public void beanProcessed(City bean, ParsingContext context) {
blackhole.consume(bean);
}
});
com.univocity.parsers.csv.CsvParser parser = new com.univocity.parsers.csv.CsvParser(settings);
try(Reader reader = csvParam.getReader()) {
parser.parse(reader);
}
}
开发者ID:arnaudroger,项目名称:mapping-benchmark,代码行数:24,代码来源:UnivocityCsvParserBenchmark.java
示例2: parseCsv
import com.univocity.parsers.common.ParsingContext; //导入依赖的package包/类
@Benchmark
public void parseCsv(Blackhole blackhole, CsvParam csvParam) throws IOException {
CsvParserSettings settings = new CsvParserSettings();
//turning off features enabled by default
settings.setIgnoreLeadingWhitespaces(false);
settings.setIgnoreTrailingWhitespaces(false);
settings.setSkipEmptyLines(false);
settings.setColumnReorderingEnabled(false);
settings.setReadInputOnSeparateThread(false);
settings.setRowProcessor(new AbstractRowProcessor() {
@Override
public void rowProcessed(String[] row, ParsingContext context) {
blackhole.consume(row);
}
});
com.univocity.parsers.csv.CsvParser parser = new com.univocity.parsers.csv.CsvParser(settings);
try(Reader reader = csvParam.getReader()) {
parser.parse(reader);
}
}
开发者ID:arnaudroger,项目名称:mapping-benchmark,代码行数:24,代码来源:UnivocityCsvParserBenchmark.java
示例3: main
import com.univocity.parsers.common.ParsingContext; //导入依赖的package包/类
public static void main(String[] args) throws IOException {
CsvParam csvParam = new CsvParam();
csvParam.setUp();
CsvParserSettings settings = new CsvParserSettings();
//turning off features enabled by default
settings.setIgnoreLeadingWhitespaces(false);
settings.setIgnoreTrailingWhitespaces(false);
settings.setSkipEmptyLines(false);
settings.setColumnReorderingEnabled(false);
settings.setReadInputOnSeparateThread(false);
settings.setProcessor(new BeanProcessor<City>(City.class) {
@Override
public void beanProcessed(City bean, ParsingContext context) {
System.out.println(bean);
}
});
com.univocity.parsers.csv.CsvParser parser = new com.univocity.parsers.csv.CsvParser(settings);
try(Reader reader = csvParam.getReader()) {
parser.parse(reader);
}
}
开发者ID:arnaudroger,项目名称:mapping-benchmark,代码行数:26,代码来源:UnivocityCsvParserBenchmark.java
示例4: parseCsv
import com.univocity.parsers.common.ParsingContext; //导入依赖的package包/类
@Benchmark
public void parseCsv(Blackhole blackhole) throws IOException {
CsvParserSettings settings = new CsvParserSettings();
//turning off features enabled by default
settings.setIgnoreLeadingWhitespaces(false);
settings.setIgnoreTrailingWhitespaces(false);
settings.setSkipEmptyLines(false);
settings.setColumnReorderingEnabled(false);
settings.setReadInputOnSeparateThread(true);
settings.setRowProcessor(new AbstractRowProcessor() {
@Override
public void rowProcessed(String[] row, ParsingContext context) {
blackhole.consume(row);
}
});
com.univocity.parsers.csv.CsvParser parser = new com.univocity.parsers.csv.CsvParser(settings);
try(Reader reader = CsvParam.getSingleThreadedReader(quotes, nbRows)) {
parser.parse(reader);
}
}
开发者ID:arnaudroger,项目名称:mapping-benchmark,代码行数:24,代码来源:UnivocityConcurrentCsvParserBenchmark.java
示例5: mapCsv
import com.univocity.parsers.common.ParsingContext; //导入依赖的package包/类
@Benchmark
public void mapCsv(Blackhole blackhole) throws IOException {
CsvParserSettings settings = new CsvParserSettings();
//turning off features enabled by default
settings.setIgnoreLeadingWhitespaces(false);
settings.setIgnoreTrailingWhitespaces(false);
settings.setSkipEmptyLines(false);
settings.setColumnReorderingEnabled(false);
settings.setRowProcessor(new BeanProcessor<City>(City.class) {
@Override
public void beanProcessed(City bean, ParsingContext context) {
blackhole.consume(bean);
}
});
com.univocity.parsers.csv.CsvParser parser = new com.univocity.parsers.csv.CsvParser(settings);
try(Reader reader = CsvParam.getSingleThreadedReader(quotes, nbRows)) {
parser.parse(reader);
}
}
开发者ID:arnaudroger,项目名称:mapping-benchmark,代码行数:23,代码来源:UnivocityConcurrentCsvParserBenchmark.java
示例6: testUnivocityCsvMapper
import com.univocity.parsers.common.ParsingContext; //导入依赖的package包/类
@Benchmark
public void testUnivocityCsvMapper(final Blackhole blackhole) throws Exception {
BeanProcessor<SmallBenchmarkObject> rowProcessor = new BeanProcessor<SmallBenchmarkObject>(SmallBenchmarkObject.class) {
@Override
public void beanProcessed(SmallBenchmarkObject bean,
ParsingContext context) {
blackhole.consume(bean);
}
};
CsvParserSettings parserSettings = new CsvParserSettings();
parserSettings.setRowProcessor(rowProcessor);
parserSettings.setHeaderExtractionEnabled(true);
com.univocity.parsers.csv.CsvParser parser = new com.univocity.parsers.csv.CsvParser(parserSettings);
parser.parse(reader);
}
开发者ID:arnaudroger,项目名称:orm-benchmark,代码行数:21,代码来源:CsvMapperBenchmark.java
示例7: initBatch
import com.univocity.parsers.common.ParsingContext; //导入依赖的package包/类
/**
* Initializes data structures to capture parsed content
* @param csvColCount the number of columns in CSV content
* @param context the parsing context
*/
@SuppressWarnings("unchecked")
private void initBatch(int csvColCount, ParsingContext context) {
final int colCount = initHeader(csvColCount, context);
this.rowValues = new String[colCount];
this.batch = new DataBatch<>(options, colCount);
this.parsers = new Parser[colCount];
}
开发者ID:zavtech,项目名称:morpheus-core,代码行数:13,代码来源:CsvSource.java
示例8: loadToolNamesForUserCategory
import com.univocity.parsers.common.ParsingContext; //导入依赖的package包/类
/**
* Loads all user agents that should be in the user source category.
*/
private static void loadToolNamesForUserCategory()
{
TsvParserSettings parserSettings = new TsvParserSettings();
parserSettings.setLineSeparatorDetectionEnabled(true);
parserSettings.setHeaderExtractionEnabled(true);
parserSettings.setSkipEmptyLines(true);
parserSettings.setReadInputOnSeparateThread(true);
ObjectRowProcessor rowProcessor = new ObjectRowProcessor()
{
@Override
public void rowProcessed(Object[] row, ParsingContext parsingContext)
{
if (row.length < 1) {
logger.warn("Ignoring line without tab while parsing.");
return;
}
if (row.length == 1) {
sourceCategoryUserToolName.add(row[0].toString());
return;
}
logger.warn("Line with row length " + row.length + " found. Is the formatting of toolNameForUserCategory.tsv correct?");
return;
}
};
parserSettings.setProcessor(rowProcessor);
TsvParser parser = new TsvParser(parserSettings);
try {
parser.parse(new InputStreamReader(new FileInputStream("userAgentClassification/toolNameForUserCategory.tsv")));
} catch (FileNotFoundException e) {
logger.error("Could not open configuration file for standard prefixes.", e);
}
}
开发者ID:Wikidata,项目名称:QueryAnalysis,代码行数:41,代码来源:Main.java
示例9: loadPropertyGroupMapping
import com.univocity.parsers.common.ParsingContext; //导入依赖的package包/类
/**
* Loads the mapping of property to groups.
*/
private static void loadPropertyGroupMapping()
{
TsvParserSettings parserSettings = new TsvParserSettings();
parserSettings.setLineSeparatorDetectionEnabled(true);
parserSettings.setHeaderExtractionEnabled(true);
parserSettings.setSkipEmptyLines(true);
parserSettings.setReadInputOnSeparateThread(true);
ObjectRowProcessor rowProcessor = new ObjectRowProcessor()
{
@Override
public void rowProcessed(Object[] row, ParsingContext parsingContext)
{
if (row.length <= 1) {
logger.warn("Ignoring line without tab while parsing.");
return;
}
if (row.length == 2) {
if (row[1] == null) {
return;
}
propertyGroupMapping.put(row[0].toString(), new HashSet<String>(Arrays.asList(row[1].toString().split(","))));
return;
}
logger.warn("Line with row length " + row.length + " found. Is the formatting of propertyGroupMapping.tsv correct?");
return;
}
};
parserSettings.setProcessor(rowProcessor);
TsvParser parser = new TsvParser(parserSettings);
File file = new File("propertyClassification/propertyGroupMapping.tsv");
parser.parse(file);
}
开发者ID:Wikidata,项目名称:QueryAnalysis,代码行数:42,代码来源:Main.java
示例10: beanProcessed
import com.univocity.parsers.common.ParsingContext; //导入依赖的package包/类
/**
*
* @param blackDuckIssue
* @param context
*/
@Override
public void beanProcessed(BlackDuckIssue blackDuckIssue, ParsingContext context) {
if (rowsProcessed == 0) {
validateHeaders(context.headers());
}
buildVulnerability(blackDuckIssue, vulnerabilityHandler);
rowsProcessed++;
}
开发者ID:blackducksoftware,项目名称:hub-fortify-parser,代码行数:14,代码来源:BlackDuckCsvRowProcessor.java
示例11: UnivocityParserRowContext
import com.univocity.parsers.common.ParsingContext; //导入依赖的package包/类
public UnivocityParserRowContext(ParsingContext context, int size) {
this.context = context;
this.splitIndexes = new int[size];
if (size > 0) {
splitIndexes[0] = -1;
}
}
开发者ID:axibase,项目名称:atsd-jdbc,代码行数:8,代码来源:UnivocityParserRowContext.java
示例12: rowProcessed
import com.univocity.parsers.common.ParsingContext; //导入依赖的package包/类
/**
* Called when a row is processed, it retrieve the headers if necessary.
*
* @param row Processed row
* @param context Parsing context
*/
@Override
public void rowProcessed(String[] row, ParsingContext context) {
if (headers == null) {
headers = context.headers();
}
}
开发者ID:HydAu,项目名称:Camel,代码行数:13,代码来源:HeaderRowProcessor.java
示例13: processStarted
import com.univocity.parsers.common.ParsingContext; //导入依赖的package包/类
@Override
public void processStarted(ParsingContext context) {}
开发者ID:zavtech,项目名称:morpheus-core,代码行数:3,代码来源:CsvSource.java
示例14: loadPreBuildQueryTypes
import com.univocity.parsers.common.ParsingContext; //导入依赖的package包/类
/**
* Loads all pre-build query types.
*/
public static void loadPreBuildQueryTypes()
{
try (DirectoryStream<Path> directoryStream =
Files.newDirectoryStream(Paths.get("preBuildQueryTypeFiles"))) {
for (Path filePath : directoryStream) {
if (Files.isRegularFile(filePath)) {
if (filePath.toString().endsWith(".preBuildQueryType")) {
String queryString = new String(readAllBytes(filePath));
OpenRDFQueryHandler queryHandler = new OpenRDFQueryHandler(QueryHandler.Validity.DEFAULT, -1L, -1, queryString, "preBuildQueryTypes", "", -1);
if (queryHandler.getValidityStatus() != QueryHandler.Validity.VALID) {
logger.info("The Pre-build query " + filePath + " is no valid SPARQL");
continue;
}
ParsedQuery normalizedPreBuildQuery = queryHandler.getNormalizedQuery();
String queryTypeName = filePath.toString().substring(filePath.toString().lastIndexOf("/") + 1, filePath.toString().lastIndexOf("."));
if (normalizedPreBuildQuery != null) {
String queryDump = normalizedPreBuildQuery.getTupleExpr().toString();
byte[] md5 = DigestUtils.md5(queryDump);
int index = Math.floorMod(queryDump.hashCode(), numberOfQueryTypeDiskMaps);
queryTypes[index].put(md5, queryTypeName);
} else {
logger.info("Pre-build query " + queryTypeName + " could not be parsed.");
}
}
if (filePath.toString().endsWith(".tsv")) {
TsvParserSettings parserSettings = new TsvParserSettings();
parserSettings.setLineSeparatorDetectionEnabled(true);
parserSettings.setHeaderExtractionEnabled(true);
parserSettings.setSkipEmptyLines(true);
parserSettings.setReadInputOnSeparateThread(true);
ObjectRowProcessor rowProcessor = new ObjectRowProcessor()
{
@Override
public void rowProcessed(Object[] row, ParsingContext parsingContext)
{
if (row.length <= 1) {
logger.warn("Ignoring line without tab while parsing.");
return;
}
if (row.length == 5) {
queryTypeToToolMapping.put(new Tuple2<>(row[0].toString(), row[1].toString()), new Tuple2<>(row[2].toString(), row[3].toString()));
return;
}
logger.warn("Line with row length " + row.length + " found. Is the formatting of toolMapping.tsv correct?");
return;
}
};
parserSettings.setProcessor(rowProcessor);
TsvParser parser = new TsvParser(parserSettings);
parser.parse(filePath.toFile());
}
}
}
} catch (IOException e) {
logger.error("Could not read from directory inputData/queryType/premadeQueryTypeFiles", e);
}
}
开发者ID:Wikidata,项目名称:QueryAnalysis,代码行数:70,代码来源:Main.java
示例15: parseTo
import com.univocity.parsers.common.ParsingContext; //导入依赖的package包/类
/**
* Read the file given by reader and hands the data to the outputHandler.
*
* @param outputHandler Handles the data that should be written.
*/
public final void parseTo(final OutputHandler outputHandler, int day)
{
//read in queries from .tsv
TsvParserSettings parserSettings = new TsvParserSettings();
parserSettings.setLineSeparatorDetectionEnabled(true);
parserSettings.setHeaderExtractionEnabled(true);
parserSettings.setSkipEmptyLines(true);
parserSettings.setReadInputOnSeparateThread(true);
ObjectRowProcessor rowProcessor = new ObjectRowProcessor()
{
@Override
public void rowProcessed(Object[] row, ParsingContext parsingContext)
{
if (row.length <= 1) {
logger.warn("Ignoring line without tab while parsing.");
return;
}
Tuple2<String, QueryHandler.Validity> queryTuple = decode(row[0].toString(), inputFile, parsingContext.currentLine());
String queryString = queryTuple._1;
QueryHandler.Validity validity = queryTuple._2;
String userAgent = "null";
if (row[2] != null) {
userAgent = row[2].toString();
}
String timeStamp = "null";
if (row[3] != null) {
timeStamp = row[3].toString();
}
Long line = parsingContext.currentLine();
try {
outputHandler.writeLine(queryString, validity, userAgent, timeStamp, line, day, inputFile);
} catch (NullPointerException e) {
outputHandler.writeLine("", QueryHandler.Validity.INTERNAL_ERROR, userAgent, timeStamp, line, day, inputFile);
logger.error("Unexpected Null Pointer Exception in writeLine.", e);
}
}
};
parserSettings.setProcessor(rowProcessor);
TsvParser parser = new TsvParser(parserSettings);
parser.parse(reader);
outputHandler.closeFiles();
if (preprocessedWriter != null) {
preprocessedWriter.close();
}
}
开发者ID:Wikidata,项目名称:QueryAnalysis,代码行数:59,代码来源:InputHandlerTSV.java
示例16: processEnded
import com.univocity.parsers.common.ParsingContext; //导入依赖的package包/类
@Override
public void processEnded(ParsingContext context) {
super.processEnded(context);
}
开发者ID:blackducksoftware,项目名称:hub-fortify-parser,代码行数:5,代码来源:BlackDuckCsvRowProcessor.java
示例17: processStarted
import com.univocity.parsers.common.ParsingContext; //导入依赖的package包/类
@Override
public void processStarted(ParsingContext context) {
// do nothing
}
开发者ID:axibase,项目名称:atsd-jdbc,代码行数:5,代码来源:RowIterator.java
示例18: rowProcessed
import com.univocity.parsers.common.ParsingContext; //导入依赖的package包/类
@Override
public void rowProcessed(String[] row, ParsingContext context) {
parsed = row.length == 0 ? EMPTY_LINE : parseValues(row);
}
开发者ID:axibase,项目名称:atsd-jdbc,代码行数:5,代码来源:RowIterator.java
示例19: processEnded
import com.univocity.parsers.common.ParsingContext; //导入依赖的package包/类
@Override
public void processEnded(ParsingContext context) {
// do nothing
}
开发者ID:axibase,项目名称:atsd-jdbc,代码行数:5,代码来源:RowIterator.java
示例20: processStarted
import com.univocity.parsers.common.ParsingContext; //导入依赖的package包/类
/**
* Method is called by framework when new scan file parsing session
*
* @param context
* com.univocity.parsers.common.ParsingContext instanse
*/
@Override
public void processStarted(ParsingContext context) {
super.processStarted(context);
rowsProcessed = 0;
}
开发者ID:blackducksoftware,项目名称:hub-fortify-parser,代码行数:12,代码来源:BlackDuckCsvRowProcessor.java
注:本文中的com.univocity.parsers.common.ParsingContext类示例整理自Github/MSDocs等源码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。 |
请发表评论