Java Pages类代码示例

OGeek|极客世界-中国程序员成长平台 › 门户 › 编程› Java›Java编程经验

原作者: [db:作者] 来自: [db:来源] 收藏邀请

本文整理汇总了Java中org.embulk.spi.util.Pages类的典型用法代码示例。如果您正苦于以下问题：Java Pages类的具体用法？Java Pages怎么用？Java Pages使用的例子？那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。

Pages类属于org.embulk.spi.util包，在下文中一共展示了Pages类的20个代码示例，这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞，您的评价将有助于我们的系统推荐出更棒的Java代码示例。

示例1: skipRecords

import org.embulk.spi.util.Pages; //导入依赖的package包/类
@Test
public void skipRecords()
        throws Exception
{
    SchemaConfig schema = schema(
            column("_c0", BOOLEAN), column("_c1", LONG), column("_c2", DOUBLE),
            column("_c3", STRING), column("_c4", TIMESTAMP), column("_c5", JSON));
    ConfigSource config = this.config.deepCopy().set("columns", schema);

    transaction(config, fileInput(
            "[",
            "[]",
            "\"embulk\"",
            "10",
            "true",
            "false",
            "null",
            " ",
            "]"
    ));

    List<Object[]> records = Pages.toObjects(schema.toSchema(), output.pages);
    assertEquals(0, records.size());
}

开发者ID:hiroyuki-sato，项目名称:embulk-parser-jsonpath，代码行数:25，代码来源:TestJsonpathParserPlugin.java

示例2: booleanStrings

import org.embulk.spi.util.Pages; //导入依赖的package包/类
@Test
public void booleanStrings()
        throws Exception
{
    SchemaConfig schema = schema(column("_c1", BOOLEAN), column("_c2", BOOLEAN),
            column("_c3", BOOLEAN), column("_c4", BOOLEAN), column("_c5", BOOLEAN),
            column("_c6", BOOLEAN), column("_c7", BOOLEAN), column("_c8", BOOLEAN),
            column("_c9", BOOLEAN), column("_c10", BOOLEAN), column("_c11", BOOLEAN),
            column("_c12", BOOLEAN));
    ConfigSource config = this.config.deepCopy().set("columns", schema);

    transaction(config, fileInput("[{\"_c1\" : \"yes\", \"_c2\" : \"true\", \"_c3\" : \"1\",",
            "\"_c4\" : \"on\", \"_c5\" : \"y\", \"_c6\" : \"t\",",
            "\"_c7\" : \"no\", \"_c8\" : \"false\", \"_c9\" : \"0\"," ,
            "\"_c10\" : \"off\", \"_c11\" : \"n\", \"_c12\" : \"f\"}]"));
    List<Object[]> records = Pages.toObjects(schema.toSchema(), output.pages);
    assertEquals(1, records.size());

    Object[] record = records.get(0);
    for (int i = 0; i < 5; i++) {
        assertTrue((boolean) record[i]);
    }
    for (int i = 6; i < 11; i++) {
        assertFalse((boolean) record[i]);
    }
}

开发者ID:hiroyuki-sato，项目名称:embulk-parser-jsonpath，代码行数:27，代码来源:TestJsonpathParserPlugin.java

示例3: filter

import org.embulk.spi.util.Pages; //导入依赖的package包/类
private List<Object[]> filter(PluginTask task, Schema inputSchema, Object ... objects)
{
    TestPageBuilderReader.MockPageOutput output = new TestPageBuilderReader.MockPageOutput();
    Schema outputSchema = BuildJsonFilterPlugin.buildOutputSchema(task, inputSchema);
    PageBuilder pageBuilder = new PageBuilder(runtime.getBufferAllocator(), outputSchema, output);
    PageReader pageReader = new PageReader(inputSchema);
    BuildJsonVisitorImpl visitor = new BuildJsonVisitorImpl(task, inputSchema, outputSchema, pageReader, pageBuilder);

    List<Page> pages = PageTestUtils.buildPage(runtime.getBufferAllocator(), inputSchema, objects);
    for (Page page : pages) {
        pageReader.setPage(page);

        while (pageReader.nextRecord()) {
            outputSchema.visitColumns(visitor);
            pageBuilder.addRecord();
        }
    }
    pageBuilder.finish();
    pageBuilder.close();
    return Pages.toObjects(outputSchema, output.pages);
}

开发者ID:hiroyuki-sato，项目名称:embulk-filter-build_json，代码行数:22，代码来源:TestBuildJsonVisitorImpl.java

示例4: filter

import org.embulk.spi.util.Pages; //导入依赖的package包/类
private List<Object[]> filter(PluginTask task, Schema inputSchema, Object ... objects)
{
    MockPageOutput output = new MockPageOutput();
    Schema outputSchema = plugin.buildOutputSchema(task, inputSchema);
    PageBuilder pageBuilder = new PageBuilder(runtime.getBufferAllocator(), outputSchema, output);
    PageReader pageReader = new PageReader(inputSchema);
    final Map<String, List<Base58FilterPlugin.Base58Column>> base58ColumnMap = Base58FilterPlugin.convertBase58ColumnListToMap(task.getColumns());
    final Map<String, Column> outputColumnMap = Base58FilterPlugin.convertColumnListToMap(outputSchema.getColumns(), null);

    List<Page> pages = PageTestUtils.buildPage(runtime.getBufferAllocator(), inputSchema, objects);
    for (Page page : pages) {
        pageReader.setPage(page);

        while (pageReader.nextRecord()) {
            plugin.setValue(base58ColumnMap, outputColumnMap, pageReader, outputSchema, pageBuilder);
            pageBuilder.addRecord();
        }
    }
    pageBuilder.finish();
    pageBuilder.close();
    return Pages.toObjects(outputSchema, output.pages);
}

开发者ID:kfitzgerald，项目名称:embulk-filter-base58，代码行数:23，代码来源:TestBase58FilterImpl.java

示例5: filter

import org.embulk.spi.util.Pages; //导入依赖的package包/类
private List<Object[]> filter(PluginTask task, Schema inputSchema, Object ... objects)
{
    MockPageOutput output = new MockPageOutput();
    Schema outputSchema = ColumnFilterPlugin.buildOutputSchema(task, inputSchema);
    PageBuilder pageBuilder = new PageBuilder(runtime.getBufferAllocator(), outputSchema, output);
    PageReader pageReader = new PageReader(inputSchema);
    ColumnVisitorImpl visitor = new ColumnVisitorImpl(task, inputSchema, outputSchema, pageReader, pageBuilder);

    List<Page> pages = PageTestUtils.buildPage(runtime.getBufferAllocator(), inputSchema, objects);
    for (Page page : pages) {
        pageReader.setPage(page);

        while (pageReader.nextRecord()) {
            outputSchema.visitColumns(visitor);
            pageBuilder.addRecord();
        }
    }
    pageBuilder.finish();
    pageBuilder.close();
    return Pages.toObjects(outputSchema, output.pages);
}

开发者ID:sonots，项目名称:embulk-filter-column，代码行数:22，代码来源:TestColumnVisitorImpl.java

示例6: skipRecords

import org.embulk.spi.util.Pages; //导入依赖的package包/类
@Test
public void skipRecords()
        throws Exception
{
    SchemaConfig schema = schema(
            column("_c0", BOOLEAN), column("_c1", LONG), column("_c2", DOUBLE),
            column("_c3", STRING), column("_c4", TIMESTAMP), column("_c5", JSON));
    ConfigSource config = this.config.deepCopy().set("columns", schema);

    transaction(config, fileInput(
            "[]",
            "\"embulk\"",
            "10",
            "true",
            "false",
            "null",
            " "
    ));

    List<Object[]> records = Pages.toObjects(schema.toSchema(), output.pages);
    assertEquals(0, records.size());
}

开发者ID:shun0102，项目名称:embulk-parser-jsonl，代码行数:23，代码来源:TestJsonlParserPlugin.java

示例7: writeNils

import org.embulk.spi.util.Pages; //导入依赖的package包/类
@Test
public void writeNils()
        throws Exception
{
    SchemaConfig schema = schema(
            column("_c0", BOOLEAN), column("_c1", LONG), column("_c2", DOUBLE),
            column("_c3", STRING), column("_c4", TIMESTAMP), column("_c5", JSON));
    ConfigSource config = this.config.deepCopy().set("columns", schema);

    transaction(config, fileInput(
            "{}",
            "{\"_c0\":null,\"_c1\":null,\"_c2\":null}",
            "{\"_c3\":null,\"_c4\":null,\"_c5\":null}",
            "{}"
    ));

    List<Object[]> records = Pages.toObjects(schema.toSchema(), output.pages);
    assertEquals(4, records.size());

    for (Object[] record : records) {
        for (int i = 0; i < 6; i++) {
            assertNull(record[i]);
        }
    }
}

开发者ID:shun0102，项目名称:embulk-parser-jsonl，代码行数:26，代码来源:TestJsonlParserPlugin.java

示例8: useNoColumnsOption

import org.embulk.spi.util.Pages; //导入依赖的package包/类
@Test
public void useNoColumnsOption()
        throws Exception
{
    SchemaConfig schema = schema(
            column("id", LONG),
            column("code", LONG),
            column("name", STRING),
            column("description", STRING),
            column("flag", BOOLEAN),
            column("created_at", STRING),
            column("created_at_utc", DOUBLE),
            column("price", DOUBLE),
            column("spec", JSON),
            column("tags", JSON),
            column("options", JSON),
            column("item_type", STRING),
            column("dummy", STRING)
    );

    ConfigSource config = this.config.deepCopy().set("avsc", this.getClass().getResource("item.avsc").getPath());

    transaction(config, fileInput(new File(this.getClass().getResource("items.avro").getPath())));

    List<Object[]> records = Pages.toObjects(schema.toSchema(), output.pages);
    assertEquals(6, records.size());

    Object[] record = records.get(0);
    assertEquals(1L, record[0]);
    assertEquals(123456789012345678L, record[1]);
    assertEquals("Desktop", record[2]);
    assertEquals(true, record[4]);
    assertEquals("D", record[11]);
    assertEquals("[\"tag1\",\"tag2\"]", record[9].toString());
    assertEquals("bar", ((MapValue)record[10]).map().get(ValueFactory.newString("foo")).toString());
    assertEquals("opt1", ((MapValue)record[8]).map().get(ValueFactory.newString("key")).toString());
    assertEquals("2016-05-09T04:35:43+09:00", record[5].toString());
    assertNull(record[12]);
}

开发者ID:joker1007，项目名称:embulk-parser-avro，代码行数:40，代码来源:TestAvroParserPlugin.java

示例9: skipBrokenJson

import org.embulk.spi.util.Pages; //导入依赖的package包/类
@Test
public void skipBrokenJson()
        throws Exception
{
    SchemaConfig schema = schema(
            column("_c0", BOOLEAN), column("_c1", LONG), column("_c2", DOUBLE),
            column("_c3", STRING), column("_c4", TIMESTAMP), column("_c5", JSON));
    ConfigSource config = this.config.deepCopy().set("columns", schema);

    transaction(config, fileInput("BROKEN"));
    List<Object[]> records = Pages.toObjects(schema.toSchema(), output.pages);
    assertEquals(0, records.size());
}

开发者ID:hiroyuki-sato，项目名称:embulk-parser-jsonpath，代码行数:14，代码来源:TestJsonpathParserPlugin.java

示例10: skipBrokenColumn

import org.embulk.spi.util.Pages; //导入依赖的package包/类
@Test
public void skipBrokenColumn()
        throws Exception
{
    SchemaConfig schema = schema(column("_c1", TIMESTAMP));
    ConfigSource config = this.config.deepCopy().set("columns", schema).
            set("stop_on_invalid_record", false);

    transaction(config, fileInput("{\"_c1\" : \"INVALID\"}"));
    List<Object[]> records = Pages.toObjects(schema.toSchema(), output.pages);
    assertEquals(0, records.size());
}

开发者ID:hiroyuki-sato，项目名称:embulk-parser-jsonpath，代码行数:13，代码来源:TestJsonpathParserPlugin.java

示例11: writeNils

import org.embulk.spi.util.Pages; //导入依赖的package包/类
@Test
public void writeNils()
        throws Exception
{
    SchemaConfig schema = schema(
            column("_c0", BOOLEAN), column("_c1", LONG), column("_c2", DOUBLE),
            column("_c3", STRING), column("_c4", TIMESTAMP), column("_c5", JSON));
    ConfigSource config = this.config.deepCopy().set("columns", schema);

    transaction(config, fileInput(
            "[",
            "{},",
            "{\"_c0\":null,\"_c1\":null,\"_c2\":null},",
            "{\"_c3\":null,\"_c4\":null,\"_c5\":null},",
            "{}",
            "]"
    ));

    List<Object[]> records = Pages.toObjects(schema.toSchema(), output.pages);
    assertEquals(4, records.size());

    for (Object[] record : records) {
        for (int i = 0; i < 6; i++) {
            assertNull(record[i]);
        }
    }
}

开发者ID:hiroyuki-sato，项目名称:embulk-parser-jsonpath，代码行数:28，代码来源:TestJsonpathParserPlugin.java

示例12: useColumnOptions

import org.embulk.spi.util.Pages; //导入依赖的package包/类
@Test
public void useColumnOptions()
        throws Exception
{

    SchemaConfig schema = schema(
            column("_c0", BOOLEAN), column("_c1", LONG), column("_c2", DOUBLE));
    File yamlFile = getResourceFile("use_column_options.yml");
    ConfigSource config = getConfigFromYamlFile(yamlFile);

    transaction(config, fileInput(
            "{\"_c0\":\"true\",\"_c1\":\"10\",\"_c2\":\"0.1\"}",
            "{\"_c0\":\"false\",\"_c1\":\"-10\",\"_c2\":\"1.0\"}"
    ));

    List<Object[]> records = Pages.toObjects(schema.toSchema(), output.pages);
    assertEquals(2, records.size());

    Object[] record;
    {
        record = records.get(0);
        assertEquals(true, record[0]);
        assertEquals(10L, record[1]);
        assertEquals(0.1, (Double) record[2], 0.0001);
    }
    {
        record = records.get(1);
        assertEquals(false, record[0]);
        assertEquals(-10L, record[1]);
        assertEquals(1.0, (Double) record[2], 0.0001);
    }
}

开发者ID:shun0102，项目名称:embulk-parser-jsonl，代码行数:33，代码来源:TestJsonlParserPlugin.java

示例13: testExpandSpecialJsonValuesFromString

import org.embulk.spi.util.Pages; //导入依赖的package包/类
@Test
public void testExpandSpecialJsonValuesFromString()
{
    final String configYaml = "" +
            "type: expand_json\n" +
            "json_column_name: _c1\n" +
            "root: $.\n" +
            "expanded_columns:\n" +
            "  - {name: _e0, type: string}\n" +
            "  - {name: _e1, type: string}\n"; // the value will be null

    ConfigSource config = getConfigFromYaml(configYaml);
    final Schema schema = schema("_c0", STRING, "_c1", STRING);

    expandJsonFilterPlugin.transaction(config, schema, new Control()
    {
        @Override
        public void run(TaskSource taskSource, Schema outputSchema)
        {
            MockPageOutput mockPageOutput = new MockPageOutput();

            try (PageOutput pageOutput = expandJsonFilterPlugin.open(taskSource, schema, outputSchema, mockPageOutput)) {
                for (Page page : PageTestUtils.buildPage(runtime.getBufferAllocator(), schema,
                        "_v0", "")) {
                    pageOutput.add(page);
                }

                pageOutput.finish();
            }

            for (Object[] record : Pages.toObjects(outputSchema, mockPageOutput.pages)) {
                assertEquals("_v0", record[0]);
                assertNull(record[1]);
                assertNull(record[2]);
            }
        }
    });
}

开发者ID:civitaspo，项目名称:embulk-filter-expand_json，代码行数:39，代码来源:TestExpandJsonFilterPlugin.java

示例14: testUnchangedColumnValues

import org.embulk.spi.util.Pages; //导入依赖的package包/类
@Test
public void testUnchangedColumnValues()
{
    String configYaml = "" +
            "type: expand_json\n" +
            "json_column_name: _c6\n" +
            "root: $.\n" +
            "expanded_columns:\n" +
            "  - {name: _e0, type: string}\n";
    final ConfigSource config = getConfigFromYaml(configYaml);
    final Schema schema = schema("_c0", STRING, "_c1", BOOLEAN, "_c2", DOUBLE,
            "_c3", LONG, "_c4", TIMESTAMP, "_c5", JSON, "_c6", STRING);

    expandJsonFilterPlugin.transaction(config, schema, new Control()
    {
        @Override
        public void run(TaskSource taskSource, Schema outputSchema)
        {
            MockPageOutput mockPageOutput = new MockPageOutput();

            try (PageOutput pageOutput = expandJsonFilterPlugin.open(taskSource, schema, outputSchema, mockPageOutput)) {
                for (Page page : PageTestUtils.buildPage(runtime.getBufferAllocator(), schema,
                        "_v0", // _c0
                        true,  // _c1
                        0.2, // _c2
                        3L,   // _c3
                        Timestamp.ofEpochSecond(4), // _c4
                        newMapBuilder().put(s("_e0"), s("_v5")).build(), // _c5
                        "{\"_e0\":\"_v6\"}")) {
                    pageOutput.add(page);
                }

                pageOutput.finish();
            }

            List<Object[]> records = Pages.toObjects(outputSchema, mockPageOutput.pages);
            assertEquals(1, records.size());

            Object[] record = records.get(0);
            assertEquals("_v0", record[0]);
            assertEquals(true, record[1]);
            assertEquals(0.2, (double) record[2], 0.0001);
            assertEquals(3L, record[3]);
            assertEquals(Timestamp.ofEpochSecond(4), record[4]);
            assertEquals(newMapBuilder().put(s("_e0"), s("_v5")).build(), record[5]);
        }
    });
}

开发者ID:civitaspo，项目名称:embulk-filter-expand_json，代码行数:49，代码来源:TestExpandJsonFilterPlugin.java

示例15: testExpandedJsonValuesWithKeepJsonColumns

import org.embulk.spi.util.Pages; //导入依赖的package包/类
@Test
public void testExpandedJsonValuesWithKeepJsonColumns()
{
    final String configYaml = "" +
            "type: expand_json\n" +
            "json_column_name: _c1\n" +
            "root: $.\n" +
            "expanded_columns:\n" +
            "  - {name: _e0, type: string}\n" +
            "keep_expanding_json_column: true\n";

    ConfigSource config = getConfigFromYaml(configYaml);
    final Schema schema = schema("_c0", STRING, "_c1", STRING);

    expandJsonFilterPlugin.transaction(config, schema, new Control()
    {
        @Override
        public void run(TaskSource taskSource, Schema outputSchema)
        {
            MockPageOutput mockPageOutput = new MockPageOutput();

            try (PageOutput pageOutput = expandJsonFilterPlugin.open(taskSource, schema, outputSchema, mockPageOutput)) {
                for (Page page : PageTestUtils.buildPage(runtime.getBufferAllocator(), schema,
                        "_v0", "{\"_e0\":\"_ev0\"}")) {
                    pageOutput.add(page);
                }

                pageOutput.finish();
            }

            assertEquals(3, outputSchema.getColumnCount());
            Column column;
            { // 1st column
                column = outputSchema.getColumn(0);
                assertTrue(column.getName().equals("_c0") && column.getType().equals(STRING));
            }
            { // 2nd column
                column = outputSchema.getColumn(1);
                assertTrue(column.getName().equals("_c1") && column.getType().equals(STRING));
            }
            { // 3rd column
                column = outputSchema.getColumn(2);
                assertTrue(column.getName().equals("_e0") && column.getType().equals(STRING));
            }

            for (Object[] record : Pages.toObjects(outputSchema, mockPageOutput.pages)) {
                assertEquals("_v0", record[0]);
                assertEquals("{\"_e0\":\"_ev0\"}", record[1]);
                assertEquals("_ev0", record[2]);
            }
        }
    });
}

开发者ID:civitaspo，项目名称:embulk-filter-expand_json，代码行数:54，代码来源:TestExpandJsonFilterPlugin.java

示例16: getRecords

import org.embulk.spi.util.Pages; //导入依赖的package包/类
private List<Object[]> getRecords(ConfigSource config, MockPageOutput output)
{
    Schema schema = config.getNested("parser").loadConfig(CsvParserPlugin.PluginTask.class).getSchemaConfig().toSchema();
    return Pages.toObjects(schema, output.pages);
}

开发者ID:civitaspo，项目名称:embulk-input-hdfs，代码行数:6，代码来源:TestHdfsFileInputPlugin.java

示例17: testDistinctBySingleColumn

import org.embulk.spi.util.Pages; //导入依赖的package包/类
@Test
public void testDistinctBySingleColumn()
{
    String yaml = "" +
            "type: distinct\n" +
            "columns: [_c0]\n";

    ConfigSource config = loadConfigFromYaml(yaml);
    plugin.transaction(config, schema, new Control() {
        @Override
        public void run(TaskSource taskSource, Schema outputSchema)
        {
            MockPageOutput output = new MockPageOutput();

            try (PageOutput pageOutput = plugin.open(taskSource, schema, outputSchema, output)) {
                for (Page page : PageTestUtils.buildPage(runtime.getBufferAllocator(), schema,
                        "a", "a",  // row: 1
                        "a", "a",  // row: 2
                        "a", "b",  // row: 3
                        "b", "b",  // row: 4
                        "b", "a",  // row: 5
                        "b", "b",  // row: 6
                        null, "a", // row: 7
                        null, "b"  // row: 8
                        )
                        ) {
                    pageOutput.add(page);
                }
                pageOutput.finish();
            }

            List<Object[]> records = Pages.toObjects(outputSchema, output.pages);
            assertEquals(3, records.size());

            Object[] record1 = records.get(0);
            assertEquals("a", record1[0]);
            assertEquals("a", record1[1]);

            Object[] record2 = records.get(1);
            assertEquals("b", record2[0]);
            assertEquals("b", record2[1]);

            Object[] record3 = records.get(2);
            assertNull(record3[0]);
            assertEquals("a", record3[1]);
        }
    });
}

开发者ID:civitaspo，项目名称:embulk-filter-distinct，代码行数:49，代码来源:TestDistinctFilterPlugin.java

示例18: testDistinctByMultipleColumns

import org.embulk.spi.util.Pages; //导入依赖的package包/类
@Test
public void testDistinctByMultipleColumns()
{
    String yaml = "" +
            "type: distinct\n" +
            "columns: [_c0, _c1]\n";

    ConfigSource config = loadConfigFromYaml(yaml);
    plugin.transaction(config, schema, new Control() {
        @Override
        public void run(TaskSource taskSource, Schema outputSchema)
        {
            MockPageOutput output = new MockPageOutput();

            try (PageOutput pageOutput = plugin.open(taskSource, schema, outputSchema, output)) {
                for (Page page : PageTestUtils.buildPage(runtime.getBufferAllocator(), schema,
                        "a", "a",  // row: 1
                        "a", "a",  // row: 2
                        "a", "b",  // row: 3
                        "b", "b",  // row: 4
                        "b", "a",  // row: 5
                        "b", "b",  // row: 6
                        null, "a", // row: 7
                        null, "b"  // row: 8
                )
                        ) {
                    pageOutput.add(page);
                }
                pageOutput.finish();
            }

            List<Object[]> records = Pages.toObjects(outputSchema, output.pages);
            assertEquals(6, records.size());

            Object[] record1 = records.get(0);
            assertEquals("a", record1[0]);
            assertEquals("a", record1[1]);

            Object[] record2 = records.get(1);
            assertEquals("a", record2[0]);
            assertEquals("b", record2[1]);

            Object[] record3 = records.get(2);
            assertEquals("b", record3[0]);
            assertEquals("b", record3[1]);

            Object[] record4 = records.get(3);
            assertEquals("b", record4[0]);
            assertEquals("a", record4[1]);

            Object[] record5 = records.get(4);
            assertNull(record5[0]);
            assertEquals("a", record5[1]);

            Object[] record6 = records.get(5);
            assertNull(record6[0]);
            assertEquals("b", record6[1]);
        }
    });
}

开发者ID:civitaspo，项目名称:embulk-filter-distinct，代码行数:61，代码来源:TestDistinctFilterPlugin.java

示例19: testDistinctByLongColumn

import org.embulk.spi.util.Pages; //导入依赖的package包/类
@Test
public void testDistinctByLongColumn()
{
    schema = schema("_c0", Types.LONG, "_c1", Types.STRING);
    String yaml = "" +
            "type: distinct\n" +
            "columns: [_c0]\n";

    ConfigSource config = loadConfigFromYaml(yaml);
    plugin.transaction(config, schema, new Control() {
        @Override
        public void run(TaskSource taskSource, Schema outputSchema)
        {
            MockPageOutput output = new MockPageOutput();

            try (PageOutput pageOutput = plugin.open(taskSource, schema, outputSchema, output)) {
                for (Page page : PageTestUtils.buildPage(runtime.getBufferAllocator(), schema,
                        1L, "a",   // row: 1
                        1L, "a",   // row: 2
                        1L, "b",   // row: 3
                        2L, "b",   // row: 4
                        2L, "a",   // row: 5
                        2L, "b",   // row: 6
                        null, "a", // row: 7
                        null, "b"  // row: 8
                )
                        ) {
                    pageOutput.add(page);
                }
                pageOutput.finish();
            }

            List<Object[]> records = Pages.toObjects(outputSchema, output.pages);
            assertEquals(3, records.size());

            Object[] record1 = records.get(0);
            assertEquals(1L, record1[0]);
            assertEquals("a", record1[1]);

            Object[] record2 = records.get(1);
            assertEquals(2L, record2[0]);
            assertEquals("b", record2[1]);

            Object[] record3 = records.get(2);
            assertNull(record3[0]);
            assertEquals("a", record3[1]);
        }
    });
}

开发者ID:civitaspo，项目名称:embulk-filter-distinct，代码行数:50，代码来源:TestDistinctFilterPlugin.java

示例20: testDistinctByDoubleColumn

import org.embulk.spi.util.Pages; //导入依赖的package包/类
@Test
public void testDistinctByDoubleColumn()
{
    schema = schema("_c0", Types.DOUBLE, "_c1", Types.STRING);
    String yaml = "" +
            "type: distinct\n" +
            "columns: [_c0]\n";

    ConfigSource config = loadConfigFromYaml(yaml);
    plugin.transaction(config, schema, new Control() {
        @Override
        public void run(TaskSource taskSource, Schema outputSchema)
        {
            MockPageOutput output = new MockPageOutput();

            try (PageOutput pageOutput = plugin.open(taskSource, schema, outputSchema, output)) {
                for (Page page : PageTestUtils.buildPage(runtime.getBufferAllocator(), schema,
                        1.1, "a",  // row: 1
                        1.1, "a",  // row: 2
                        1.1, "b",  // row: 3
                        2.2, "b",  // row: 4
                        2.2, "a",  // row: 5
                        2.2, "b",  // row: 6
                        null, "a", // row: 7
                        null, "b"  // row: 8
                )
                        ) {
                    pageOutput.add(page);
                }
                pageOutput.finish();
            }

            List<Object[]> records = Pages.toObjects(outputSchema, output.pages);
            assertEquals(3, records.size());

            Object[] record1 = records.get(0);
            assertEquals(1.1, record1[0]);
            assertEquals("a", record1[1]);

            Object[] record2 = records.get(1);
            assertEquals(2.2, record2[0]);
            assertEquals("b", record2[1]);

            Object[] record3 = records.get(2);
            assertNull(record3[0]);
            assertEquals("a", record3[1]);
        }
    });
}

开发者ID:civitaspo，项目名称:embulk-filter-distinct，代码行数:50，代码来源:TestDistinctFilterPlugin.java

注：本文中的org.embulk.spi.util.Pages类示例整理自Github/MSDocs等源码及文档管理平台，相关代码片段筛选自各路编程大神贡献的开源项目，源码版权归原作者所有，传播和使用请参考对应项目的License；未经允许，请勿转载。

鲜花

握手

雷人

路过

鸡蛋

该文章已有0人参与评论

请发表评论

全部评论

专题导读

More+

10-27 六六分期app的软件客服如何联系？(六六分期

11-06 可心卡盟:win10系统火狐flash插件崩溃怎么

11-06 亲亲特价:怎么删除回收站图标

11-06 济南大学虚拟社区:鲁大师节能降温的具体办

11-06 xlueops.exe:无线网络安装向导

11-06 女斗合众国:win7系统cf与主机连接不稳定怎

11-06 0xc000022-[cf烟雾头]cf怎么调烟雾头

11-06 qizideyouhuo:应用程序无法正常启动0xc0000

11-06 ipz-185:win7系统vcf文件怎么打开

11-06 傻哥蹦迪:win10系统s4怎么打开usb调试

11-06 八神浩树gtaste:回收站清空了怎么恢复

11-06 妖尾之黑色守护:win10系统电脑没有1440x900

11-06 校园至尊魔王小说:win7系统浏览网页时字体

11-06 女斗合众国:win10系统访问共享文件夹提示请

11-06 tokyo hot n0654:恢复win7系统默认字体一招

11-06 雨酷仙境:设置win7系统转移临时文件夹腾出

11-06 阿穆纳伊之杖:win7系统开始菜单在右边还原

11-06 tunespotting:win10系统火狐flash插件总是

11-06 甘尔葛分析师：计谋网站seo关键词暴涨有什

11-06 蔡贵霖: 计谋网站seo关键词暴涨有什么秘密

11-06 博益网首页:ao3网页版进入不了解决方法

11-06 漏斗子专栏: 网站数据分析小白易懂精华篇

11-06 见证双虹怎么做:win7系统开启telnet命令的

11-06 颾狐蝶蜋:系统资源不足无法完成请求的服务

11-06 国光中学校歌:提交网站到alexa查询详细步骤

11-06 西安有情天:静态网页和动态网页的区别

11-06 红木雅尚斋:外部链接构造对网站的好处

11-06 前官礼遇：防止域名劫持–增强域安全性的10

11-06 密传二转答案: 中文分词算法有哪些

11-06 金泉家园邮编:百度快照劫持的表现及应对方

Java RichEditor类代码示例发布时间：2022-05-22

Java JsonPath类代码示例发布时间：2022-05-22

剪的笔顺,诠释剪的笔画,认识剪的部首

1 六六分期app的软件客服如何联系？(六六分期

六六分期app的软件客服如何联系？不知道吗？加qq群【895510560】即可！标题：六六分期

阅读：18248|2023-10-27

2 可心卡盟:win10系统火狐flash插件崩溃怎么

今天小编告诉大家如何处理win10系统火狐flash插件总是崩溃的问题，可能很多用户都不知

阅读：9671|2022-11-06

3 亲亲特价:怎么删除回收站图标

今天小编告诉大家如何对win10系统删除桌面回收站图标进行设置，可能很多用户都不知道

阅读：8175|2022-11-06

4 济南大学虚拟社区:鲁大师节能降温的具体办

今天小编告诉大家如何对win10系统电脑设置节能降温的设置方法，想必大家都遇到过需要

阅读：8547|2022-11-06

5 xlueops.exe:无线网络安装向导

我们在使用xp系统的过程中,经常需要对xp系统无线网络安装向导设置进行设置，可能很多

阅读：8455|2022-11-06

6 女斗合众国:win7系统cf与主机连接不稳定怎

今天小编告诉大家如何处理win7系统玩cf老是与主机连接不稳定的问题，可能很多用户都不

阅读：9384|2022-11-06

7 0xc000022-[cf烟雾头]cf怎么调烟雾头

电脑对日常生活的重要性小编就不多说了，可是一旦碰到win7系统设置cf烟雾头的问题，很

阅读：8426|2022-11-06

8 qizideyouhuo:应用程序无法正常启动0xc0000

我们在日常使用电脑的时候，有的小伙伴们可能在打开应用的时候会遇见提示应用程序无法

阅读：7859|2022-11-06

9 ipz-185:win7系统vcf文件怎么打开

今天小编告诉大家如何对win7系统打开vcf文件进行设置，可能很多用户都不知道怎么对win

阅读：8410|2022-11-06

10 傻哥蹦迪:win10系统s4怎么打开usb调试

今天小编告诉大家如何对win10系统s4开启USB调试模式进行设置，可能很多用户都不知道怎

阅读：7394|2022-11-06

客服电话

电子邮件

Java Pages类代码示例

示例1: skipRecords

示例2: booleanStrings

示例3: filter

示例4: filter

示例5: filter

示例6: skipRecords

示例7: writeNils

示例8: useNoColumnsOption

示例9: skipBrokenJson

示例10: skipBrokenColumn

示例11: writeNils

示例12: useColumnOptions

示例13: testExpandSpecialJsonValuesFromString

示例14: testUnchangedColumnValues

示例15: testExpandedJsonValuesWithKeepJsonColumns

示例16: getRecords

示例17: testDistinctBySingleColumn

示例18: testDistinctByMultipleColumns

示例19: testDistinctByLongColumn

示例20: testDistinctByDoubleColumn

请发表评论

全部评论

上一篇：

下一篇：

bradtraversy/iweather: Ionic 3 mobile we

joaomh/curso-de-matlab

断牙刷新位置时间（断牙属性及刷新位置介绍

the-virtual-brain/tvb-library: DEPRECATE

rugk/mastodon-simplified-federation: Sim

剪的笔顺,诠释剪的笔画,认识剪的部首

六六分期app的软件客服如何联系？(六六分期

florent37/ViewAnimator: A fluent Android

florent37/Shrine-MaterialDesign2: implem

CVE-2020-36276

SimpleSoftwareIO/simple-sms: Send and re

关于我们

产品与服务

解决方案

139-2527-9053