• 设为首页
  • 点击收藏
  • 手机版
    手机扫一扫访问
    迪恩网络手机版
  • 关注官方公众号
    微信扫一扫关注
    迪恩网络公众号

Java Nimbus类代码示例

原作者: [db:作者] 来自: [db:来源] 收藏 邀请

本文整理汇总了Java中backtype.storm.generated.Nimbus的典型用法代码示例。如果您正苦于以下问题:Java Nimbus类的具体用法?Java Nimbus怎么用?Java Nimbus使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。



Nimbus类属于backtype.storm.generated包,在下文中一共展示了Nimbus类的20个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于我们的系统推荐出更棒的Java代码示例。

示例1: initThrift

import backtype.storm.generated.Nimbus; //导入依赖的package包/类
private void initThrift(Map conf) throws TTransportException {
	Integer thrift_port = JStormUtils.parseInt(conf
			.get(Config.NIMBUS_THRIFT_PORT));
	TNonblockingServerSocket socket = new TNonblockingServerSocket(
			thrift_port);

	Integer maxReadBufSize = JStormUtils.parseInt(conf
			.get(Config.NIMBUS_THRIFT_MAX_BUFFER_SIZE));

	THsHaServer.Args args = new THsHaServer.Args(socket);
	args.workerThreads(ServiceHandler.THREAD_NUM);
	args.protocolFactory(new TBinaryProtocol.Factory(false, true,
			maxReadBufSize));

	args.processor(new Nimbus.Processor<Iface>(serviceHandler));
	args.maxReadBufferBytes = maxReadBufSize;

	thriftServer = new THsHaServer(args);

	LOG.info("Successfully started nimbus: started Thrift server...");
	thriftServer.serve();
}
 
开发者ID:zhangjunfang,项目名称:jstorm-0.9.6.3-,代码行数:23,代码来源:NimbusServer.java


示例2: initThrift

import backtype.storm.generated.Nimbus; //导入依赖的package包/类
@SuppressWarnings("rawtypes")
private void initThrift(Map conf) throws TTransportException {
    Integer thrift_port = JStormUtils.parseInt(conf.get(Config.NIMBUS_THRIFT_PORT));
    TNonblockingServerSocket socket = new TNonblockingServerSocket(thrift_port);

    Integer maxReadBufSize = JStormUtils.parseInt(conf.get(Config.NIMBUS_THRIFT_MAX_BUFFER_SIZE));

    THsHaServer.Args args = new THsHaServer.Args(socket);
    args.workerThreads(ServiceHandler.THREAD_NUM);
    args.protocolFactory(new TBinaryProtocol.Factory(false, true, maxReadBufSize));

    args.processor(new Nimbus.Processor<Iface>(serviceHandler));
    args.maxReadBufferBytes = maxReadBufSize;

    thriftServer = new THsHaServer(args);

    LOG.info("Successfully started nimbus: started Thrift server...");
    thriftServer.serve();
}
 
开发者ID:songtk,项目名称:learn_jstorm,代码行数:20,代码来源:NimbusServer.java


示例3: initThrift

import backtype.storm.generated.Nimbus; //导入依赖的package包/类
@SuppressWarnings("rawtypes")
private void initThrift(Map conf) throws TTransportException {
    Integer thrift_port = JStormUtils.parseInt(conf.get(Config.NIMBUS_THRIFT_PORT));
    TNonblockingServerSocket socket = new TNonblockingServerSocket(thrift_port);

    Integer maxReadBufSize = JStormUtils.parseInt(conf.get(Config.NIMBUS_THRIFT_MAX_BUFFER_SIZE));

    THsHaServer.Args args = new THsHaServer.Args(socket);
    args.workerThreads(ServiceHandler.THREAD_NUM);
    args.protocolFactory(new TBinaryProtocol.Factory(false, true, maxReadBufSize, -1));

    args.processor(new Nimbus.Processor<Iface>(serviceHandler));
    args.maxReadBufferBytes = maxReadBufSize;

    thriftServer = new THsHaServer(args);

    LOG.info("Successfully started nimbus: started Thrift server...");
    thriftServer.serve();
}
 
开发者ID:kkllwww007,项目名称:jstrom,代码行数:20,代码来源:NimbusServer.java


示例4: getComponents

import backtype.storm.generated.Nimbus; //导入依赖的package包/类
/**
 * @@@ Don't be compatible with Storm
 * 
 *     Here skip the logic
 * @param client
 * @param topology
 * @return
 * @throws Exception
 */
private HashSet<String> getComponents(Nimbus.Client client, String topology) throws Exception {
    HashSet<String> components = new HashSet<String>();
    ClusterSummary clusterSummary = client.getClusterInfo();
    TopologySummary topologySummary = null;
    for (TopologySummary ts : clusterSummary.get_topologies()) {
        if (topology.equals(ts.get_name())) {
            topologySummary = ts;
            break;
        }
    }
    if (topologySummary == null) {
        throw new IllegalArgumentException("topology: " + topology + " not found");
    } else {
        String id = topologySummary.get_id();
        // GetInfoOptions getInfoOpts = new GetInfoOptions();
        // getInfoOpts.set_num_err_choice(NumErrorsChoice.NONE);
        // TopologyInfo info = client.getTopologyInfoWithOpts(id, getInfoOpts);
        // for (ExecutorSummary es: info.get_executors()) {
        // components.add(es.get_component_id());
        // }
    }
    return components;
}
 
开发者ID:kkllwww007,项目名称:jstrom,代码行数:33,代码来源:Monitor.java


示例5: initThrift

import backtype.storm.generated.Nimbus; //导入依赖的package包/类
@SuppressWarnings("rawtypes")
private void initThrift(Map conf) throws TTransportException {
	Integer thrift_port = JStormUtils.parseInt(conf
			.get(Config.NIMBUS_THRIFT_PORT));
	TNonblockingServerSocket socket = new TNonblockingServerSocket(
			thrift_port);

	Integer maxReadBufSize = JStormUtils.parseInt(conf
			.get(Config.NIMBUS_THRIFT_MAX_BUFFER_SIZE));

	THsHaServer.Args args = new THsHaServer.Args(socket);
	args.workerThreads(ServiceHandler.THREAD_NUM);
	args.protocolFactory(new TBinaryProtocol.Factory(false, true,
			maxReadBufSize));

	args.processor(new Nimbus.Processor<Iface>(serviceHandler));
	args.maxReadBufferBytes = maxReadBufSize;

	thriftServer = new THsHaServer(args);

	LOG.info("Successfully started nimbus: started Thrift server...");
	thriftServer.serve();
}
 
开发者ID:greeenSY,项目名称:Tstream,代码行数:24,代码来源:NimbusServer.java


示例6: getSlots

import backtype.storm.generated.Nimbus; //导入依赖的package包/类
private List<String> getSlots() throws Exception {
    NimbusClient nimbusClient = NimbusClient.getConfiguredClient(conf);
    Nimbus.Client nimbus = nimbusClient.getClient();
    List<String> slots = nimbus.getClusterInfo().get_supervisors().stream()
            .flatMap(s -> Arrays.asList(s.get_host() + ":6700", s.get_host() + ":6701").stream())
            .collect(Collectors.toList());
    Collections.shuffle(slots);
    System.out.println(slots.size());
    return slots;
}
 
开发者ID:ADSC-Resa,项目名称:resa,代码行数:11,代码来源:MigrateSimulate.java


示例7: doRebalance

import backtype.storm.generated.Nimbus; //导入依赖的package包/类
private void doRebalance(String topoName, int numWorkers) throws Exception {
    NimbusClient nimbusClient = NimbusClient.getConfiguredClient(conf);
    Nimbus.Client nimbus = nimbusClient.getClient();
    RebalanceOptions options = new RebalanceOptions();
    options.set_num_workers(numWorkers);
    options.set_wait_secs(1);
    System.out.println("Reassigning to " + numWorkers + " workers");
    nimbus.rebalance(topoName, options);
}
 
开发者ID:ADSC-Resa,项目名称:resa,代码行数:10,代码来源:MigrateSimulate.java


示例8: getClient

import backtype.storm.generated.Nimbus; //导入依赖的package包/类
public Nimbus.Client getClient() {
	return _client;
}
 
开发者ID:zhangjunfang,项目名称:jstorm-0.9.6.3-,代码行数:4,代码来源:NimbusClient.java


示例9: flush

import backtype.storm.generated.Nimbus; //导入依赖的package包/类
@Override
protected void flush() {
	_client = new Nimbus.Client(_protocol);
}
 
开发者ID:zhangjunfang,项目名称:jstorm-0.9.6.3-,代码行数:5,代码来源:NimbusClient.java


示例10: setLocalNimbus

import backtype.storm.generated.Nimbus; //导入依赖的package包/类
public static void setLocalNimbus(Nimbus.Iface localNimbusHandler) {
	StormSubmitter.localNimbus = localNimbusHandler;
}
 
开发者ID:zhangjunfang,项目名称:jstorm-0.9.6.3-,代码行数:4,代码来源:StormSubmitter.java


示例11: getClient

import backtype.storm.generated.Nimbus; //导入依赖的package包/类
public Nimbus.Client getClient() {
    return _client;
}
 
开发者ID:songtk,项目名称:learn_jstorm,代码行数:4,代码来源:NimbusClient.java


示例12: flush

import backtype.storm.generated.Nimbus; //导入依赖的package包/类
@Override
protected void flush() {
    // TODO Auto-generated method stub
    _client = new Nimbus.Client(_protocol);
}
 
开发者ID:songtk,项目名称:learn_jstorm,代码行数:6,代码来源:NimbusClient.java


示例13: NimbusClient

import backtype.storm.generated.Nimbus; //导入依赖的package包/类
public NimbusClient(Map conf, String host, int port, Integer timeout) throws TTransportException {
    super(conf, ThriftConnectionType.NIMBUS, host, port, timeout, null);
    _client = new Nimbus.Client(_protocol);
}
 
开发者ID:kkllwww007,项目名称:jstrom,代码行数:5,代码来源:NimbusClient.java


示例14: metrics

import backtype.storm.generated.Nimbus; //导入依赖的package包/类
public void metrics(Nimbus.Client client) throws Exception {
    if (_interval <= 0) {
        throw new IllegalArgumentException("poll interval must be positive");
    }

    if (_topology == null || _topology.isEmpty()) {
        throw new IllegalArgumentException("topology name must be something");
    }

    if (_component == null || _component.isEmpty()) {
        HashSet<String> components = getComponents(client, _topology);
        System.out.println("Available components for " + _topology + " :");
        System.out.println("------------------");
        for (String comp : components) {
            System.out.println(comp);
        }
        System.out.println("------------------");
        System.out.println("Please use -m to specify one component");
        return;
    }

    if (_stream == null || _stream.isEmpty()) {
        throw new IllegalArgumentException("stream name must be something");
    }

    if (!WATCH_TRANSFERRED.equals(_watch) && !WATCH_EMITTED.equals(_watch)) {
        throw new IllegalArgumentException("watch item must either be transferred or emitted");
    }
    System.out.println("topology\tcomponent\tparallelism\tstream\ttime-diff ms\t" + _watch + "\tthroughput (Kt/s)");

    long pollMs = _interval * 1000;
    long now = System.currentTimeMillis();
    MetricsState state = new MetricsState(now, 0);
    Poller poller = new Poller(now, pollMs);

    do {
        metrics(client, now, state);
        try {
            now = poller.nextPoll();
        } catch (InterruptedException e) {
            e.printStackTrace();
            break;
        }
    } while (true);
}
 
开发者ID:kkllwww007,项目名称:jstrom,代码行数:46,代码来源:Monitor.java


示例15: flush

import backtype.storm.generated.Nimbus; //导入依赖的package包/类
@Override
protected void flush() {
	// TODO Auto-generated method stub
	_client = new Nimbus.Client(_protocol);
}
 
开发者ID:greeenSY,项目名称:Tstream,代码行数:6,代码来源:NimbusClient.java


示例16: testRebalanceUsingTopologyHelper

import backtype.storm.generated.Nimbus; //导入依赖的package包/类
@Test
public void testRebalanceUsingTopologyHelper() throws Exception {

    conf.put(Config.NIMBUS_HOST, "192.168.0.31");
    conf.put(Config.NIMBUS_THRIFT_PORT, 6627);

    conf.put("resa.opt.smd.qos.ms", 1500.0);
    conf.put("resa.opt.win.history.size", 3);

    GeneralTopologyContext gtc = TopologyHelper.getGeneralTopologyContext("ta1wc", conf);

    if (gtc == null) {
        System.out.println("gtc is null");
        return;
    }

    String host = "192.168.0.31";
    int port = 6379;
    String queue = "ta1wc";
    int maxLen = 500;

    String topoName = "ta1wc";

    NimbusClient nimbusClient = NimbusClient.getConfiguredClient(conf);
    Nimbus.Client nimbus = nimbusClient.getClient();
    String topoId = TopologyHelper.getTopologyId(nimbus, topoName);

    Map<String, List<ExecutorDetails>> comp2Executors = TopologyHelper.getTopologyExecutors(topoName, conf)
            .entrySet().stream().filter(e -> !Utils.isSystemId(e.getKey()))
            .collect(Collectors.toMap(Map.Entry::getKey, Map.Entry::getValue));

    for (int i = 0; i < 10000; i++) {
        Utils.sleep(10000);

        TopologyInfo topoInfo = nimbus.getTopologyInfo(topoId);
        Map<String, Integer> currAllocation = topoInfo.get_executors().stream().filter(e -> !Utils.isSystemId(e.get_component_id()))
                .collect(Collectors.groupingBy(e -> e.get_component_id(),
                        Collectors.reducing(0, e -> 1, (i1, i2) -> i1 + i2)));

        System.out.println("-------------Report on: " + System.currentTimeMillis() + "------------------------------");
        System.out.println(currAllocation);
    }
}
 
开发者ID:ADSC-Resa,项目名称:resa,代码行数:44,代码来源:SimpleGeneralAllocCalculatorTest.java


示例17: testMakeUsingTopologyHelper

import backtype.storm.generated.Nimbus; //导入依赖的package包/类
@Test
public void testMakeUsingTopologyHelper() throws Exception {

    conf.put(Config.NIMBUS_HOST, "192.168.0.30");
    conf.put(Config.NIMBUS_THRIFT_PORT, 6627);

    conf.put("resa.opt.smd.qos.ms", 1500.0);
    conf.put("resa.opt.win.history.size", 3);

    conf.put("resa.comp.sample.rate", 1.0);

    conf.put(ResaConfig.ALLOWED_EXECUTOR_NUM, 7);

    GeneralTopologyContext gtc = TopologyHelper.getGeneralTopologyContext("ta1wc2Redis", conf);

    if (gtc == null) {
        System.out.println("gtc is null");
        return;
    }

    String host = "192.168.0.30";
    int port = 6379;
    String queue = "ta1wc";
    int maxLen = 500;

    String topoName = "ta1wc2Redis";

    NimbusClient nimbusClient = NimbusClient.getConfiguredClient(conf);
    Nimbus.Client nimbus = nimbusClient.getClient();
    String topoId = TopologyHelper.getTopologyId(nimbus, topoName);

    TopologyInfo topoInfo = nimbus.getTopologyInfo(topoId);

    Map<String, Integer> currAllocation = topoInfo.get_executors().stream().filter(e -> !Utils.isSystemId(e.get_component_id()))
            .collect(Collectors.groupingBy(e -> e.get_component_id(),
                    Collectors.reducing(0, e -> 1, (i1, i2) -> i1 + i2)));

    SimpleGeneralAllocCalculator smdm = new SimpleGeneralAllocCalculator();
    smdm.init(conf, currAllocation, gtc.getRawTopology());

    Map<String, List<ExecutorDetails>> comp2Executors = TopologyHelper.getTopologyExecutors(topoName, conf)
            .entrySet().stream().filter(e -> !Utils.isSystemId(e.getKey()))
            .collect(Collectors.toMap(Map.Entry::getKey, Map.Entry::getValue));

    for (int i = 0; i < 10000; i++) {
        Utils.sleep(30000);

        topoInfo = nimbus.getTopologyInfo(topoId);
        Map<String, Integer> updatedAllocation = topoInfo.get_executors().stream().filter(e -> !Utils.isSystemId(e.get_component_id()))
                .collect(Collectors.groupingBy(e -> e.get_component_id(),
                        Collectors.reducing(0, e -> 1, (i1, i2) -> i1 + i2)));

        AggResultCalculator resultCalculator = new AggResultCalculator(
                RedisDataSource.readData(host, port, queue, maxLen), comp2Executors, gtc.getRawTopology());
        resultCalculator.calCMVStat();

        System.out.println("-------------Report on: " + System.currentTimeMillis() + "------------------------------");
        if (currAllocation.equals(updatedAllocation)) {
            System.out.println(currAllocation + "-->" + smdm.calc(resultCalculator.getResults(), 7));
        } else {
            currAllocation = updatedAllocation;
            smdm.allocationChanged(currAllocation);
            System.out.println("Allocation updated to " + currAllocation);
        }
    }
}
 
开发者ID:ADSC-Resa,项目名称:resa,代码行数:67,代码来源:SimpleGeneralAllocCalculatorTest.java


示例18: testMakeUsingTopologyHelperForkTopology

import backtype.storm.generated.Nimbus; //导入依赖的package包/类
@Test
public void testMakeUsingTopologyHelperForkTopology() throws Exception {

    conf.put(Config.NIMBUS_HOST, "192.168.0.30");
    conf.put(Config.NIMBUS_THRIFT_PORT, 6627);

    conf.put("resa.opt.smd.qos.ms", 1500.0);
    conf.put("resa.opt.win.history.size", 3);
    conf.put("resa.opt.win.history.size.ignore", -1);
    conf.put("resa.comp.sample.rate", 1.0);

    int allewedExecutorNum = 24;
    conf.put(ResaConfig.ALLOWED_EXECUTOR_NUM, allewedExecutorNum);

    String host = "192.168.0.30";
    int port = 6379;
    String queue = "ta1wc";
    int maxLen = 5000;

    NimbusClient nimbusClient = NimbusClient.getConfiguredClient(conf);
    Nimbus.Client nimbus = nimbusClient.getClient();
    //String topoName = "ta1wc2P2Redis";
    ///String topoName = "ta1wcLoopRedis";
    ///String topoName = "arwcRedis";
    ///String topoName = "outdetResa";
    ///String topoName = "rwc";
    String topoName = "fpt";
    String topoId = TopologyHelper.getTopologyId(nimbus, topoName);

    TopologyInfo topoInfo = nimbus.getTopologyInfo(topoId);

    Map<String, Integer> currAllocation = topoInfo.get_executors().stream().filter(e -> !Utils.isSystemId(e.get_component_id()))
            .collect(Collectors.groupingBy(e -> e.get_component_id(),
                    Collectors.reducing(0, e -> 1, (i1, i2) -> i1 + i2)));

    SimpleGeneralAllocCalculator smdm = new SimpleGeneralAllocCalculator();
    smdm.init(conf, currAllocation, nimbus.getUserTopology(topoId));


    for (int i = 0; i < 10000; i++) {
        Utils.sleep(30000);

        topoInfo = nimbus.getTopologyInfo(topoId);
        Map<String, Integer> updatedAllocation = topoInfo.get_executors().stream().filter(e -> !Utils.isSystemId(e.get_component_id()))
                .collect(Collectors.groupingBy(e -> e.get_component_id(),
                        Collectors.reducing(0, e -> 1, (i1, i2) -> i1 + i2)));

        Map<String, List<ExecutorDetails>> comp2Executors = TopologyHelper.getTopologyExecutors(topoName, conf)
                .entrySet().stream().filter(e -> !Utils.isSystemId(e.getKey()))
                .collect(Collectors.toMap(Map.Entry::getKey, Map.Entry::getValue));

        AggResultCalculator resultCalculator = new AggResultCalculator(
                RedisDataSource.readData(host, port, queue, maxLen), comp2Executors, nimbus.getUserTopology(topoId));
        resultCalculator.calCMVStat();

        System.out.println("-------------Report on: " + System.currentTimeMillis() + "------------------------------");
        if (currAllocation.equals(updatedAllocation)) {
            System.out.println(currAllocation + "-->" + smdm.calc(resultCalculator.getResults(), allewedExecutorNum));
        } else {
            currAllocation = updatedAllocation;
            smdm.allocationChanged(currAllocation);
            RedisDataSource.clearQueue(host, port, queue);
            System.out.println("Allocation updated to " + currAllocation);
        }
    }
}
 
开发者ID:ADSC-Resa,项目名称:resa,代码行数:67,代码来源:SimpleGeneralAllocCalculatorTest.java


示例19: runAllocCalculatorAlg

import backtype.storm.generated.Nimbus; //导入依赖的package包/类
@Test
public void runAllocCalculatorAlg() throws Exception {

    conf.put(Config.NIMBUS_HOST, "192.168.0.30");
    conf.put(Config.NIMBUS_THRIFT_PORT, 6627);

    conf.put("resa.opt.smd.qos.ms", 1500.0);
    conf.put("resa.opt.win.history.size", 1);
    conf.put("resa.opt.win.history.size.ignore", 0);
    conf.put("resa.comp.sample.rate", 1.0);

    int allewedExecutorNum = 24;
    conf.put(ResaConfig.ALLOWED_EXECUTOR_NUM, allewedExecutorNum);

    String host = "192.168.0.30";
    int port = 6379;
    String queue = "fpm-7-1417774110-metrics";
    int maxLen = 5000;

    NimbusClient nimbusClient = NimbusClient.getConfiguredClient(conf);
    Nimbus.Client nimbus = nimbusClient.getClient();
    //String topoName = "ta1wc2P2Redis";
    ///String topoName = "ta1wcLoopRedis";
    ///String topoName = "arwcRedis";
    ///String topoName = "outdetResa";
    ///String topoName = "rwc";
    String topoName = "fpm";
    String topoId = TopologyHelper.getTopologyId(nimbus, topoName);

    TopologyInfo topoInfo = nimbus.getTopologyInfo(topoId);

    Map<String, Integer> currAllocation = topoInfo.get_executors().stream().filter(e -> !Utils.isSystemId(e.get_component_id()))
            .collect(Collectors.groupingBy(e -> e.get_component_id(),
                    Collectors.reducing(0, e -> 1, (i1, i2) -> i1 + i2)));

    SimpleGeneralAllocCalculator smdm = new SimpleGeneralAllocCalculator();
    smdm.init(conf, currAllocation, nimbus.getUserTopology(topoId));

    Map<String, List<ExecutorDetails>> comp2Executors = TopologyHelper.getTopologyExecutors(topoName, conf)
            .entrySet().stream().filter(e -> !Utils.isSystemId(e.getKey()))
            .collect(Collectors.toMap(Map.Entry::getKey, Map.Entry::getValue));

    AggResultCalculator resultCalculator = new AggResultCalculator(
            RedisDataSource.iterData(host, port, queue, maxLen), comp2Executors, nimbus.getUserTopology(topoId));
    resultCalculator.calCMVStat();

    System.out.println("-------------Report on: " + System.currentTimeMillis() + "------------------------------");
    System.out.println(currAllocation + "-->" + smdm.calc(resultCalculator.getResults(), allewedExecutorNum).currOptAllocation);
}
 
开发者ID:ADSC-Resa,项目名称:resa,代码行数:50,代码来源:SimpleGeneralAllocCalculatorTest.java


示例20: NimbusClient

import backtype.storm.generated.Nimbus; //导入依赖的package包/类
public NimbusClient(Map conf, String host, int port, Integer timeout) throws TTransportException {
    super(conf, host, port, timeout);
    _client = new Nimbus.Client(_protocol);
}
 
开发者ID:metamx,项目名称:incubator-storm,代码行数:5,代码来源:NimbusClient.java



注:本文中的backtype.storm.generated.Nimbus类示例整理自Github/MSDocs等源码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。


鲜花

握手

雷人

路过

鸡蛋
该文章已有0人参与评论

请发表评论

全部评论

专题导读
上一篇:
Java ClientYamlTestCandidate类代码示例发布时间:2022-05-22
下一篇:
Java SegmentedFile类代码示例发布时间:2022-05-22
热门推荐
阅读排行榜

扫描微信二维码

查看手机版网站

随时了解更新最新资讯

139-2527-9053

在线客服(服务时间 9:00~18:00)

在线QQ客服
地址:深圳市南山区西丽大学城创智工业园
电邮:jeky_zhao#qq.com
移动电话:139-2527-9053

Powered by 互联科技 X3.4© 2001-2213 极客世界.|Sitemap