在线时间:8:00-16:00
迪恩网络APP
随时随地掌握行业动态
扫描二维码
关注迪恩网络微信公众号
开源软件名称:hammer/homebrew-cdh开源软件地址:https://github.com/hammer/homebrew-cdh开源编程语言:Ruby 100.0%开源软件介绍:homebrew-cdhFormulae
Usagebrew tap hammer/cdh I think you'll also need Command Line Tools for Xcode. CDH 4: HDFS 2 with MapReduce 1Install CDH Hadoop(Don't worry about the error linking cdh-mr1) brew install cdh-hadoop
brew install cdh-mr1 No need to edit configuration filesThe
The
Enable SSH to localhostsystemsetup -f -setremotelogin on
ssh-keygen -t rsa -N "" -f ~/.ssh/id_rsa
cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
chmod 0600 ~/.ssh/authorized_keys
for host_id in localhost 0.0.0.0; do
ssh-keyscan $host_id >> ~/.ssh/known_hosts
done Format and start HDFS, ensure all processes are running`brew --cellar`/cdh-hadoop/4.2.1/bin/hdfs namenode -format
`brew --cellar`/cdh-hadoop/4.2.1/libexec/sbin/start-dfs.sh
jps Set HADOOP_HOME, Start MapReduce, ensure all processes are running
Add some data to HDFS
Run a MapReduce job
Read results of MapReduce job
When you're done: Stop MapReduce and HDFS, remove temporary data`brew --cellar`/cdh-mr1/4.2.1/bin/stop-mapred.sh
`brew --cellar`/cdh-hadoop/4.2.1/libexec/sbin/stop-dfs.sh
rm -rf ~/hadoop-store
unset HADOOP_HOME |
2023-10-27
2022-08-15
2022-08-17
2022-09-23
2022-08-13
请发表评论