文档下载 文档下载导航
设为首页 | 加入收藏
搜索 请输入内容:  
 导航当前位置: 文档下载 > 所有分类 > 工程科技 > 电子/电路 > COMP5349_2014 Semester1_week10_lab_week10
侵权投诉

COMP5349_2014 Semester1_week10_lab_week10

Task!2:!Elastic!MapReduce!(EMR)!Basics

Let’s now try and use Amazon to run a simple Hadoop work-flow.

Select ‘Elastic MapReduce’ from the ‘Analytics’ options on the welcome page.

Your are presented with a screen which allows you to create new clusters of EC2 nodes automatically. These clusters are ephemeral – that is they will exist only for the duration of the Hadoop programs execution.

In order to have Amazon EMR run your program you must first configure it to do so.

Select ‘Create Cluster’.

To the right of the label 'Cluster Configuration' there is a button labelled 'Configure sample application'

o Click on this button

o Select 'Word count' from the 'Select sample application' drop down menu. o As the output enter

s3n://comp5349/user/your-login/word_count o As the logging enter

s3n://comp5349/user/your-login/word_count_logging o Click 'OK'

COMP5349_2014 Semester1_week10_lab_week10

COMP5349_2014 Semester1_week10_lab_week10

Figure 2.

The next step is to select the data input location for the word count job.

o Scroll to the bottom of the page.

o Click on the pencil icon symbolizing the edit control for the program step. o You'll see an image as shown in Figure 3.

o You can choose to either edit the input location to another file (such as place.txt) or leave it as this

sample file.

o Once you've made your choice click 'Create cluster'

If everything went OK you will be redirected to the cluster status page. Here you can see a range of metrics about the status of the cluster. ‘Refresh’ the top right corner of the wizard’s window.

This should open you a task list with your new ‘EMR Test 1’ being shown as ‘STARTING’. Select this entry, and you will see further details in a new panel at the bottom of the window.

上一页第3页

你可能喜欢

热门文档

相关文档

站点地图 | 文档上传 | 侵权投诉 | 手机版
本站所有资源均来自互联网,本站只负责收集和整理,均不承担任何法律责任,如有侵权等其它行为请联系我们.
文档下载 Copyright 2013 doc.guandang.net All Rights Reserved.  -  email