hadoop 配置history server 和timeline server
来源:互联网 发布:ubuntu tftp-hpa配置 编辑:程序博客网 时间:2024/06/09 04:33
一,配置history server
1.配置history server,在etc/hadoop/mapred-site.xml中配置以下内容.
<span style="font-size:18px;"><span style="font-size:18px;"> <property> <name>mapreduce.jobhistory.address</name> <value>localhost:10020</value> </property> <property> <name>mapreduce.jobhistory.webapp.address</name> <value>localhost:19888</value> </property></span></span>
2.把配置分发到所有服务器
3.启动服务,以localhost这台服务器上执行以下语句:
mr-jobhistory-daemon.sh start historyserver
二 ,配置timeline server
1.配置history server,在etc/hadoop/yarn-site.xml中配置以下内容.
<span style="font-size:18px;"><!--start timeline settings --> <property> <description></description> <name>yarn.timeline-service.hostname</name> <value>localhost</value> </property> <property> <description>Address for the Timeline server to start the RPC server.</description> <name>yarn.timeline-service.address</name> <value>${yarn.timeline-service.hostname}:10200</value></property><property> <description>The http address of the Timeline service web application.</description> <name>yarn.timeline-service.webapp.address</name> <value>${yarn.timeline-service.hostname}:8188</value></property><property> <description>The https address of the Timeline service web application.</description> <name>yarn.timeline-service.webapp.https.address</name> <value>${yarn.timeline-service.hostname}:8190</value></property><property> <description>Handler thread count to serve the client RPC requests.</description> <name>yarn.timeline-service.handler-thread-count</name> <value>10</value></property><property> <description>Enables cross-origin support (CORS) for web services where cross-origin web response headers are needed. For example, javascript making a web services request to the timeline server.</description> <name>yarn.timeline-service.http-cross-origin.enabled</name> <value>false</value></property><property> <description>Comma separated list of origins that are allowed for web services needing cross-origin (CORS) support. Wildcards (*) and patterns allowed</description> <name>yarn.timeline-service.http-cross-origin.allowed-origins</name> <value>*</value></property><property> <description>Comma separated list of methods that are allowed for web services needing cross-origin (CORS) support.</description> <name>yarn.timeline-service.http-cross-origin.allowed-methods</name> <value>GET,POST,HEAD</value></property><property> <description>Comma separated list of headers that are allowed for web services needing cross-origin (CORS) support.</description> <name>yarn.timeline-service.http-cross-origin.allowed-headers</name> <value>X-Requested-With,Content-Type,Accept,Origin</value></property><property> <description>The number of seconds a pre-flighted request can be cached for web services needing cross-origin (CORS) support.</description> <name>yarn.timeline-service.http-cross-origin.max-age</name> <value>1800</value></property><property> <description>Indicate to ResourceManager as well as clients whether history-service is enabled or not. If enabled, ResourceManager starts recording historical data that Timelien service can consume. Similarly, clients can redirect to the history service when applications finish if this is enabled.</description> <name>yarn.timeline-service.generic-application-history.enabled</name> <value>true</value></property><property> <description>Store class name for history store, defaulting to file system store</description> <name>yarn.timeline-service.generic-application-history.store-class</name> <value>org.apache.hadoop.yarn.server.applicationhistoryservice.FileSystemApplicationHistoryStore</value></property><property> <description>Indicate to clients whether Timeline service is enabled or not. If enabled, the TimelineClient library used by end-users will post entities and events to the Timeline server.</description> <name>yarn.timeline-service.enabled</name> <value>true</value></property><property> <description>Store class name for timeline store.</description> <name>yarn.timeline-service.store-class</name> <value>org.apache.hadoop.yarn.server.timeline.LeveldbTimelineStore</value></property><property> <description>Enable age off of timeline store data.</description> <name>yarn.timeline-service.ttl-enable</name> <value>true</value></property><property> <description>Time to live for timeline store data in milliseconds.</description> <name>yarn.timeline-service.ttl-ms</name> <value>6048000000</value></property> <!--end timeline settings --></span>
2.把配置分发到所有服务器
3.启动服务,以localhost这台服务器上执行以下语句:
yarn-daemon.sh start timelineserver
0 0
- hadoop 配置history server 和timeline server
- 配置Spark history server
- spark history server 配置
- Spark History Server配置
- Spark1.0.0 history server 配置
- Spark1.0.0 history server 配置
- Spark1.0.0 history server 配置
- 配置&使用Spark History Server
- Spark History Server配置使用
- Spark History Server配置使用
- Spark history Server 配置过程
- Spark History Server配置使用
- Spark-History Server配置使用
- app timeline server
- YARN Timeline Server介绍
- (14)YARN Timeline Server
- YARN, MR History Server和Spark History Server
- Spark History Server配置使用(zhuan)
- 如何做一个安全的“记住我”功能
- 如何设置QWidget的背景颜色
- 黑马程序员——java基础-多线程
- PyBrain使用简介
- 关于@SuppressWarnings
- hadoop 配置history server 和timeline server
- 4438无线网络组网代码解析
- VS2010进行远程调试方法
- firefox和chrome 中tr下的td colspan属性在tr 隐藏时无效
- SAS数据步常用语句
- 轮播图功能的全实现(自动播放、小点点、按住停止播放、放手后开始播放...)
- f2c demo
- 数字安全证书(CA证书)介绍
- 整型和字符串、字符串和字符数组互转