What Is Apache Hadoop?

What Is Apache Hadoop?

The Apache™ Hadoop® project develops open-source software for reliable, scalable, distributed computing.

可靠的，可扩展的开源软件，分布式计算。

The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage. Rather than rely on hardware to deliver high-availability, the library itself is designed to detect and handle failures at the application layer, so delivering a highly-available service on top of a cluster of computers, each of which may be prone to failures.

Apache Hadoop 软件库是一个框架，允许大型数据集通过使用简单的编程模型的计算机集群的分布式处理。它的设计规模从单一服务器到数千台计算机，每个提供本地计算和存储。而不是依靠硬件提供的高可用性，库是用来检测和应用层处理失败，因此在计算机集群的顶部交付一个高可用性服务，每一个可能会失败。

The project includes these modules:

该项目包括这些模块：

• Hadoop Common: The common utilities that support the other Hadoop modules.
• Hadoop Distributed File System (HDFS™): A distributed file system that provides high-throughput access to application data.
• Hadoop YARN: A framework for job scheduling and cluster resource management.
• Hadoop MapReduce: A YARN-based system for parallel processing of large data sets.

• Hadoop Common: 一组分布式文件系统和通用I/O的组件与接口。hadoop 的核心。包括文件系统、远程调用 RPC 的序列化函数。
• Hadoop分布式文件系统：分布式文件系统提供了高吞吐量的访问应用程序数据。高吞吐量分布式文件系统。 GFS 的开源实现。
  
• Hadoop YARN:作业调度和集群资源管理框架。下一代 MapReduce 框架。
  
• Hadoop MapReduce:基于YARN的大型数据集的并行处理系统。大型分布式合并/计算数据处理模型。Google MapReduce 的开源实现。

Other Hadoop-related projects at Apache include:

包括在Apache中的Hadoop相关其他项目：

• Ambari™: A web-based tool for provisioning, managing, and monitoring Apache Hadoop clusters which includes support for Hadoop HDFS, Hadoop MapReduce, Hive, HCatalog, HBase, ZooKeeper, Oozie, Pig and Sqoop. Ambari also provides a dashboard for viewing cluster health such as heatmaps and ability to view MapReduce, Pig and Hive applications visually alongwith features to diagnose their performance characteristics in a user-friendly manner.
• Avro™: A data serialization system.
• Cassandra™: A scalable multi-master database with no single points of failure.
• Chukwa™: A data collection system for managing large distributed systems.
• HBase™: A scalable, distributed database that supports structured data storage for large tables.
• Hive™: A data warehouse infrastructure that provides data summarization and ad hoc querying.
• Mahout™: A Scalable machine learning and data mining library.
• Pig™: A high-level data-flow language and execution framework for parallel computation.
• ZooKeeper™: A high-performance coordination service for distributed applications.

• Ambari™: 一个基于Web的工具配置，管理，监控Apache Hadoop集群，包括Hadoop HDFS，Hadoop Hive，Hadoop MapReduce,HCatalog，HBase，ZooKeeper, Oozie,Pig和Sqoop。Ambari还提供了一个仪表板查看集群健康如heatmaps和查看MapReduce的能力，Pig和Hive的视觉和应用功能在用一个用户友好的方式诊断其性能。
  
• Avro™:数据序列化系统。
  
• Cassandra™: 一个没有单点故障的可扩展的多主数据库。由 Facebook 开发分布式数据仓库。apache 已经将 Cassandra 应用到各种云计算系统中。
  
• Chukwa™: 一个用于管理大型分布式系统的数据采集系统。日志收集与分析系统。
  
• HBase™: 一个可扩展的，支持大型表的结构化数据存储的分布式数据库。BigTable 的开源实现。
  
• Hive™: 数据仓库的基础设施，提供数据汇总和专案查询。
  
• Mahout™: 一个可扩展的机器学习和数据挖掘库。 机器学习框架。
  
• Pig™: 一个高级别的数据流语言和执行框架的并行计算。大数据分析评估平台。
  
• ZooKeeper™:高性能分布式协同服务的应用。