برنامه نویسی با فریمورک هدوپ hadoop

Lesson 1, “Background Concepts,” covers important Hadoop and Big Data fundamentals. You learn Hadoop history and design principles along with the introduction to the MapReduce paradigm and the components of the Hadoop ecosystem will be introduced. Lesson 2, “Running Hadoop on a Desktop or Laptop,” shows you how to create a real Hadoop working installation in a virtual Linux sandbox. All software is freely available, can be easily installed to a desktop or laptop computer, and can be used for many of the examples in this tutorial. Lesson 3, “The Hadoop Distributed File System” introduces you to the distributed storage system of Hadoop. In this lesson, you learn HDFS design basics, how to perform basic file operations, and how to use HDFS in programs. Lesson 4, “Hadoop MapReduce,” presents Hadoop MapReduce in more detail using simple command line examples. You also learn how to run a Java MapReduce application on a Hadoop cluster and then learn each step of the full Hadoop MapReduce process. Lesson 5, “Hadoop Examples,” teaches you how to write MapReduce programs in almost any language using the Streaming and Pipes interface. You also learn how to run a “grep” like Hadoop application and use some basic debugging techniques. Lesson 6, “Higher Level Tools,” shows you how to use Pig and Hive, two high level Hadoop applications. Each lesson teaches you the various execution modes and commands needed to use the tools. Lesson 7, “Setting Up Hadoop in the Cloud,” demonstrates the simple steps needed to start a Hadoop Cluster in the cloud using a tool called Whirr. Lesson 8, “Setting Up Hadoop on a Local Cluster,” teaches you how to install Hadoop on a basic four node cluster. You will learn the steps needed to configure, install, start, test, and monitor a fully functional Hadoop cluster.