ABOUT HADOOP

Hadoop: It is completely open source system that provides us the framework to deal with big data. Hadoop designed to be robust, in that your big data application will continue to run even when individual server or cluster fails. It also designed to be efficient, because it doesn’t require your application to shuttle huge volume of data across your network. Hadoop system is flexible in nature, companies can easily add or modify their data system according to their need and requirement using the cheap and readily available part from ant IT service provider.

Hadoop Course Content

Hadoop Course Concepts

Understanding Big Data and Hadoop

1.Big Data, Limitations and Solutions of existing Data Analytics Architecture,

2.Hadoop,

3.Hadoop Features,

4.Hadoop Ecosystem,

5.Hadoop 2.x core components,

6.Hadoop Storage: HDFS,

7.Hadoop Processing

8.MapReduce Framework

9.Hadoop Different Distributions.

Hadoop requirements

  1. Linux commands
30 Essential Linux Basic Commands You Must Know
  1. vmware
  • Basics
  • Installations
  • Backups
 
  1. sql basics
  • Introduction to SQL
  • MySQL Essentials
  • Database Fundamentals
 
  1. Hands on exercise and Assignments

Hadoop Architecture and HDFS

  1. Hadoop 2.x Cluster Architecture
  2. Federation and High Availability,
  3. A Typical Production Hadoop Cluster,
  4. Hadoop Cluster Modes,
  5. Common Hadoop Shell Commands,
  6. Hadoop 2.x Configuration Files,
  7. Single node cluster and Multi node cluster set up Hadoop Administration.
Hands on exercise and Assignments

Hadoop MapReduce Framework

  1. MapReduce Use Cases,
  2. Traditional way Vs MapReduce way,
  3. Why MapReduce,
  4. Hadoop 2.x MapReduce Architecture,
  5. Hadoop 2.x MapReduce Components,
  6. YARN MR Application Execution Flow,
  7. YARN Workflow,
  8. Anatomy of MapReduce Program,
  9. Demo on MapReduce.
  10. Input Splits,
  11. Relation between Input Splits and HDFS Blocks,
  12. MapReduce Combiner & Partitioner,
Hands on exercise and Assignments

Pig

  1. About Pig,
  2. MapReduce Vs Pig,
  3. Pig Use Cases,
  4. Programming Structure in Pig,
  5. Pig Running Modes,
  6. Pig components,
  7. Pig Execution,
  8. Pig Latin Program,
  9. Data Models in Pig,
  10. Pig Data Types,
  11. Shell and Utility Commands,
  12. Pig Latin Relational Operators,
  13. File Loaders,
  14. Group Operator,
  15. COGROUP Operator,
  16. Joins and COGROUP,
  17. Union,
  18. Diagnostic Operators,
  19. Specialized joins in Pig,
  20. Hands on exercise and Assignments

Hive

  1. Hive Background,
  2. Hive Use Case,
  3. About Hive,
  4. Hive Vs Pig,
  5. Hive Architecture and Components,
  6. Metastore in Hive,
  7. Limitations of Hive,
  8. Comparison with Traditional Database,
  9. Hive Data Types and Data Models,
  10. Partitions and Buckets,
  11. Hive Tables(Managed Tables and External Tables),
  12. Importing Data,
  13. Querying Data,
  14. Managing Outputs,
  15. Hive Script,
  16. Hive UDF,
  17. Retail use case in Hive,
Hands on exercise and Assignments

Advanced Hive and HBase

  1. Hive QL: Joining Tables,
  2. Dynamic Partitioning,
  3. Custom Map/Reduce Scripts,
  4. Hive Indexes and views
  5. Hive query optimizers,
  6. User Defined Functions,
  7. HBase:
  8. Introduction to NoSQL
  9. Databases and HBase,
  10. HBase v/s RDBMS,
  11. HBase Components,
  12. HBase Architecture,
  13. Run Modes & Configuration,
  14. HBase Cluster Deployment.
Hands on exercise and Assignments

Advanced HBase

  1. HBase Data Model,
  2. HBase Shell,
  3. HBase Client API,
  4. Data Loading Techniques,
  5. ZooKeeper
  6. Demos on Bulk Loading,
  7. Getting and Inserting Data,
  8. Filters in HBase.
  9. Hands on exercise and Assignments
Sqoop
  1. Import Data.
  2. Export Data.
  3. Sqoop Syntax.
  4. Databases connection.
Hands on exercise and Assignments Impala
  1. .Introduction to Impala
  2. .Impala Configuration
  3. .Comparison between Hive and Impala
  4. .Impala Commands
Hands on exercise and Assignments

Processing Distributed Data with Apache Spark

  1. What is Apache Spark,
  2. Spark Ecosystem,
  3. Spark Components,
  4. History of Spark
  5. Spark Versions/Releases,
  6. What is Scala?,
  7. Why Scala?,
  8. SparkContext,
  9. Spark Sql
Hands on exercise and Assignments. Flume & solr
  1. Configuration and Setup
  2. Flume Sink with example
  3. Channel
  4. Flume Source with example
  5. Complex flume architecture
Streaming data storing into solr
  1. customization of solr
Hands on exercise and Assignments Hue
  1. Introduction to Hue
  2. Advantages of Hue
  3. Hue Web Interface
  4. Ecosystems in Hue
Hands on exercise and Assignments

Oozie

  1. Oozie,
  2. Oozie Components,
  3. Oozie Workflow,
  4. Scheduling with Oozie,
  5. Demo on Oozie Workflow,
  6. Oozie Co-ordinator,
  7. Oozie Commands,
  8. Oozie Web Console,
  9. Oozie for MapReduce,
  10. PIG, Hive, and Sqoop,
  11. Combine flow of MR, PIG, Hive in Oozie
Hands on exercise and Assignments Tableau
  1. Tableau Fundamentals
  2. Tableau Analytics.
  3. Visual Analytics.
Hands on exercise and Assignments

Why SkillVidya

  • Live project oriented training
  • 24/7 Student support
  • Quality material and training
  • Certification and job support

FAQ'S

    • All our trainers are working professionals from the Industry and have at least 10-12 yrs of relevant experience in various departments.
    • Once if you have enrolled in the course then all our contact details will be provided to you and all the information regarding the course and schedules are provided.
    • To attend the live sessions 1mbps speed of internet is required.
    • You can go through the sample class recordings because without enrollment attending a live session is not possible.
    • These classes are completely Online Live Instructor-led classes. You will have chat option available to discuss your queries with the trainer during a class.
    • Yes, you will get the recorded videos of the sessions you missed and also you can attend the missed class in another live session.
    • yes, you will get the course certification once you are completely done with your course.
  • After enrolling with us we will provide you a software where you can work practically in that
  • Yes, the real-time experience will be given, By the end of the course, you will work on a live project.
  • We will train enough you to attend for an interview and placed in a company with your knowledge regarding the course and we will help you to build your resume please make sure that we are not into job placement.
WATCH FREE DEMO
  • NEW BATCHESevery week
  • Duration150 hrs / week
  • certificationyes
  • mode of trainingonline/classroom
  • LanguageEnglish

Inquire Now