Syllabus

1.5 to 2 months (50 hours)

SQOOP
- Introduction
- Import Data
- Export data
FLUME
- Introduction
- Flume Commands
Map Reduce
- Functional Programming Basics
- Map and Reduce Basics
- Anatomy of a Map Reduce Job Run
- Architecture
- Job Completion, Failures
- Shuffling and Sorting
- Splits, Record reader, Partition, Types of partitions & Combiner
- Speculative Execution
- Types of Schedulers and Counters
- YARN
- Sequential Files and Map Files
- Hands on “Word Count” in Map/Reduce in standalone and Pseudo distribution Mode

Hive
- Installation
- Introduction and Architecture
- Hive Services, Hive Shell, Hive Server and Hive Web Interface (HWI)
- Meta store
- Hive QL
- Derby Database
- Working with Tables
- Primitive data types and complex data types
- Working with Partitions
- Hive Bucketed Tables and Sampling
- External partitioned tables
- Differences between ORDER BY, DISTRIBUTE BY and SORT BY
- Log Analysis on Hive
- Hands on Exercises
NoSql Database
- Introduction
- Types
- Brief Of Nosql Database

HBase
- HBase Installation
- HBase concepts
- HBase Data Model and Comparison between RDBMS and NOSQL
- Master & Region Servers
- HBase Operations (DDL and DML) through Shell and Programming and HBase Architecture
- Catalog Tables
- Block Cache and sharing
- SPLITS
- DATA Modeling
- HBASE Filters
- Bulk Loading and Coprocessors
- Real world use case consisting of HDFS, MR and HBASE
SPARK
- Spark and its purpose
- Components of Spark
- Using Spark with Hadoop
- Resilient Distributed Dataset (RDD)
- Working with Key-Value Pairs
- Downloading and installing Spark Standalone
- Scala Overview
SCALA
- Fundamental Of Scala
- Basic Syntax and Operators
- Programming with Spark
SOLR
- Fundamental Of Solr
- Installation of Solr Standalone
- Basic Solr Concept
- Demo