Educational notes,Hands on problems w/ solutions for hadoop ecosystem

This repository focuses on gathering and making a curated list resources to learn Hadoop for FREE.

IBIS is a workflow creation-engine that abstracts the Hadoop internals of ingesting RDBMS data.

A data pipeline moving data from a Relational database system (RDBMS) to a Hadoop file system (HDFS).

This project aims to move the data from a Relational database system (RDBMS) to a Hadoop file system (HDFS)

Pizza Orders Data Pipeline Usecase Solved by SQL, Sqoop, HDFS, Hive, Airflow.

Analysed New York City's Yellow taxi data set with Big Data tools such as Hadoop, HBase, Sqoop, MapReduce and AWS Cloud Infrastructure.

Apache Hadoop

Learn Big Data tools/ framework by doing examples, POC, per projects.

Solving the Restaurant User Review Data Pipeline Scenarios using Shellscript, Python, Sqoop, HDFS

Combination between Apache Spark and Sqoop to extract data from Hive table into relational database, integrated with pipeline using luigi.

Performed business operations using Big data technologies: AWS EMR, AWS RDS (MySQL), Hadoop, Apache Scoop, Apache HBase, MapReduce

Large-Scale Data Pipeline Migration from Mainframe to Hadoop | Hadoop | Spark | Hive | Sqoop | Oozie | MySQL Migrated a legacy mainframe data warehouse to a modern Hadoop-based big data ecosystem, enabling scalable storage, faster analytics, and automated workflows.

Hadoop PPT and components

Basic Hadoop Course Code

Analyzed traffic flow around the university through bus arrival time at the bus stop in Myongji University. Use web crawling (Python), Hadoop, HDFS, Sqoop, Hive, Zeppelin, and Amazon RDS (Mysql).

A python package that lets you sqoop into HDFS/Hive/HBase data from RDBMS using sqoop

Backup de mi preparación para el examen CCA175 de Cloudera

Hadoop Examples

A data pipeline on GCP Dataproc using Sqoop, HDFS, Hive, and PySpark to implement SCD Type 2 for an e-commerce use case. Tracks customer and product changes (e.g., address, price) and their impact on sales, demonstrating scalable data warehousing and processing.