KTU 2024 Scheme · Semester 5 · Program Core (PBL) — Computer Science and Engineering (Data Science)
Big Data Processing (PBCDT504) Syllabus
Official KTU 2024 Scheme syllabus for Big Data Processing, Semester 5, Program Core (PBL) — Computer Science and Engineering (Data Science) (Computer Science and Engineering (Data Science)).
Course Code
PBCDT504
Credits
4
Teaching Hours
3:0:0:1 (L:T:P:R) — Project Based Learning (PBL)
CIE Marks
60
ESE Marks
40
Exam Duration
2 Hrs 30 Min
Prerequisites
None
Semester
Semester 5
Course Objective
To provide an overview of the storage, retrieval and processing of big data, and to introduce the tools and techniques used to handle big data with technologies such as MapReduce, Hadoop, HBase, Pig, Hive and Spark.
Module-wise Syllabus
Module 1
11 contact hoursIntroduction to Big Data and the Hadoop Distributed File System: evolution of big data, big data characteristics, RDBMS and big data. History of Hadoop, Hadoop ecosystem and core components. HDFS architecture — blocks, name nodes and data nodes; using HDFS files — basic file system operations, Hadoop specific file types; anatomy of a file read and write.
Module 2
11 contact hoursMapReduce Programming: data processing with MapReduce — execution pipeline, runtime coordination and task management in MapReduce. Designing MapReduce implementations — using MapReduce as a framework for parallel processing; face recognition example — simple data processing with MapReduce; inverted indexes example; road enrichment example. Projects using R, Python, Java.
Module 3
11 contact hoursHBase and Stream Data Model: HBase architecture, HBase schema design. Introduction to stream concepts, stream data model and architecture, sampling data in a stream, filtering streams, counting distinct elements in a stream.
Module 4
11 contact hoursHive, Pig, Spark: Hive — features, data types and file formats, primitive and collection data types, HiveQL — creating tables, dropping tables, altering tables. Pig — data model, Pig Latin structure, functions. Spark — storage layers for Spark, core Spark concepts, RDD basics, RDD operations. Projects using R, Python, Java. Suggested project topics include log file analysis, sentiment analysis on social media data, recommendation systems and word count with MapReduce.
Course Outcomes
- CO1Explain the principles of big data and distributed systems, including the characteristics of large datasets and the fundamentals of building and maintaining reliable, scalable, distributed systems.
- CO2Infer the mechanisms of distributed storage and processing, with a specific focus on the role of HDFS in effective data storage.
- CO3Model the distributed processing of large data sets across clusters using simple programming models.
- CO4Identify and understand the fundamentals of stream computing and the usage of HBase.
- CO5Apply the fundamental features and components of Hive, Pig and Spark for data processing.
Assessment Pattern (CIE: 60 marks, ESE: 40 marks)
Continuous Internal Evaluation (CIE)
| Attendance | 5 |
| Project | 30 |
| Internal Examination 1 (Written) | 12.5 |
| Internal Examination 2 (Written) | 12.5 |
End Semester Examination (ESE)
Total 40 marks, 2 Hrs 30 Min. See the official KTU syllabus document for the exact Part A / Part B question pattern for this course.
Textbooks & Reference Books
Textbooks
- Professional Hadoop Solutions — Boris Lublinsky, Kevin T. Smith, Alexey Yakubovich (Wrox, 1/e, 2013)
- The Art of R Programming: A Tour of Statistical Software Design — Norman Matloff (No Starch Press, 1/e, 2011)
- Learning Spark, Lightning-Fast Data Analytics — Holden Karau, Andy Konwinski, Patrick Wendell, Matei Zaharia (O'Reilly, 2/e, 2020)
- Programming Hive — Jason Rutherglen, Dean Wampler, Edward Capriolo (O'Reilly, 1/e, 2012)
- Mining of Massive Datasets — Jure Leskovec, Anand Rajaraman, Jeffrey David Ullman (Cambridge University Press, 3/e, 2020)
- BIG DATA, Black Book — — (DreamTech Press, 1/e, 2016)
- R for Everyone: Advanced Analytics and Graphics — Jared P. Lander (Pearson Education, 2/e, 2018)
Reference Books
- Big Data and Analytics — Seema Acharya, Subhasni Chellappan (Wiley, 2/e, 2019)
Frequently Asked Questions
How many credits is KTU Big Data Processing (PBCDT504)?
4 credits, with 3:0:0:1 (L:T:P:R) — Project Based Learning (PBL) teaching hours per week, under the KTU 2024 Scheme.
How many modules are in the PBCDT504 syllabus?
4 modules, 44 total contact hours.
What is the CIE and ESE mark split for this course?
CIE (Continuous Internal Evaluation): 60 marks. ESE (End Semester Examination): 40 marks, 2 Hrs 30 Min. Total: 100 marks.
What are the recommended textbooks for PBCDT504?
Professional Hadoop Solutions (Boris Lublinsky, Kevin T. Smith, Alexey Yakubovich); The Art of R Programming: A Tour of Statistical Software Design (Norman Matloff); Learning Spark, Lightning-Fast Data Analytics (Holden Karau, Andy Konwinski, Patrick Wendell, Matei Zaharia); Programming Hive (Jason Rutherglen, Dean Wampler, Edward Capriolo); Mining of Massive Datasets (Jure Leskovec, Anand Rajaraman, Jeffrey David Ullman); BIG DATA, Black Book (—); R for Everyone: Advanced Analytics and Graphics (Jared P. Lander).
Is this syllabus specific to one branch, or common to others too?
This Semester 5 course is listed under Program Core (PBL) — Computer Science and Engineering (Data Science) at KTU under the 2024 Scheme — check the course header above for which branches it's common to.
Need help with KTU Big Data Processing?
Learnizo offers live, 1-on-1 online tuition for KTU CS (Data Science) subjects — matched to your exact module and semester.