Chat with us on WhatsAppCall Learnizo

KTU 2024 Scheme · Semester 5 · Program Core (PBL) — Computer Science and Engineering (Data Science)

Big Data Processing (PBCDT504) Syllabus

Official KTU 2024 Scheme syllabus for Big Data Processing, Semester 5, Program Core (PBL) — Computer Science and Engineering (Data Science) (Computer Science and Engineering (Data Science)).

This page compiles APJ Abdul Kalam Technological University's officially published 2024 Scheme syllabus for Computer Science and Engineering (Data Science), Semester 5, sourced directly from KTU's official website (ktu.edu.in). Learnizo is an independent online tuition platform and is not affiliated with, endorsed by, or officially connected to APJKTU. The university may revise syllabus content after this page was last updated — always cross-check with the official KTU source for the current, authoritative version.

Course Code

PBCDT504

Credits

4

Teaching Hours

3:0:0:1 (L:T:P:R) — Project Based Learning (PBL)

CIE Marks

60

ESE Marks

40

Exam Duration

2 Hrs 30 Min

Prerequisites

None

Semester

Semester 5

Course Objective

To provide an overview of the storage, retrieval and processing of big data, and to introduce the tools and techniques used to handle big data with technologies such as MapReduce, Hadoop, HBase, Pig, Hive and Spark.

Module-wise Syllabus

Module 1

11 contact hours

Introduction to Big Data and the Hadoop Distributed File System: evolution of big data, big data characteristics, RDBMS and big data. History of Hadoop, Hadoop ecosystem and core components. HDFS architecture — blocks, name nodes and data nodes; using HDFS files — basic file system operations, Hadoop specific file types; anatomy of a file read and write.

Module 2

11 contact hours

MapReduce Programming: data processing with MapReduce — execution pipeline, runtime coordination and task management in MapReduce. Designing MapReduce implementations — using MapReduce as a framework for parallel processing; face recognition example — simple data processing with MapReduce; inverted indexes example; road enrichment example. Projects using R, Python, Java.

Module 3

11 contact hours

HBase and Stream Data Model: HBase architecture, HBase schema design. Introduction to stream concepts, stream data model and architecture, sampling data in a stream, filtering streams, counting distinct elements in a stream.

Module 4

11 contact hours

Hive, Pig, Spark: Hive — features, data types and file formats, primitive and collection data types, HiveQL — creating tables, dropping tables, altering tables. Pig — data model, Pig Latin structure, functions. Spark — storage layers for Spark, core Spark concepts, RDD basics, RDD operations. Projects using R, Python, Java. Suggested project topics include log file analysis, sentiment analysis on social media data, recommendation systems and word count with MapReduce.

Course Outcomes

  • CO1Explain the principles of big data and distributed systems, including the characteristics of large datasets and the fundamentals of building and maintaining reliable, scalable, distributed systems.
  • CO2Infer the mechanisms of distributed storage and processing, with a specific focus on the role of HDFS in effective data storage.
  • CO3Model the distributed processing of large data sets across clusters using simple programming models.
  • CO4Identify and understand the fundamentals of stream computing and the usage of HBase.
  • CO5Apply the fundamental features and components of Hive, Pig and Spark for data processing.

Assessment Pattern (CIE: 60 marks, ESE: 40 marks)

Continuous Internal Evaluation (CIE)

Attendance5
Project30
Internal Examination 1 (Written)12.5
Internal Examination 2 (Written)12.5

End Semester Examination (ESE)

Total 40 marks, 2 Hrs 30 Min. See the official KTU syllabus document for the exact Part A / Part B question pattern for this course.

Textbooks & Reference Books

Textbooks

  • Professional Hadoop Solutions — Boris Lublinsky, Kevin T. Smith, Alexey Yakubovich (Wrox, 1/e, 2013)
  • The Art of R Programming: A Tour of Statistical Software Design — Norman Matloff (No Starch Press, 1/e, 2011)
  • Learning Spark, Lightning-Fast Data Analytics — Holden Karau, Andy Konwinski, Patrick Wendell, Matei Zaharia (O'Reilly, 2/e, 2020)
  • Programming Hive — Jason Rutherglen, Dean Wampler, Edward Capriolo (O'Reilly, 1/e, 2012)
  • Mining of Massive Datasets — Jure Leskovec, Anand Rajaraman, Jeffrey David Ullman (Cambridge University Press, 3/e, 2020)
  • BIG DATA, Black Book — — (DreamTech Press, 1/e, 2016)
  • R for Everyone: Advanced Analytics and Graphics — Jared P. Lander (Pearson Education, 2/e, 2018)

Reference Books

  • Big Data and Analytics — Seema Acharya, Subhasni Chellappan (Wiley, 2/e, 2019)

Frequently Asked Questions

How many credits is KTU Big Data Processing (PBCDT504)?

4 credits, with 3:0:0:1 (L:T:P:R) — Project Based Learning (PBL) teaching hours per week, under the KTU 2024 Scheme.

How many modules are in the PBCDT504 syllabus?

4 modules, 44 total contact hours.

What is the CIE and ESE mark split for this course?

CIE (Continuous Internal Evaluation): 60 marks. ESE (End Semester Examination): 40 marks, 2 Hrs 30 Min. Total: 100 marks.

What are the recommended textbooks for PBCDT504?

Professional Hadoop Solutions (Boris Lublinsky, Kevin T. Smith, Alexey Yakubovich); The Art of R Programming: A Tour of Statistical Software Design (Norman Matloff); Learning Spark, Lightning-Fast Data Analytics (Holden Karau, Andy Konwinski, Patrick Wendell, Matei Zaharia); Programming Hive (Jason Rutherglen, Dean Wampler, Edward Capriolo); Mining of Massive Datasets (Jure Leskovec, Anand Rajaraman, Jeffrey David Ullman); BIG DATA, Black Book (—); R for Everyone: Advanced Analytics and Graphics (Jared P. Lander).

Is this syllabus specific to one branch, or common to others too?

This Semester 5 course is listed under Program Core (PBL) — Computer Science and Engineering (Data Science) at KTU under the 2024 Scheme — check the course header above for which branches it's common to.

Need help with KTU Big Data Processing?

Learnizo offers live, 1-on-1 online tuition for KTU CS (Data Science) subjects — matched to your exact module and semester.