KTU 2024 Scheme · Semester 5 · Program Core (PBL) — Artificial Intelligence and Data Science
Big Data Analytics (PBADT504) Syllabus
Official KTU 2024 Scheme syllabus for Big Data Analytics, Semester 5, Program Core (PBL) — Artificial Intelligence and Data Science (Artificial Intelligence and Data Science).
Course Code
PBADT504
Credits
4
Teaching Hours
3:0:0:1 (L:T:P:R) — Project Based Learning (PBL)
CIE Marks
60
ESE Marks
40
Exam Duration
2 Hrs 30 Min
Prerequisites
UCEST105, PBADT304
Semester
Semester 5
Course Objective
To understand the need for a framework to store and process big data, to gain knowledge of the big data technologies for processing different types of data, and to understand the advanced frameworks for faster access and processing of big data.
Module-wise Syllabus
Module 1
12 contact hoursHadoop Distributed File System: introduction to big data, conventional data vs big data, big data architecture, big data platforms. Hadoop ecosystem, core components, HDFS — architecture, using HDFS files, HDFS design, blocks, namenodes and data nodes, basic file system operations, Hadoop specific file types, anatomy of a file read and file write. Data processing with MapReduce: execution pipeline, developing a MapReduce application.
Module 2
12 contact hoursPig: introduction to Pig, execution modes of Pig, comparison of Pig with databases, Grunt, Pig Latin, user defined functions, data processing operators. Hive: Hive shell, Hive services, Hive metastore, comparison with traditional databases, HiveQL, tables, querying data and user defined functions. HBase: HBasics, concepts, clients, example, HBase versus RDBMS.
Module 3
12 contact hoursIntroduction to R — overview of modern data analytic tools, introduction to R, R graphical user interfaces, features of the R language, vectors, filtering, creating matrices, applying functions to matrix rows and columns, lists, creating lists, general list operations, data frames, creating data frames, matrix-like operations in frames, applying functions to data frames, reading and writing files.
Module 4
12 contact hoursOverview of Spark — Hadoop vs Spark, cluster design, cluster management, performance. Application Programming Interface (API): Spark Context, Resilient Distributed Datasets, creating RDDs, RDD operations and saving RDDs, lazy operation, Spark jobs. Writing Spark applications — Spark programming in Python, R and Java, application execution. Suggested project topics include search engine optimization, social media reputation monitoring, equity research, analysing crime rates, health status prediction, anomaly detection in cloud servers and tourist behaviour analysis.
Course Outcomes
- CO1Demonstrate the Hadoop framework, focusing on the Hadoop Distributed File System (HDFS) and MapReduce.
- CO2Simulate various big data technologies like Pig, Hive and HBase.
- CO3Resolve problems associated with big data with the features of R programming.
- CO4Demonstrate Spark programming with different programming languages.
- CO5Develop and implement innovative ideas on big data technologies.
Assessment Pattern (CIE: 60 marks, ESE: 40 marks)
Continuous Internal Evaluation (CIE)
| Attendance | 5 |
| Project | 30 |
| Internal Examination 1 (Written) | 12.5 |
| Internal Examination 2 (Written) | 12.5 |
End Semester Examination (ESE)
Total 40 marks, 2 Hrs 30 Min. See the official KTU syllabus document for the exact Part A / Part B question pattern for this course.
Textbooks & Reference Books
Textbooks
- Hadoop: The Definitive Guide — Tom White (O'Reilly Media, 4/e, 2015)
- Professional Hadoop Solutions — Boris Lublinsky, Kevin T. Smith, Alexey Yakubovich (Wrox Press, 1/e, 2014)
- The Art of R Programming: A Tour of Statistical Software Design — Norman Matloff (No Starch Press, 1/e, 2011)
- Spark in Action — Jean-Georges Perrin (O'Reilly Media, 1/e, 2020)
- Mastering Apache Spark — Mike Frampton (Packt Publishing, 1/e, 2015)
- Machine Learning with Spark — Nick Pentreath (Packt Publishing, 1/e, 2015)
Reference Books
- Big Data Fundamentals: Concepts, Drivers & Techniques — Thomas Erl, Wajid Khattak, Paul Buhler (Pearson India Education Service Pvt. Ltd, 1/e, 2016)
- Programming Pig: Dataflow Scripting with Hadoop — Alan Gates (O'Reilly Media, Inc, 1/e, 2011)
- Programming Hive — Jason Rutherglen, Dean Wampler, Edward Capriolo (O'Reilly Media, Inc, 1/e, 2012)
- Big Data Black Book — — (DreamTech Press, 1/e, 2016)
Frequently Asked Questions
How many credits is KTU Big Data Analytics (PBADT504)?
4 credits, with 3:0:0:1 (L:T:P:R) — Project Based Learning (PBL) teaching hours per week, under the KTU 2024 Scheme.
How many modules are in the PBADT504 syllabus?
4 modules, 48 total contact hours.
What is the CIE and ESE mark split for this course?
CIE (Continuous Internal Evaluation): 60 marks. ESE (End Semester Examination): 40 marks, 2 Hrs 30 Min. Total: 100 marks.
What are the recommended textbooks for PBADT504?
Hadoop: The Definitive Guide (Tom White); Professional Hadoop Solutions (Boris Lublinsky, Kevin T. Smith, Alexey Yakubovich); The Art of R Programming: A Tour of Statistical Software Design (Norman Matloff); Spark in Action (Jean-Georges Perrin); Mastering Apache Spark (Mike Frampton); Machine Learning with Spark (Nick Pentreath).
Is this syllabus specific to one branch, or common to others too?
This Semester 5 course is listed under Program Core (PBL) — Artificial Intelligence and Data Science at KTU under the 2024 Scheme — check the course header above for which branches it's common to.
Need help with KTU Big Data Analytics?
Learnizo offers live, 1-on-1 online tuition for KTU AI&DS subjects — matched to your exact module and semester.