KTU 2024 Scheme · Semester 6 · Program Core Lab — Computer Science and Engineering (Data Science)
Big Data Processing Lab (PCCDL607) Syllabus
Official KTU 2024 Scheme syllabus for Big Data Processing Lab, Semester 6, Program Core Lab — Computer Science and Engineering (Data Science) (Computer Science and Engineering (Data Science)).
Course Code
PCCDL607
Credits
2
Teaching Hours
0:0:3:0 (L:T:P:R)
CIE Marks
50
ESE Marks
50
Exam Duration
2 Hrs 30 Min
Prerequisites
PBCDT504
Semester
Semester 6
Course Objective
To equip students with hands-on experience in setting up and managing Hadoop ecosystems, to provide practical experience with data processing tools such as Hive, Pig and Apache Spark, and to introduce students to R programming and its applications in data analysis.
Module-wise Syllabus
Module 1
1. Set up and install Hadoop in any of the three operating modes: standalone, pseudo-distributed or fully distributed. 2. Explore the various shell commands in Hadoop. 3. Implement file management tasks in Hadoop: adding files and directories, retrieving files, deleting files. 4. Implement a word count program using MapReduce. 5. Write an R program to find the factorial and check for palindromes. 6. Write an R program to solve linear regression and make predictions. 7. Write an R program to solve logistic regression. 8. Implement statistical operations using R. 9. Implement a program to find variance, covariance and correlation between different types of attributes. 10. Implement an SVM classifier using packages. 11. Implement a decision tree classifier using packages. 12. Implement a clustering algorithm. 13. Explore Hive with its basic commands. 14. Design a data model using NoSQL databases such as Hive or Cassandra. 15. Write Pig Latin scripts to sort, group, join, project and filter data. 16. Install, deploy and configure Apache Spark.
Course Outcomes
- CO1Illustrate the setting up and installation of Hadoop in one of the three operating modes.
- CO2Implement file management tasks in Hadoop and explore the shell commands.
- CO3Implement different tasks using the Hadoop MapReduce programming model.
- CO4Implement Pig scripting operations and Spark application functionalities.
- CO5Implement data extraction from files and other sources and perform various data manipulation tasks on them using R programs.
Assessment Pattern (CIE: 50 marks, ESE: 50 marks)
Continuous Internal Evaluation (CIE)
| Attendance | 5 |
| Preparation / Pre-Lab Work, Experiments, Viva, Timely Completion of Lab Reports / Record (Continuous Assessment) | 25 |
| Internal Examination | 20 |
End Semester Examination (ESE)
Total 50 marks, 2 Hrs 30 Min. See the official KTU syllabus document for the exact Part A / Part B question pattern for this course.
Textbooks & Reference Books
Textbooks
- Professional Hadoop Solutions — Boris Lublinsky, Kevin T. Smith, Alexey Yakubovich (John Wiley & Sons, 2013)
- Hadoop: The Definitive Guide — Tom White (O'Reilly Media, 3rd edition, 2012)
Reference Books
- Mining of Massive Datasets — Jure Leskovec, Anand Rajaraman, Jeffrey David Ullman (Cambridge University Press, 2nd edition, 2016)
- Programming Hive — Edward Capriolo, Dean Wampler, Jason Rutherglen (O'Reilly Media, 1st edition, 2012)
- R in Action — Robert I. Kabacoff (Manning Publications, 3rd edition, 2022)
Frequently Asked Questions
How many credits is KTU Big Data Processing Lab (PCCDL607)?
2 credits, with 0:0:3:0 (L:T:P:R) teaching hours per week, under the KTU 2024 Scheme.
How many modules are in the PCCDL607 syllabus?
1 modules.
What is the CIE and ESE mark split for this course?
CIE (Continuous Internal Evaluation): 50 marks. ESE (End Semester Examination): 50 marks, 2 Hrs 30 Min. Total: 100 marks.
What are the recommended textbooks for PCCDL607?
Professional Hadoop Solutions (Boris Lublinsky, Kevin T. Smith, Alexey Yakubovich); Hadoop: The Definitive Guide (Tom White).
Is this syllabus specific to one branch, or common to others too?
This Semester 6 course is listed under Program Core Lab — Computer Science and Engineering (Data Science) at KTU under the 2024 Scheme — check the course header above for which branches it's common to.
Need help with KTU Big Data Processing Lab?
Learnizo offers live, 1-on-1 online tuition for KTU CS (Data Science) subjects — matched to your exact module and semester.