KTU 2024 Scheme · Semester 6 · Program Core — Artificial Intelligence and Machine Learning
Introduction to Natural Language Processing (PCCMT601) Syllabus
Official KTU 2024 Scheme syllabus for Introduction to Natural Language Processing, Semester 6, Program Core — Artificial Intelligence and Machine Learning (Artificial Intelligence and Machine Learning).
Course Code
PCCMT601
Credits
4
Teaching Hours
3:1:0:0 (L:T:P:R)
CIE Marks
40
ESE Marks
60
Exam Duration
2 Hrs 30 Min
Prerequisites
None
Semester
Semester 6
Course Objective
To introduce fundamental NLP tasks, applications and language processing challenges, to explore machine learning techniques including neural networks and transformers used in NLP, and to impart rule-based and machine learning approaches with emphasis on pre-trained models and transfer learning.
Module-wise Syllabus
Module 1
8 contact hoursIntroduction to NLP: NLP tasks and applications; language building blocks; challenges of NLP; machine learning for NLP — neural networks, transformers; approaches to NLP — transformer-based NLP, pre-trained language models; ethics in NLP.
Module 2
12 contact hoursPre-processing, Text Representation and Information Extraction: the NLP system pipeline — modern approaches including transfer learning; text representation — word embeddings (Word2Vec, GloVe, FastText), transformer-based embeddings (BERT, GPT). Advanced feature engineering techniques. Information extraction — deep learning approaches, relation extraction using transformers; advanced NER techniques.
Module 3
12 contact hoursText Classification, Relation Detection and Information Retrieval: text classification — transformer-based classifiers, fine-tuning pre-trained models; relation detection and classification — supervised and lightly supervised approaches, evaluation of relation analysis systems; information retrieval — term weighting, document scoring, inverted index, neural IR, transformer-based IR models, evaluation of IR systems.
Module 4
12 contact hoursQA Systems, Machine Translation and Large Language Models: question-answering systems — transformer-based QA models, open-domain QA; machine translation — Neural Machine Translation (NMT), transformer-based NMT, multilingual NLP models; introduction to Large Language Models — GPT-3, GPT-4 and their applications.
Course Outcomes
- CO1Explain foundational NLP tasks, challenges and the integration of neural networks and transformers in modern NLP systems.
- CO2Demonstrate advanced pre-processing techniques, feature engineering and text representation methods, including transformer-based models.
- CO3Use NLP models for text classification, relation detection and information retrieval, focusing on transformers and large language models.
- CO4Demonstrate NLP applications such as machine translation and QA systems using state-of-the-art large language models, considering ethical implications.
Assessment Pattern (CIE: 40 marks, ESE: 60 marks)
Continuous Internal Evaluation (CIE)
| Attendance | 5 |
| Assignment / Microproject | 15 |
| Internal Examination 1 (Written) | 10 |
| Internal Examination 2 (Written) | 10 |
End Semester Examination (ESE)
Total 60 marks, 2 Hrs 30 Min. See the official KTU syllabus document for the exact Part A / Part B question pattern for this course.
Textbooks & Reference Books
Textbooks
- Speech and Language Processing — Daniel Jurafsky, James H. Martin (Pearson Education, 2nd edition, 2013)
- Foundations of Statistical Natural Language Processing — Christopher Manning, Hinrich Schütze (MIT Press, 1st edition, 2019)
Reference Books
- Natural Language Understanding — James Allen (Pearson, 1st edition, 1994)
- Natural Language Processing with Transformers: Building Language Applications with Hugging Face — Leandro von Werra, Lewis Tunstall, Thomas Wolf (O'Reilly Media, 1st edition, 2022)
- Natural Language Processing: A Paninian Perspective — Akshar Bharati, Vineet Chaitanya, Rajeev Sangal (Prentice Hall India, 1st edition, 1995)
Frequently Asked Questions
How many credits is KTU Introduction to Natural Language Processing (PCCMT601)?
4 credits, with 3:1:0:0 (L:T:P:R) teaching hours per week, under the KTU 2024 Scheme.
How many modules are in the PCCMT601 syllabus?
4 modules, 44 total contact hours.
What is the CIE and ESE mark split for this course?
CIE (Continuous Internal Evaluation): 40 marks. ESE (End Semester Examination): 60 marks, 2 Hrs 30 Min. Total: 100 marks.
What are the recommended textbooks for PCCMT601?
Speech and Language Processing (Daniel Jurafsky, James H. Martin); Foundations of Statistical Natural Language Processing (Christopher Manning, Hinrich Schütze).
Is this syllabus specific to one branch, or common to others too?
This Semester 6 course is listed under Program Core — Artificial Intelligence and Machine Learning at KTU under the 2024 Scheme — check the course header above for which branches it's common to.
Need help with KTU Introduction to Natural Language Processing?
Learnizo offers live, 1-on-1 online tuition for KTU AI&ML subjects — matched to your exact module and semester.