0578 - Language Models
Description
Large Language Models (LLMs) are transforming how we interact with technology; from powering chatbots and search engines to enabling advanced content generation and semantic understanding. This course provides a practical introduction to the architecture, functionality, and applications of Language Models (LMs), equipping learners with the skills to build, fine-tune, and deploy models for real-world tasks.
Building on foundational machine learning concepts and preparing for advanced topics in generative AI and model deployment, you will explore the inner workings of LLMs, including tokenization, embeddings, attention mechanisms, and transformer architectures. Learners will gain practical experience by building a text classification system and exploring advanced techniques, such as instruction tuning, semantic search, and multimodal model integration.
By the end of this course, you will be equipped to apply LLMs in enterprise settings, enhance AI-driven products, and contribute to NLP and multimodal AI projects.
What you will learn
- Describe the architecture of transformer-based language models
- Prepare and embed training data
- Build and train your own small special-purpose language model
- Supplement your model’s knowledge with additional information via Retrieval-Augmented Generation (RAG)
- Evaluate your language model’s performance
Skills you’ll gain
- Applying pre-trained LLMs to classification and search tasks using Hugging Face Transformers
- Designing classification heads and prompt-based pipelines
- Using vector databases and RAG for semantic retrieval
- Understanding multimodal model architectures and their applications
- Understanding and implementing advanced tokenization methods
Course format
- Prerequisites:
- Completion of Machine Learning course or equivalent prior knowledge.
- Familiarity with PyTorch
- Project: Build a text classification system
- Delivery: Hybrid delivery, instructor-led live sessions with hands-on assignments
Applies Towards the Following Certificates
- AI Bundle : Mandatory
- Artificial Intelligence Certificate : Mandatory