Transformers, Large Language Models (LLMs) and Multimodal Learning

Training Provider: SINGAPORE MANAGEMENT UNIVERSITY
Course Reference: TGS-2024048935
S$660
Original: S$2,200
Save S$1,540

About This Course

This module delves into advanced deep learning models revolutionizing natural language processing tasks. Divided into two sessions, participants will explore the architecture, implementation, and applications of Transformers and Large Language Models (LLMs) using PyTorch.

What You'll Learn

- Describe the architecture and working principles of Transformers, including the attention mechanism and encoder-decoder architecture.
- Implement Transformers using PyTorch for building state-of-the-art language models.
- Describe the capabilities of Large Language Models (LLMs) and their significance in natural language understanding tasks.
- Apply fine-tuning techniques to adapt pre-trained LLMs for specific tasks such as text generation and question answering.
- Describe how multimodal models are able to simultaneously take inputs of varying formats and explore the capabilities of some of the commercially available multimodal models.

Entry Requirements

Nil

Course Details

Duration 15 hours
Language English
Training Commitment Not specified
Total Enrolled New course
Back to All Courses
Note: To apply for this course, visit the SkillsFuture website or contact the training provider directly.

More Courses from SINGAPORE MANAGEMENT UNIVERSITY

In today’s rapidly evolving technological landscape, the emphasis on digital transformation is mor...
Duration 107.5 hours
Fee After Subsidy S$4,350
This certificate programme is designed for non-technical professionals who want to develop data visu...
Duration 330 hours
Fee After Subsidy S$5,760
This programme covers the operational aspects of data protection and information security. It seeks ...
Duration 176 hours
Fee After Subsidy S$3,600