This course is a one-semester course intended for Masters students in Computer Science and Data Science graduate programs. Students will gain a deep understanding of pivotal topics, including the intricacies and innovations of recent artificial intelligence architectures. The course will cover diverse generative models such as encoder-decoder architectures, contrastive learning, seq2seq models, attention/ transformer mechanisms, diffusion models, and a variety of specialized loss functions. This comprehensive overview will equip students with a broad understanding of the key approaches in generative modeling. Students will engage in practical, hands-on projects utilizing real-world generative models to tackle contemporary challenges and applications, including computer vision, speech and natural language processing, graph mining, reinforcement learning, and trustworthy machine learning. In this course, students will be introduced to extensive, large-scale datasets pivotal to the field of Generative Artificial Intelligence. All practical components will be delivered using the Python programming language, leveraging the power and versatility of leading libraries, including TensorFlow, PyTorch, and Scikit-learn.
Course learning outcomes
1. Demonstrate a thorough understanding of the foundational principles and advanced concepts underpinning generative models and their associated architectures.
2. Apply knowledge of deep learning architectures, such as encoder-decoder structures, diffusion models, seq2seq, attention mechanisms, transformers, BERT, and GPT.
3. Critically assess the performance of various generative models, utilizing both quantitative metrics and qualitative insights, to determine their suitability for different applications.
4. Integrate current research findings, methodologies, and advancements into generative model development and problem-solving.
5. Exhibit the ability to independently explore, understand, and integrate new tools, techniques, and research developments in generative AI, demonstrating a commitment to lifelong learning.