Deep Learning Advanced Quiz 5

1. Which advanced optimizer uses lookahead steps to improve convergence?

2. What is label smoothing used for?

3. Which method is used for neural architecture search?

4. What is the main benefit of mixed-precision training?

5. Which method is commonly used to generate adversarial examples?

6. What is the main idea behind contrastive learning?

7. Which architecture is widely used for image segmentation tasks?

8. What is the main purpose of teacher forcing in sequence-to-sequence models?

9. In large language models, what is the main purpose of using a cosine learning rate schedule with warmup?

10. When fine-tuning a very large pre-trained model on a small dataset, which strategy best reduces overfitting risk?