Minimum Requirements


  1. Understanding of matrix multiplication and factorization, gradients & Hessian, probabilities, basic statistics.
  2. Coding in Python, Numpy https://cs231n.github.io/python-numpy-tutorial/
  3. Visualizations using matplotlib or something similar
  4. Good understanding of neural networks; optimizers; transformers
  5. PyTorch + any higher-level framework, e.g. Pytorch-lightning, HuggingFace Transformers
  6. Good understanding of all videos of https://karpathy.ai/zero-to-hero.html


More Materials to Study


  1. A book for Math background: https://mml-book.github.io/
  2. 2025 videos: https://introtodeeplearning.com/
  3. Building GPT-2 from scratch: https://karpathy.ai/zero-to-hero.html
  4. Deep Learning for Computer Vision (2021; Michigan; Justin Johnson)
  5. Contents in Armenian: FAST 1991 videos, Arthur Muradyan’s videos, ACA courses!
  6. A book: https://www.bishopbook.com/
  7. Apply to LLM Summer School!