Minimum Requirements
- Understanding of matrix multiplication and factorization, gradients & Hessian, probabilities, basic statistics.
- Coding in Python, Numpy https://cs231n.github.io/python-numpy-tutorial/
- Visualizations using matplotlib or something similar
- Good understanding of neural networks; optimizers; transformers
- PyTorch + any higher-level framework, e.g. Pytorch-lightning, HuggingFace Transformers
- Good understanding of all videos of https://karpathy.ai/zero-to-hero.html