Generative AI Engineer - Senior Prep

Build the end-to-end mental model senior interviewers probe for: pretraining, post-training, tokenization, sampling, and why models hallucinate. Skip the hype and understand the full training stack.

• 

  Deep Dive into LLMs like ChatGPT

  Andrej Karpathy

  • The full LLM training stack: pretraining vs post-training
  • How internet-scale datasets (Common Crawl, FineWeb) are built and filtered
  • Base models vs assistant models and what fine-tuning really changes
  • Why LLMs hallucinate, and how RLHF shapes behavior
  • Reasoning models, tool use, and where the field is heading
  • Talking-points you can reuse verbatim in senior interviews
• 

  [1hr Talk] Intro to Large Language Models

  Andrej Karpathy

  • What the two files that make up an LLM really are
  • Scaling laws and the compute/data/parameter trade-off
  • The LLM 'operating system' framing for tools and agents
  • Prompt injection, jailbreaks, and other security failure modes
  • A crisp 1-hour narrative you can whiteboard from memory