24-Week Senior AI Engineering Roadmap
Build model-level understanding from gradients to transformers, then apply it to production AI systems. Built on senior backend experience in Laravel, Vue/TypeScript, Node, Kotlin, Docker and Kubernetes.
Goal
Target senior applied AI, AI systems, or AI platform engineering roles, rather than resetting to a junior ML position.
Understand the machine
Gradients, neural networks, transformers, training and inference.
Ship the system
Retrieval, tool calling, evaluation, serving and operations.
Prove it
Three reviewable projects, design defenses and a senior AI narrative.
Time per week
1.5 h conceptual study · 2 h from-scratch implementation · 2 h applied project work · 1 h testing and documentation · 0.5–1.5 h math and papers.
Overall split
35% model internals · 40% production AI · 25% portfolio and career.
Three portfolio projects
Each project is built in stages across the plan and finishes as a reviewable artifact.
Mini GPT from scratch
Autograd, neural network, tokenizer, attention, training and generation.
Reliable order processing
Document classification, structured extraction, catalog matching, review workflows and evaluation.
Inference and evaluation platform
Open-weight serving, benchmarks, telemetry, deployment and operational controls.
Weekly plan
Open any week for the full guide: steps, where to get each resource, what to build and how to check yourself. Progress is saved in this browser.
First seven days
The on-ramp before Week 1 begins in earnest.
- Set up Python, uv, NumPy, PyTorch and pytest.
- Review chain rule, gradients, matrices and dot products.
- Watch the first part of Karpathy’s micrograd lecture.
- Write a Value class with addition and multiplication.
- Implement backward propagation through a graph.
- Run numerical gradient checks against PyTorch.
- Commit the code and write down what a gradient means.
Production architecture to practice
The system you will build and defend in interviews.
Design rules
- Keep authorization, validation, financial and business operations, and audit controls in deterministic code.
- Treat model outputs as untrusted input.
- Require human approval for consequential writes.
Evaluation scorecard
Targets for the projects, and the metrics to track throughout.
Document classification accuracy
SKU exact-match
Unauthorized model-triggered writes
Pipeline metrics
Field-level precision and recall, false automations, cost per correctly processed document, p95 latency, human-review fraction and regressions.
Serving metrics
Time to first token, tokens per second, p95 latency, concurrent throughput, KV cache and peak memory, cost per successful request.
Career milestones
Checkpoints that show whether the plan is on track.
Implement and explain gradients, attention and a transformer.
Demonstrate an evaluated, integrated and operational AI service.
Present three reviewable projects with architecture, baselines, performance, failure analyses and trade-offs.
Target roles
Senior Applied AI Engineer · Senior AI Systems Engineer · AI Platform Engineer.
Reality check
Experience running real production systems matters more than certificates. Six months will not substitute for years of production ML or research experience.
Technology priorities
Hardware, budget and confidentiality
Hardware and budget
Your existing laptop is enough for micrograd and mini-GPT experiments. Use Apple Silicon acceleration where available. Rent GPU compute only when a larger model requires it, and cap costs. A provisional $25–$100 per month may cover modest API and occasional GPU use. Training can cost much more.
Confidentiality
Use synthetic or expressly authorized anonymized datasets for portfolio work. Do not publish proprietary source code, credentials, customer documents or company data.
Recommended specialization
AI Systems Engineering with strong model-level understanding. Use your backend and infrastructure strengths to build the dependable system around probabilistic models.
Resources
Links from your plan. Each week page lists the specific resources for that week.
Model internals
- Karpathy Zero to Herohttps://karpathy.ai/zero-to-hero.html
- Zero to Hero source codehttps://github.com/karpathy/nn-zero-to-hero
- nanoGPThttps://github.com/karpathy/nanoGPT
- PyTorch beginner fundamentalshttps://docs.pytorch.org/tutorials/beginner/basics/intro.html
Hugging Face and fine-tuning
- Hugging Face LLM coursehttps://huggingface.co/learn/llm-course/en/chapter1/1
- Hugging Face PEFThttps://huggingface.co/docs/peft/index
Building AI applications and evaluation
- OpenAI AI application developmenthttps://developers.openai.com/tracks/ai-application-development
- OpenAI evaluation best practiceshttps://developers.openai.com/api/docs/guides/evaluation-best-practices
Serving and inference
- vLLM documentationhttps://docs.vllm.ai/en/stable/