, ,

How to become an AI engineer: an end-to-end guide with free resources

Six stages, from Python and maths to building, fine-tuning and running LLM applications in production, with the free courses, playlists and books for each stage and a project to build at every step.

How to become an AI engineer, an end-to-end guide in six stages

AI Learning Path

Becoming an AI engineer means learning six things in order: Python and maths, machine learning, how large language models work, building with them, the engineering tools around them, and running AI applications in production. Each stage below explains what to learn, points to free courses, playlists and books that teach it well, and ends with a project to build before you move on.

OverviewSix stages at a glance

  1. Python, maths, dataPython, Pandas, SQL, Git, linear algebra, statistics
  2. ML and deep learningMachine learning, neural networks, transformers
  3. How LLMs workTraining, tokens, prompting
  4. Building with LLMsLangChain, RAG, LangGraph agents
  5. Tools and fine-tuningClaude Code, MCP, FastAPI, Ollama, LoRA
  6. Production and cloudEvals, LLMOps, guardrails, tracing, one cloud

A few practical notes:

  • Build the project at the end of each stage before starting the next one.
  • Skip what you already know. If you already write Python, start with the data tools and maths.
  • Expect roughly 9 to 12 months at one to two hours a day. Stages 1 and 2 take the longest.

Many playlists are from CampusX and are taught in Hindi with English terms. A section near the end lists English options. Video counts were checked in October 2026 and may change.

From an infrastructure background? An optional infra track near the end covers Linux, Kubernetes, cloud, GPUs and model serving.

Stage 1Python, maths and data

Python first, then the tools for working with data, then the maths that machine learning rests on.

ResourceCreatorSizeWhat you learn
100 Days of Python ProgrammingCampusX40 videosPython basics: data types, input, operators, if-else, loops
NumPyCampusX13 videosArrays and fast maths on data
PandasCampusX21 videosLoading, cleaning and analysing tables of data
Complete SQL Course for Data ScienceCampusX5 h 42 minQuerying databases
Git and GitHub for BeginnersfreeCodeCamp1 h 8 minVersion control and sharing code
Essence of Linear Algebra3Blue1Brown16 videosVectors and matrices, visually
Essence of Calculus3Blue1Brown12 videosDerivatives and gradients, the idea behind how models learn
Statistics FundamentalsStatQuest62 videosProbability and distributions; watch the first 20, return for the rest when needed

BuildLoad a public dataset with Pandas, answer five questions about it, and push the notebook to GitHub.

Stage 2Machine learning and deep learning

How models learn from data, then neural networks, then transformers, the architecture behind large language models.

ResourceCreatorSizeWhat you learn
100 Days of Machine LearningCampusX134 videosWhat ML is, types of learning, the ML project life cycle
Neural Networks3Blue1Brown9 videosA visual picture of how a network learns; watch before the next playlist
100 Days of Deep LearningCampusX84 videosNeural networks from the perceptron up, Keras and TensorFlow projects
Complete Transformers for NLP in one shotKrish Naik1 long videoEmbeddings and self-attention, with handwritten notes

BuildA small model that predicts something real, such as customer churn, with a short write-up of how well it does.

Stage 3How LLMs work, and prompting

What large language models are, how they are trained, and why they sometimes get things wrong, followed by how to write good prompts.

ResourceCreatorSizeWhat you learn
Intro to Large Language ModelsAndrej Karpathy59 minA big-picture view of what an LLM is; start here
Deep Dive into LLMs like ChatGPTAndrej Karpathy3 h 31 minPre-training, fine-tuning, reinforcement learning and hallucinations, without code
Neural Networks: Zero to HeroAndrej Karpathy10 long videosOptional deep dive: build networks and a small GPT from scratch in code, including Let’s build GPT
ChatGPT Prompt Engineering for DevelopersDeepLearning.AI and OpenAI1.5 hWriting clear prompts from code: summarising, extracting, transforming
Interactive Prompt Engineering TutorialAnthropic9 chaptersHands-on exercises; pair with the prompt engineering docs

BuildA prompt that turns messy text, such as an email or invoice, into clean JSON, tested on ten real examples.

Stage 4Building with LLMs

Calling a model from code, connecting it to your own documents (retrieval augmented generation, or RAG), and building agents that can plan and use tools.

ResourceCreatorSizeWhat you learn
Generative AI using LangChainCampusX21 videosModels, prompts, structured output, parsers, chains, runnables, document loaders
RAG playlistCampusX9 videosText splitters, vector stores, retrievers, Corrective RAG, Self-RAG
Agentic AI using LangGraphCampusX28 videosAgent concepts, sequential, parallel, conditional and looping workflows, persistence
Agentic AI ProjectsAbhijeet Muneshwar7 videosComplete agent projects built end to end
Agentic AI projects: End-to-EndAI with Hassan42 videosClient-style agent projects; pick two or three rather than all 42

BuildA chatbot that answers questions from your own PDFs, then rebuilt as a LangGraph agent.

Stage 5AI engineering tools, open models and fine-tuning

Coding with an AI assistant, connecting models to other tools with MCP, serving a model as an API, and running and fine-tuning open models.

ResourceCreatorSizeWhat you learn
Agentic Coding using Claude CodeCampusX15 videosSetup, context window, CLAUDE.md, spec-driven development, plan mode, skills, subagents
Model Context Protocol (MCP Trilogy)CampusX8 videosWhy MCP exists, its architecture, building MCP servers and clients
FastAPI for Machine LearningCampusX13 videosAPIs, Pydantic, serving a model, Docker, deploying to AWS
Ollama Masterclass 2026CampusX2 h 49 minRunning open models on your own laptop with Ollama
Hugging Face LLM CourseHugging Face12 chaptersTransformers library, datasets, tokenizers, fine-tuning (a text course)
Finetuning LLM: LoRA and QLoRAKrish Naik Hindi26 minHow low-cost fine-tuning works
Fine Tuning LLM ModelsfreeCodeCamp (Krish Naik)2 h 37 minHands-on LoRA and QLoRA; the Unsloth docs help you train faster on a free GPU

BuildWrap your Stage 4 chatbot in a FastAPI service with Docker, switch it to a local Ollama model, and fine-tune one small model on your own data.

Stage 6Production and cloud

Testing, deploying, securing and monitoring an LLM application, and running it on a cloud platform.

ResourceCreatorSizeWhat you learn
LLM EvaluationCampusX19 videosModel vs application evals, LLM-as-a-judge, offline and online evals, benchmarks
LLMOps Course: Build, Deploy and Scale RAG AI SystemsAnalytics Vidhya26 videosLLMOps life cycle, model serving, hosted APIs vs open models
LLM Gateways: explained and crash courseKrish Naik2 videosOne entry point to many model providers, with routing, cost control and logging
Complete AI Security Course in 8 HoursKrish Naik1 long videoGuardrails against unsafe or off-topic input and output, plus evals and memory
LLM Tracing and ObservabilityArize AI20 videosOpenTelemetry for AI, traces and spans, tracing tool calls, human feedback
Loop Engineering and Harness Engineering Crash CourseKrish Naik3 h 35 minHow agent loops and the harness around them are designed
Pick one cloud: Amazon Bedrock Getting Started, Microsoft Foundry or Google Introduction to Generative AIAWS, Microsoft, Google1 to 5 hManaged model APIs, security and cost on a cloud platform
AI Engineering and its free resourcesChip Huyen534-page bookOptional reading on how production AI applications are designed; the book is paid, the repo is free
AI and GenAI: Complete Guides and SeriesDr. Pranay Jha11 written seriesWritten deep dives on GenAI concepts, AWS, Azure, Google Cloud, IBM watsonx, Hugging Face, NVIDIA, Red Hat and VMware Private AI

BuildAdd an evaluation set, one guardrail and tracing to your Stage 5 service, then deploy it on your chosen cloud. Cloud services cost money once you go past the free tier, so set a budget alert before you deploy and shut down what you are not using.

After Stage 6Final project and keeping up

Final projectOne application that uses every stage, for example a support assistant for a small business: RAG over its documents, an agent that can take actions, served with FastAPI, evaluated, guarded, traced and deployed.

AI tools change quickly. These are worth reading regularly:

Optional · For infrastructure engineersInfra track: cloud, Kubernetes and AI infrastructure

Coming from infrastructure, such as VMware, cloud, networking or Kubernetes? This track covers the platform side that AI applications run on: Linux, containers, Kubernetes, automation, cloud, and then GPUs and model serving. Take it alongside Stages 5 and 6, or skip it if you work on the application side.

Platform basics

ResourceSizeWhat you learn
Linux Zero to Hero13 videosLinux basics every server and container runs on
Networking Fundamentals3 videosIP addressing, CIDR and subnets
Docker15 videosContainers and images
Kubernetes45 videosPods, deployments, services, ingress and the rest of the platform
Troubleshooting Kubernetes6 videosDiagnosing common failures such as ImagePullBackOff
Ansible Zero to Hero11 videosAutomating server and application setup
Pick one cloud: AWS Zero to Hero, Azure Zero to Hero or GCP Zero to Hero in 20 Days16 to 40 videosCompute, storage, networking and identity on the cloud you chose in Stage 6
AI Assisted DevOps15 videosUsing AI tools in day-to-day infrastructure and DevOps work

All playlists in this table are by Abhishek Veeramalla. His DevOps Zero to Hero course (59 videos) covers most of them in one series.

AI infrastructure

ResourceCreatorSizeWhat you learn
What is vLLM? and Understanding vLLM with a hands-on demoIBM Technology; KodeKloud5 min; 15 minServing open models efficiently; follow up with the vLLM quickstart
NVIDIA GPU OperatorNVIDIAdocsHow GPUs are made available to Kubernetes; see installing the GPU Operator
Cloud Native Inference at Scale with KServeCNCF18 minRunning LLM inference on Kubernetes with KServe
Large Scale Distributed LLM Inference with llm-d and KubernetesDevoxx (Abdel Sghiouar)1 h 44 minOptional deep dive into distributed inference on Kubernetes

Related reading on this site: turning one laptop into a full AI and Kubernetes lab, running a 70B model without owning a GPU, one RAG chatbot on five tech stacks, and the AI Stack Builder for mapping each layer of an AI platform.

BuildDeploy your Stage 6 service on Kubernetes and automate the setup with Ansible. If you have access to a GPU, serve an open model with vLLM behind it. Then break something on purpose and use an AI assistant to help you diagnose and fix it.

In EnglishEnglish options for each stage

Swap these in for the Hindi playlists; the order of stages stays the same. Karpathy, 3Blue1Brown, StatQuest, the evaluation and observability courses and the cloud courses are already in English.

StageResourceCreatorSize
1Learn Python: Full Course for Beginners or Harvard CS50PfreeCodeCamp; Harvard4 h 27 min; full course
1Python NumPy Tutorial for BeginnersfreeCodeCamp58 min
1Pandas TutorialsCorey Schafer11 videos
1SQL Tutorial: Full Database Course for BeginnersfreeCodeCamp4 h 20 min
2Machine Learning Specialization (free to audit)Andrew Ng, DeepLearning.AI and Stanford3 courses
2Machine Learning for EverybodyfreeCodeCamp (Kylie Ying)3 h 53 min
2Practical Deep Learning for Coders or MIT 6.S191 Introduction to Deep Learningfast.ai; MITfull course; lectures
4Learn RAG From ScratchfreeCodeCamp (Lance Martin)2 h 33 min
4Introduction to LangGraphLangChain Academyonline course
5Claude Code in ActionAnthropic Academyonline course
5Model Context Protocol CourseHugging Faceonline course
5FastAPI Course for BeginnersfreeCodeCamp1 h 4 min
5Ollama Course: Build AI Apps LocallyfreeCodeCamp2 h 57 min
3 to 6DeepLearning.AI short coursesDeepLearning.AI1 to 2 h each

Track your progress. Download the printable checklist (PDF) with every resource in this guide, and tick each one off as you finish it.

All resources listed here belong to their creators: CampusX, 3Blue1Brown, StatQuest, freeCodeCamp, Andrej Karpathy, DeepLearning.AI, Anthropic, Hugging Face, Krish Naik, Abhijeet Muneshwar, AI with Hassan, Analytics Vidhya, Arize AI, AWS, Microsoft, Google, Abhishek Veeramalla, Chip Huyen, Harvard CS50, fast.ai, MIT, LangChain, Corey Schafer, IBM, KodeKloud, NVIDIA, CNCF and Devoxx. Links and video counts were checked in October 2026.

About The Author


Discover more from Journal of Intelligent Infrastructure

Subscribe to get the latest posts sent to your email.

Leave a Reply

Your email address will not be published. Required fields are marked *

Architect’s Toolkit

About the Author

Dr. Pranay Jha is a Cloud and AI Consultant with 18+ years of experience in hybrid cloud, virtualization, and enterprise infrastructure transformation. He specializes in VMware technologies, multi-cloud strategy, and Generative AI solutions. He holds a PhD in Computer Applications with research focused on Cloud and AI, has published multiple research papers, and has been a VMware vExpert since 2016 and a VMUG Community Leader.

Discover more from Journal of Intelligent Infrastructure

Subscribe now to keep reading and get access to the full archive.

Continue reading