I started learning CUDA a while back to work on inference and understand FlashAttention. I read a lot of blogs on various topics, but the order was always confusing, so I wrote up the order that I'd pick if I started over.

What it covers:
- H100 architecture
- CUDA software mental model
- Getting started with Matrix Multiplication and building up to a very optimized solution
- Understanding how all of these add to optimization constraints
- An introduction to reading and understanding PTX(the compiler code)

It's meant to be a starter overview that will get you confident enough to read deeper, niche resources. I'd appreciate any feedback or corrections. Cheers!

Link to blog

Hi everyone,

I’m a self-taught software engineer with a couple of years of industry experience. I was recently made redundant, so I have a good chunk of free time on my hands before I dive heavily back into the job hunt (which, honestly, feels a bit daunting right now).

Lately, I’ve become really interested in Machine Learning and want to start learning it. However, I’ve been reading a lot of discouraging posts lately. It seems like even people with CS Bachelor's degrees are struggling to land MLE roles because they are competing against a massive pool of Masters and PhD graduates.

Given that I don't have an academic background or official credentials in ML, am I wasting my time trying to break into this field?

I’m absolutely willing to put in the work to learn, but I want to be realistic about my employment prospects. For those working in the industry: is there a viable path for an experienced, self-taught dev to pivot into ML/AI roles, or should I focus my energy elsewhere?

Thanks in advance for any insights or brutal honesty.

Title: How do you introduce yourself in an AI Engineer interview?

Hey everyone,

I feel like my self-introduction isn't that good during AI Engineer interviews.

I have around 3 years of IT experience, but I sometimes struggle to explain my experience properly.

If you're working as an AI Engineer, GenAI Engineer, or LLM Engineer, could you share how you introduce yourself in interviews?

Even a simple example would really help me improve mine.

Thanks in advance!

It's a 50 hour course for beginners in AI/ML (obviously it's fully free). Starts out with linear algebra, derivatives, statistics and then linear regression, neural networks and backpropagation etc...

kinoml.tech

Hi everyone. I’m a hands-on AI engineering leader with a PhD in computer science and experience teaching in academia and mentoring working professionals. My work involves both leading teams and building AI systems—from architecture and implementation to evaluation and deployment.

Based on that experience, I’ve been developing Nextia Learning, a free platform covering the different skills involved in AI engineering.

The motivation is straightforward: AI engineering requires knowledge across several areas, and knowing what to learn—and in what order—can be difficult.

Understanding models matters. So does knowing how to prepare data, build APIs, work with databases, evaluate outputs, manage permissions, deploy applications, and investigate failures. With LLMs and agents, you also need to think about retrieval, tool access, unpredictable outputs, latency, and cost.

You don’t need to master everything before you start. But understanding how these pieces fit together helps you build better systems and identify where you need to develop your skills.

That’s what I wanted to reflect in this platform.

Courses covering different aspects of AI engineering

The curriculum brings together:

• Foundations: Python, Git, SQL, mathematics, and statistics.
• Models and applications: machine learning, LLMs, RAG, agents, and MCP.
• Software engineering: APIs, databases, authentication, permissions, and frontend considerations.
• Quality and safety: evaluation, testing AI applications, security, and privacy.
• Deployment and operations: Docker, cloud deployment, CI/CD, observability, scaling, and cost.
• Leadership and governance: planning AI products, leading teams, and making decisions about risk and accountability.

The selection reflects the range of problems and decisions I’ve encountered while building AI applications. My aim is to help learners develop skills across these areas and understand how to use them together.

Learning paths are a central part of it

Having a collection of courses doesn’t necessarily tell you where to begin.

A software developer moving into LLM applications has different needs from a new graduate learning machine learning, a domain expert applying AI, or someone leading an AI team.

The learning paths organize courses around those goals, with prerequisites and a suggested order. They help you see what to learn next, how it builds on what you already know, and where it fits into the work you want to do.

Lessons are text-first, written in simple English, and include worked examples, guided practice, common mistakes, and checks for understanding. There’s also an interview preparation section.

A few things to be transparent about

• All courses and certificates are free. You can read lessons without an account. Signing in lets you enroll and save your progress.
• The content is AI-assisted and human-reviewed. I design the outlines and instructional approach, guide the examples, and review the courses. This is disclosed on the site.
• Your data isn’t sold or used for marketing. Lesson reminders are optional, off by default, and you control their frequency.
• The platform is evolving. Some courses are in pilot or marked coming soon. Feedback and corrections are welcome.

You can explore the courses and learning paths here: https://learning.nextia-ai.com/

For those learning or working in AI engineering: which skills were missing from your initial learning but turned out to be important in your work? I’d also welcome feedback on whether the learning paths make sense for your background and goals.

We wanted to understand how well a model will adhere to your fonts and colors and preserve your images when making edits.

Take a look at the complete writeup here: https://cocolabs.ai/blog/introducing-vybbench

Our HuggingFace dataset is here: https://huggingface.co/datasets/cocolabs/vybbench

Hey everyone!

I've been learning Python and I'm really interested in getting into machine learning and deep learning. The problem is that whenever I try to figure out how to get started, I end up finding a huge amount of mathematics, statistics, linear algebra, calculus, and theory that I'm apparently supposed to learn first.

I understand that math is important if you want to properly understand how these models work, and I'm not trying to avoid learning it forever. However, I don't want to spend months studying theory before I can actually start building things and experimenting with code.

I'd much rather learn by doing projects, making mistakes, seeing what happens when I change something, and gradually learning the theory behind it as I need it.

Is it realistic to start building ML projects with Python while learning the math along the way?

How much math do I actually need to know before getting started with things like neural networks and deep learning?

Would you recommend starting with scikit-learn and traditional ML, or jumping straight into PyTorch or TensorFlow?

Are there any resources that teach you by making you build actual projects instead of spending most of the time on theory?

I'm not looking for a way to completely skip the fundamentals. I just want to avoid getting stuck in tutorial hell or spending so much time preparing to learn that I never actually get to build anything.

I'd really appreciate any advice, especially from people who learned this way themselves. Thanks!

Hey everyone!

I'm a BTech AIML student currently learning Machine Learning and working towards becoming an ML Engineer.

So far, I've learned Linear Regression, Gradient Descent and its types (Batch, Stochastic, and Mini-batch), Logistic Regression, and evaluation metrics like Precision, Recall, and F1-score. I've been learning the concepts practically using Python and Scikit-learn.

Now, I'm confused about what to do next.

Should I start building projects with the concepts I've learned so far?

What beginner-friendly projects would help me understand ML practically?

Should I learn more algorithms first, such as Decision Trees, Random Forest, SVM, and KNN?

What skills should I focus on to become internship-ready?

How can I make my projects stand out when applying for ML internships?

I'd appreciate advice from people working in ML or those who have been through a similar learning journey. I want to build real-world projects and develop practical skills rather than just follow tutorials.

Four years ago I posted a first version of the Mechanical Neural Network, a mechanical model of a fully connected neural network explaining structure and functionality of artificial neural networks.

Now a new 3D printed version exists along together with a series of teaching videos. Check out these videos here. For now this series covers structure and functionality of ANNs, gradient descent and backpropagation, as well as learning rate and momentum. The videos are in German but with YouTube auto translate and subtitles this should hopefully be not a big hindrance.

There is also a short explanation video on what the Mechanical Neural Network actually is and how it can be used in teaching.

Hi,

I am trying to transition from a Data Analyst to an AI Engineer role. I recently followed Andrej Karpathy’s youtube video to build a character level LLM.

I feel like i have a rough understanding of how llms work and now i want to move on to building projects that will help me understand other fundamentals.

I am thinking of building a murder mystery game where AI generates the scanerio, the characters as well as any evidence. The players are required to chat with the suspects and solve the case. The game will then give them feedback on their deduction abilities.

I plan to build more projects in the future but i want to start with something that is simplistic enough in terms of concept and scope.

Do you think this is a good project to learn the fundamentals of AI Engineering? Will it attract attention from Hiring Managers and Recruiters?

Any AI Engineers, if you have better project ideas please share!

Thanks you!

Hi! I'm a 3rd-year CS student in France. I'm looking for an internship this year and will apply to ML master's programs, so I need a personal roject.

My idea: a computer vision tool that analyzes hockey game footage to automatically count shots on goal, puck possessions, and long possessions (4+ seconds).

My questions:

• Is this a good portfolio project for ML/CV internships?

• What tools and topics should I learn to build it?

• Any tips for detecting a small, fast object like a puck?

If you don't think this is a good project idea, I'm open to other suggestions. I'd really appreciate any advice! (I know I could ask an AI about all of this, but I'd like to hear from real people with actual experience.) Thanks!

Most of us start learning AI with real intent: a great course, the book everyone recommends. Then life interrupts. A hard week at work, a move, a busy month. Coming back means remembering where you were and finding the next step, and that friction is often enough to stall us. Meanwhile the field keeps moving, and every week away feels like falling further behind.

What changed it for me was rethinking what I studied, not just how often. Some ideas don't add to what you know; they rewire it. Education researchers Jan Meyer and Ray Land called these threshold concepts in 2003. Their classic example is opportunity cost: once it clicks, nothing is ever free again, and every hour and every dollar carries the price of what you gave up for it. If you code, you've felt this with recursion. One day it's a magic trick; the next, you see it in trees, parsers, and every divide-and-conquer problem. You can't unlearn a threshold concept, and it quietly reorganizes everything you learn after it.

That's the strategy, and it works for any field: find its handful of thresholds, learn them roughly in the order they were discovered, and go deep enough that they change how you see the rest. New facts stop piling up and start snapping onto a frame.

Here are eight thresholds that greatly help explain AI, roughly in their historical order, each with a surprising fact and a free resource:

1. Behavior learned from data, not programmed. In 1958, Rosenblatt's perceptron, a single artificial neuron, taught itself to tell left from right card marks after about 50 tries. 60 years too soon.
2. Representations and embeddings. In 2012, AlexNet learned its own features and hit 15% top-5 error on ImageNet, against 26% for the runner-up built on hand-picked ones. Jay Alammar's Illustrated Word2vec
3. Next-token prediction. A network trained only to predict the next character of Amazon reviews grew a neuron that tracked sentiment, and nobody had taught it that. The only task of the neural net was to predict tokens in a sequence of text, but in doing so it learned how to identify and represent underlying concepts. At the scale of internet data, the exact same task produced grammar, facts, and reasoning, the foundation of today’s models.  Karpathy's "Let's build GPT"
4. Attention. The 2017 transformer dropped word-by-word reading and reached top-tier translation after about 12 hours on one 8-GPU machine. This enabled the transformer, training in parallel on GPUs, and the speed up and scale that followed. Jay Alammar's Illustrated Transformer
5. Evals. How do you know a change actually made a general model better? The trap is old: Goodhart’s law warns that when a measure becomes a target, it stops being a good measure, and models are very good at hitting targets. Hugging Face's Evaluation Guidebook
6. Post-training and RL fine-tuning. People preferred a 1.3B InstructGPT model over the 175B GPT-3. How you train after pretraining can matter more than size. This enables ChatGPT-style assistants and reasoning models trained on answers that can be checked. Nathan Lambert's RLHF book
7. Harnesses and agents. On SWE-bench Lite, GPT-4 scored 2.7% with one harness and 28.3% with another. Same model, almost 10× better. This enables agents that plan, act, and retry, and it explains why the same model does better in one product than another. Anthropic's "Building effective agents"
8. Recursive self-improvement. DeepMind's AlphaEvolve sped up a key piece of Gemini's own training code by 23%. DeepMind's AlphaEvolve post

These eight are a small subset. There are of course many more threshold concepts in AI, and which ones matter next depends on what you’re exploring, at what granularity and where you’re starting from. The bigger point here is the approach and orientation.

💡 My biggest lightbulb moment came from working out by hand how a neural net could handle a fixed goal, like deciding whether a piece of text fits a topic. I started with a neural version of bag-of-words, one weight per word, then realized I could encode arbitrary rules in the parameters. After that, "learned from data instead of programmed" stopped feeling abstract.

The full write-up has more of the history behind each idea, the "spiral" approach to going deeper with each pass, and a study prompt that turns these into a plan with any LLM: Feynman's wobbling plate and 8 core ideas behind modern AI

Disclosure: I'm building Zairai, an AI coach built on these learning science principles, delivering bite-sized interactive sessions that feel like real work and compound strategically: you step into the shoes of the people who made these discoveries and measure for yourself, so the foundations that you're missing click and everything built on them makes more sense. It's free to start and launching soon. Everything above works without it.

What was the threshold concept that made AI click for you?

I've been working on computer vision projects and one lesson I've learned is that a high overall metric doesn't always tell the full story.

A few things I now check during evaluation:

- Per-class precision and recall

- Confusion matrices and difficult examples

- Performance on validation data that wasn't used for training

- Whether improvements hold up on real-world images

I'm curious how others here approach error analysis. What's the first thing you inspect when a model's validation metrics look good but its real-world predictions are disappointing?

[ Removed by Reddit on account of violating the content policy. ]

Hi! I'm a materials engineering PhD researcher at the University of Sheffield, specialising in microscopy and microstructural characterisation. I'm looking for collaborators, particularly those with ML experience, for the upcoming hackathon (15–17 December).

Anyone interested in teaming up?

https://kaliningroup.github.io/mic_hackathon_3/

Hello, newb here looking for recommendations for a personal project where I would like to analyze the players' movements from the Mobile Legends Bang Bang (MLBB) Mini-map. From my limited research on Sports Game Analyses – I have learnt that the researchers mostly apply Computer Vision technologies, RNN, and CNN for conducting their analyses. However, contrary to their projects, videogame Mini-maps are simpler without much random events — which means replicating their techniques are a bit overkill.

P.s, a MLBB match typically lasts around 15 minutes and I need all player-movements analyzed for my project. Thanks! **Pic was taken from Vcgamers not mine.

I will be starting a course in Probabilistic Machine Learning in one week. Can you guys please recommend a good resource for me to refresh my knowledge in short amount of time?

I've been setting up an environment to work through the labs in ISLP (An Introduction to Statistical Learning), and I got curious about how the free cloud tiers I frequently use actually compare to my daily-driver laptop.

Threw together a few quick and dirty tests comparing: - Oracle Cloud: Always-free 4-core ARM64 VM (Ampere, ~24 GB RAM) - Lightning AI: Free CPU Studio (4 vCPUs) - Kaggle: Standard CPU session (4 vCPUs) + separate T4 GPU session - Local Laptop: Ryzen 7 6800H (16 threads) + RTX 3050 Laptop (4GB VRAM)

Sharing the numbers below in case anyone finds it useful.

1. scikit-learn: Random Forest Training

Synthetic binary classification dataset (40k samples, 40 features). Trained a Random Forest with 200 trees (32k train / 8k test). Single run per config:

All runs hit 95.59% test accuracy.

Kaggle's CPU runtime was surprisingly sluggish here—at n_jobs=4, it took more than 3x longer than the local 6800H. Oracle ARM held up pretty decently against Lightning.

2. PyTorch: CPU Matmul (4096×4096, float32)

Warmed up once, timed 3 runs, reported median:

Lightning was super fast on 1-2 threads (likely better underlying Intel/AVX optimizations or host clock), but scaling fell off a cliff at 4 threads. Kaggle also basically plateaued between 2 and 4 threads.

3. Quick GPU Check: RTX 3050 vs. Tesla T4 (4096×4096 Matmul)

PyTorch float32 matmul, TF32 explicitly disabled, with CUDA sync:

For raw single-op compute without memory bottlenecks, the 3050 edged out the older T4 by ~10%. Obviously 4GB VRAM limits any serious deep learning workloads, but for lightweight prototyping, it beats waiting in Kaggle's queue.

Notes & Limitations

• Not a rigorous scientific review—Python/library builds weren't identical across instances (e.g. local was PyTorch 2.10 on Python 3.12, Kaggle CPU was on 3.13, differing OpenBLAS/MKL backends, shared host throttling, etc.).
• Take the single-run scikit-learn numbers with a grain of salt.

I was honestly expecting the cloud instances to be faster or at least on par with an older mobile chip, but modern laptop silicon continues to impress for basic tabular ML and small-scale prototyping.

Curious if anyone else has run into that severe scaling bottleneck on Kaggle's 4-core CPU instances?

Hey everyone! I’m a Software Engineer in India with around 1 year of experience in automotive embedded software .

My background includes C/C++, Python,embedded systems, ARM, RTOS, Linux fundamentals etc.

I’ve been learning ML, along with the fundamentals of deep learning.

I’m now planning to build something hands-on projects around ASR/TTS, model deployment, ONNX, quantization, and inference on edge hardware.

I’d love to hear from people currently working in this space:

* What are you actually working on day-to-day in Edge AI or on-device ML?
* What skills and tools matter most in real industry projects?
* How should someone with my embedded background target relevant jobs and get interviews?
* Are strong projects and deployment experience enough to break in, or are there other gaps I should address?

I’m particularly interested in the intersection of embedded systems, deep learning, and hardware—not just general ML roles.

Any honest advice, experiences, or pointers would be really appreciated. Thanks!

Hi everyone, I'm an undergraduate Geophysics student, working on my final-year thesis. My work involves subsurface imaging, mostly with Python. I'm comfortable with programming, but I'm an absolute beginner when it comes to machine learning and deep learning.

I'd like to apply Implicit Neural Representations at one stage of my workflow, but I don't want to just copy code without understanding what's happening under the hood. So I'm looking to learn the fundamentals properly, from zero. Could you recommend: Books or courses for learning ML/deep learning fundamentals and a suggested learning path: what to study first, and what I can safely skip for now.

Thanks in advance

I've been working on krnl, a lightweight machine-learning library I've been building to understand and implement the fundamentals of neural networks myself.

It currently includes:

• A custom Tensor class with automatic gradient computation
• NumPy and OpenCL-backed computation
• Linear, ReLU and Sigmoid layers
• SGD, Adam, Muon and MuonWithAdamAux optimizers
• MSE, MAE and Huber loss functions

I also developed PyCLBlast for working with CLBlast through Python.

I'm interested in making the library useful for experimenting with neural networks while exploring GPU computation beyond CUDA.

I'd appreciate feedback, especially on the tensor API, autograd design, and OpenCL backend.

GitHub: https://github.com/helloadhavan/krnl/

PyPI: https://pypi.org/project/krnl/