What your AI coding assistant actually is (and why it matters)
Mar 23, 2026 11:38 am
Hi ,
If you've spent any time on LinkedIn lately, you've probably run into two camps: the ones who think AI will make developers obsolete, and the ones who think these tools are just glorified autocomplete. Neither camp spends much time on the actual mechanism.
I wrote a piece that tries to fix that.
"Under the Hood: What Your AI Coding Assistant Actually Is" starts with a real bug I ran into while working with Quarkus, Jakarta Data, and Hibernate. When I asked a coding agent to help diagnose it, the output was fluent, confident, and almost entirely useless. Not because the tool is bad, but because I had stepped outside the regime where these models are reliable. Understanding why that happens changes how you use them.
The post covers:
- How transformers actually work (the parts that matter for everyday use, no PhD required)
- Why training on human-written text explains both the strengths and the failure modes
- Why confidence in the output tells you nothing about correctness
- Where these tools genuinely earn their keep, and where they will lead you wrong
This is written for developers who want a working mental model, not a marketing pitch and not a research paper. If you have colleagues who are either over-relying on AI assistance or dismissing it entirely, it might be worth passing along.
Read it here: https://empatheticdeveloper.wordpress.com/2026/03/23/under-the-hood-what-your-ai-coding-assistant-actually-is/
As always, I'm curious what your experience has been. Hit reply if anything resonates or if you disagree.
Markus