A Practical Guide to Evaluation of LLM Apps (Part C)
Understanding evaluation of conversational LLM systems, toolcalls, tracing, and red teaming.
Lire
There are no heroes in commercial AI
When it comes down to it, Dario Amodei isn’t all that much different from Sam Altman
Lire
Anthropic Officially, Arbitrarily and Capriciously Designated a Supply Chain Risk
Make no mistake about what is happening.
Lire
Don’t trust Generative AI to do your taxes — and don’t trust it with people’s lives
“The problem comes down to how A.I. chatbots are fundamentally designed”
Lire
AI #158: The Department of War
This was the worst week I have had in quite a while, maybe ever.
Lire
Gemini 3.1 Pro Aces Benchmarks, I Suppose
I’ve been trying to find a slot for this one for a while.
Lire
A Tale of Three Contracts
The attempt on Friday by Secretary of War Pete Hegsted to label Anthropic as a supply chain risk and commit corporate murder had a variety of motivations.
Lire
Breaking: “sycophantic AI distorts belief, manufacturing certainty where there should be doubt”
LLMs are an epistemic nightmare
Lire
How AGI-is-nigh doomers own-goaled humanity
The road to where we are now was (mostly) paved with good intentions — but mixed with too much uncritical acceptance of hype.
Lire
Import AI 447: The AGI economy; testing AIs with generated games; and agent ecologies
What might a superintelligence arcology be like?
Lire
Secretary of War Tweets That Anthropic is Now a Supply Chain Risk
This is the long version of what happened so far.
Lire
Is AI already killing people by accident?
The writer Tyler Austin Harper (of The Atlantic, etc.) sent me a thread this morning, asking whether a mistargeting yesterday that killed nearly 150 school children in Iran could have been the result of AI.
Lire
Did Trump just overplay his hand?
We will learn a lot about Silicon Valley in the upcoming days
Lire