C-TIER platform
PostHog as agent observability — sponsored pitch for a self-learning company
100k ft — What is this?
PostHog as agent observability — sponsored pitch for a self-learning company
50k ft — Why care?
This is a sponsored PostHog video. It pitches putting all company data in one place, pointing an AI agent at it to find what's broken, and installing PostHog on your agents to watch their outputs and failures. The one useful line is to let AI measure while humans make the judgment calls.
10k ft — Key takeaways
• Instrument agent outputs the way you'd instrument a product.
• Labeled #ad, so read it as a sponsored PostHog pitch.
• Use AI to measure, and keep decisions about fixes with a human.
5k ft — Tools & techniques
PostHog
AI agents, MCP, agent observability
1k ft — Deep-dive / try it
Comment “agent” and I’ll send you a guide on how to do this. Shout out posthog for sponsoring this vid!
#ai #agent #ad
Transcript excerpt
Proud you want to know the weirdest thing? Companies are ripping out their MCP servers and replacing it with a self-learning database. Go and look this up, right? Everybody is trying to build a self-learning AI company. Oh, and the world does one do that. Take all your data and put it in one place. I'd just use this, but now your source of truth for everything that happens in your company. Point any AI agent at this database. Talk as a built-in one, just use this. Ask the agent to go through that data and tell you what the fuck is going wrong. And say the thing that's going wrong is sales. So go to whatever AI agent is helping with sales. Install post-hog on that agent. Now you're watching the agent's output. How it works, where it goes wrong. How you have two layers of data or business stuff. Agent data can give your AI a prop like this one. You can figure out what's wrong with your data and then figure out why an agent is messing up in the same prompt. Times the fix is to just rewrite a prompt somewhere. Sometimes it's to build something completely new. Yes, who's going to make that decision? You, bro, not the AI agent. Guys fucking horrible at creativity. This is the hill that I will die on, bro. Measuring things can be automated, but AI rarely has good ideas. So use it to measure not to make the judgment.
Appears in
More from @angus.sewell
- B-TIER AI networking for job referrals — archetype-based LinkedIn outreach
- B-TIER Chat-history mining — derive better custom instructions from your AI logs
- A-TIER Fish Audio phone agent — AI receptionist that gathers context then hands off
- B-TIER Clipper outreach agent — Roy Lee's pay-per-view clipping army, automated
- A-TIER Anthropic job index audit — map your tasks to automation vs augmentation