Charlie Tolleson

Hi, I'm Charlie, a multidisciplinary data scientist building the measurement frameworks that decide a business's next move. Now prototyping and launching products with AI.

Currently freelancing and open to new roles

Previously a senior data scientist at @Meta, @Amazon, and @IBM

Setting the Launch Bar for AI @Meta

Evals Lead · 2026

Seven teams were building agents for thousands of ad sellers. I set the bar they had to clear to launch.

AI workflows held to one launch bar
7
eval criteria on one dashboard
~100
people across eight teams aligned
30+
Facts match sourcesbar 99%Right recipientbar 99%Next steps match callbar 95%Numbers match call3 days below bar

Making an Org Agent-Ready @Meta

Framework Author · 2026

Agents trust everything they read. I wrote the standards that make it worth trusting.

person org it was presented to
50+
metrics and data fields given specs
25+
teams adopted it on their own
No mandate
Sales leader$118.9MFinance partner$104.1MProduct analyst$106.0Mthe spec: $98.6M

Orchestrating a Team of Models

Creator & Architect · 2026

Hyperion, my multi-agent orchestrator: every task a graph, every step on the model that fits it.

specialist agents for every role
Custom
per step, with config and callbacks
Any model
of every step, for deep diagnostics
Full trace
Market Sizing: Market Analyst · gpt-4oresearcherworkMarket SizingDomain Expert: Domain Expert · gpt-4oresearcherworkDomain ExpertLegal Expert: Legal Analyst · gpt-4oresearcherworkLegal ExpertMarket Trends: Trend Researcher · gpt-4oresearcherworkMarket TrendsCompetitive Landscape: Competitive Analyst · gpt-4oresearcherworkCompetitive LandscapeResearch Synthesis: Synthesizer · gemini-2.5-prosynthesizersynthesizeResearch SynthesisCritic: Critic · gpt-4ocriticworkCriticAdvocate: Advocate · gemini-2.5-prosynthesizerworkAdvocatePlanner: Planner · smartplannerplanPlannerDeveloper: Technical Lead · workerdeveloperplanDeveloperAssessor: Assessor · gpt-4ocriticsynthesizeAssessorVerdict: Verdict Writer · gemini-2.5-prosynthesizersynthesizeVerdict

scroll the diagram sideways →

Building in Stealth

Founder · In development

My own AI product, for an industry most software has passed by. Ask me for a private walkthrough.

ProblemWhy nowMarketBusiness modelCompetitionLaunch plan

What Moves the Metric @Meta

Data Science Lead · 2026

They couldn't move the metric. I built a causal inference agent to test every hypothesis.

hypotheses tested
50+
per hypothesis, down from a week
Minutes
reprioritized by region and company size
Sales plays
+2.3+4.7-0.5+1.5+1.9+5.3-0.4+1.7+1.9+4.2-1.3+0.8

Metric Forensics @Amazon & @Meta

Data Science Lead · 2025

Don't know what happened? I built a one-stop-shop framework+agent to tell you.

headwinds traced to exact causes at Amazon
Weekly
reports the agent replaced at Meta
~30
of data science time saved
~30 weeks
0+10.1APAC+2.3North America-5.1Europe-55.2LATAM-48.0Totalbps

Finding the Story @IBM

Data Science Lead · 2019

Anything can break a supply chain. I built a graph that finds the story before the alert exists.

global news stream
Live
person team led
6
published internally at IBM
Paper