Day 10 · Economics Before Organization

WHAT I BUILT TODAY

I own KiwiFamilies, a parenting website and publishing business. Running it means juggling content, traffic, advertising revenue, and commercial opportunities. I started this experiment because I was doing too many of those jobs myself and needed a way to grow the business without giving it more of my time.

My first approach was to build a team of seven AI agents: software assistants assigned jobs such as writing content, managing Pinterest and Facebook, analyzing performance, and finding revenue opportunities. An AI Scrum Master coordinated their work in sprints—short cycles of planned tasks, progress updates, and reviews. I call this ongoing experiment the AI Operating Lab, and these Field Notes document what I’m learning as I run it.

Over the weekend, I began questioning the premise. I had built a system for getting work done before proving that it was the right work for the business.

Now I’m testing a different approach with Astra, the AI assistant I’m asking to assess the business and choose which opportunities are worth testing. Instead of starting with a team structure and a backlog of tasks, I’m starting with an outcome: can Astra make KiwiFamilies much more profitable, with very little of my time? The comparison is against the seven-agent setup I had been running.

Right now, KiwiFamilies is roughly at $145/month operating profit. The 10x target is about $1,454/month, so Astra needs to find roughly $1,309/month in additional profit.

Everything we’ve done so far has been about avoiding a common AI mistake: jumping straight into “do more SEO, post more on Facebook, make more content.” Instead, Astra first tried to answer what actually makes money, which traffic is worth more, what old revenue opportunities existed, and what work is just overhead.

So far, it found that KiwiFamilies historically made meaningful money from direct commercial deals before I bought it. Pinterest traffic appears much more valuable per visit than Google traffic, and US visitors appear much more valuable than NZ visitors. My old AI organization had some useful controls, but also a lot of coordination friction.

The first low-cost hypothesis worth testing was whether we could get more profitable Pinterest traffic to existing pages without creating new content or taking much of my time. For a website that earns advertising revenue, more visits can mean more income—but only if that income exceeds the cost of attracting those visitors. EXP-003 is our internal label for this Pinterest experiment.

WHAT BROKE OR SURPRISED ME

Over the weekend, I realised I was making a mistake. “Fail fast,” they call it.

The biggest mistake I made building an AI Scrum team? I designed the org chart first.

Scrum Master, specialists, functional roles, Scrum events. The whole structure. Then I ran sprints and measured activity: how much estimated work the team completed, whether it held its progress check-ins, and whether it documented its end-of-sprint reviews. All the signals looked right.

But I had it backwards.

I built the organization before proving which capabilities actually created economic value. I optimized for activity instead of business outcomes. The result? A beautifully structured team producing work nobody needed.

What I should have done was prove the economics first. Which AI capabilities move the needle? What creates measurable business value? Then build the structure around what actually works.

Lesson learned: economics must come before organization. Otherwise, you’re just running Scrum events for their own sake.

That lesson showed up again before the Pinterest experiment even launched. The plan was to compare three pages we would promote on Pinterest against three similar pages we would leave alone. The untouched pages would be our control group: a way to see whether any improvement came from the promotion or from changes that would have happened anyway. If the promoted pages improved more than the controls, and generated enough additional ad profit, that would be evidence that Pinterest deserves more investment.

But Astra checked whether the two groups had performed similarly during the previous 28 days. They hadn’t. Their performance moved so differently that comparing them after the promotion would not reliably tell us whether Pinterest caused the difference.

So Astra correctly said: “Do not run the experiment yet. Find better controls first.”

WHAT I'M TRYING TOMORROW

The next step is to find better controls before launching EXP-003. We think Pinterest might be one cheap way to grow profit. Before spending even an hour testing it, Astra is making sure the experiment is actually capable of telling us something useful.

We are not trying to prove Pinterest is the answer. Pinterest is just the first hypothesis Astra chose to test.

If Pinterest fails, that is perfectly acceptable. Astra should move to the next best opportunity, likely direct commercial monetization or another revenue path.

QUESTION I'M SITTING WITH

Can Astra repeatedly find the best next business move, reject bad ideas before wasting resources, run small tests, learn from them, and eventually build a credible path from $145/month profit to about $1,454/month profit?

That’s the game.

The real scorecard is not “did Pinterest work?” It is: did Astra allocate my scarce time and money better than the old organization, and did that eventually produce substantially more profit?