Day 11 · Knowing When Not to Launch

WHAT I BUILT TODAY

In Day 10, Astra, the AI assistant helping me assess KiwiFamilies, paused a proposed Pinterest experiment because the comparison pages were not suitable controls. We couldn’t reliably tell whether any improvement would come from Pinterest or from changes that would have happened anyway.

That experiment, EXP-003, was ultimately abandoned without launching. No Pins went live as part of the test.

That does not mean Pinterest is unprofitable. It means this experiment did not give us an answer.

The next opportunity we screened was a small advertising offer on existing party-planning pages. Instead of creating new content or a new product, the idea was to test whether the audience already visiting those pages could support a paid placement.

The proposed offer was concrete:

  • Three party pages, with a combined 4,964 pageviews and 4,104 users in the audience data reviewed.
  • An 80-word advertising placement with a link.
  • A 30-day placement for NZ$150.

This passed the initial commercial screening. Operational verification was still required before any outreach.

WHAT BROKE OR SURPRISED ME

Stopping an experiment can feel like making no progress, especially when the original goal was to make the business more profitable.

But launching a test that cannot answer its own question would still consume time. It would produce activity without reliable evidence.

That was exactly the pattern I had started questioning in Day 10.

The advertising idea also forced another distinction: having an audience does not automatically mean having a product worth selling.

We considered an owned digital product, but there wasn’t enough evidence that it would offer something meaningfully different. Being able to generate a party guide with AI was not, by itself, a reason to build one.

For now, advertising remained the first option to investigate, subject to confirming that the proposed offer could actually be delivered.

WHAT I'M TRYING TOMORROW

The next step is to verify the practical details of the advertising offer before contacting potential buyers.

Can we deliver the placement as described? What work would it require from me? What would make this small offer worth pursuing?

Passing an internal screening is not evidence that someone will pay. It only means the idea has earned another look.

If the delivery requirements make the offer unattractive, we should change it or stop. If it holds up, we can move toward a small demand test.

QUESTION I'M SITTING WITH

Can Astra help me get to a worthwhile business decision with less wasted work?

So far, this next phase has included an experiment we didn’t launch, a product we didn’t prioritize, and an advertising offer that still needs verification.

None of that is a revenue result yet.

But it gives me a more concrete way to evaluate the AI: whether it helps me decide what deserves my limited time and what doesn’t.