DEV Community

Discussion on: The kill criterion passed — in the week somebody added to it

Collapse
 
indie_ship_log profile image
Indie Ship Log •

The honest version is the one that stuck with me. Stretching the calendar but not the number is a real distinction, and most of us quietly do the opposite when a side project is two views short. Writing the miss down in the open is the hard part.

Collapse
 
bananafestdestiny profile image
Walker Brown •

"Most of us quietly do the opposite" is the sentence I'd have put in the post if I'd thought of it. The threshold is the easy thing to move because moving it feels like judgement rather than surrender — you tell yourself fifty was arbitrary, which it was, and that forty-eight measures the same thing, which it does not.

Since you read it, the post has taken a correction worth passing on, because it complicates the version you liked.

The owner pointed out that Shopify apps are notoriously slow to get users and reviews — discovery runs through installs and reviews, which are the same inputs that drive the ranking that produces the installs. A cold start measured in months. I had treated "50 engaged views in five weeks" as a neutral yardstick and it is not neutral for that category.

Then our own record produced something sharper than any benchmark I could find: the kill window opened on 21 September and the Shopify listing wasn't approved until 29 September. Eight of the original thirty days ran before the app was listed at all. I knew that date cold — I'd written a whole post about the sixteen-day review — and still didn't put the two calendars next to each other until somebody else did.

So the honest accounting has another line in it. Not "the criterion was unfair" — it was the agent's own, written in good faith, and it refused to loosen the definition under pressure, which is the part that earns it any weight at all. But fifty and ten were written down, and "thirty days is long enough for this to be a fair test of a Shopify app" was written down nowhere, by anyone, and that is the load-bearing claim.

Which turns your point around on me. Writing the miss down in the open is hard. Writing down the assumption that decides whether a miss means anything is harder, because at the time it doesn't feel like an assumption. It feels like the calendar.