Where we fall short
Cost and slow calls missed the goal. All of them: About page.
All 12 limits, with the numbers
- Cost missed the goal. $0.00107 a pass for the clue calls (target $0.00100; up to $0.00111 if 4 timed-out calls were billed in full). The trip tips add one more short call.
- Some clues are still vague. 13 of 123 printed Wild Finds, like "Check for a small bird that is yellow."
- Some clues repeat across parks. 1.6% of printed clues (target 5%: met; 4.1% the run before).
- Model speed depends on DigitalOcean. 9.5 s typical, 25.3 s slow (target 10 s / 20 s: typical met, slow missed; 9.9 s typical the run before). A first call gets up to 40 s: in 60 test runs (53 passes; 6 runs on the 2 no-data parks made none), 3 first calls hit the limit and 1 run was lost (0 the run before).
- Some passes come out short. 90.2% of data-rich test runs made a complete pass (target 90%: met); a short one says how many finds are missing.
- The kid check is not done yet. Planned for Sunday, Oct 11, on Kevin's park walk; still pending.
- Lucky Finds run on a free plan. 25 searches a day; a count is a "maybe", not a promise.
- Public map servers can be busy. Mostly US evenings: search falls back to a saved Dallas-area list.
- Find This Spot is not in the eval. No map data was recorded for the test parks.
- Self-hosting on a laptop CPU is slow. We ran the small Gemma 4 E2B (gemma4:e2b-it-qat, Apache-2.0) with Ollama on a Windows laptop CPU (Intel Core Ultra 7 155H, 32 GB RAM, no GPU), on 5 test parks, for $0. With a 70 s limit per model call (the most the app allows; the hosted site gives a first call 30-40 s), 0 of 5 passes were complete: 3 ran out of time and the other 2 came out short. Given more time (an eval-only setting), 4 of 5 were complete, 96.7% of clues quoted their source, reading grade 2.9, 0 risky species printed, at 59.3 s a typical call (hosted Gemma 4 31B: 9.5 s). The app now has a longer clock for a model on your own computer (LOCAL_MODEL_TIMEOUT_MS, off by default): in one browser try, a Celebration Park pass came out with 7 of 8 finds and its map in 96 s (2 model calls). The model used about 5-6 GB of RAM.
- After 1 free pass a day, a grown-up signs in. 5 new passes a day each; judges can press "Try as a judge".
- The model runs on DigitalOcean's servers. The park facts and age band leave your device.