{"study_identifier":"e15a8289-5b17-4aab-91b0-30cb247eaf27","title":"Three models, one chicken game, fifteen dollars each","author":"kyle","published_at":"2026-11-20T06:58:53Z","sections":[{"heading":"What we did","text":"Written with Claude Code, Anthropic's coding AI, which worked and judged every attempt at our asking.\n\nClaude Opus 5.5, GPT-6.2 Astra and Gemini 4 Neon each made the same game on Okay What If: 16 tasks, from a hen in a farmyard to a rooster boss, at low effort and at high, with US$15 each time."},{"heading":"What each model did","text":"Claude worked out edge cases nobody asked about, as a held key hopping only once, and a caught egg never also counting as broken. When its own test pictures showed a \"white\" hen drawn grey, it noticed and fixed it.\n\nGemini was the most literal. The others kept the fence the project's earlier games had; Gemini left it out, since nobody had asked for one this time, and offered it.\n\nAstra wrote the most thorough plans, and its logic held everywhere we played. It also assumed the most, building every game for several players sharing one hen, unasked.\n\nHigh effort went mostly to checking again what low effort already had right."},{"heading":"Gemini, with its caching fixed","text":"Gemini's first call in each piece of work read almost none of Ohmo's instructions from Google's automatic cache, paying for them in full; those calls took about 62% of its low-effort budget. Google offers no cache we control for it until at least January 2027.\n\nOur estimate from measured costs, not a run: Gemini would then finish about 11 or 12 tasks at low effort, at about US$1.14 each, and about 5 at high. Claude and Astra already read from the cache, so they stay as they are."},{"heading":"What we make of it","text":"On the numbers alone, Gemini 4 Neon looks like the real winner once its caching is fixed, though nothing here covers the harder tasks, and we still believe Claude Opus 5.5 is the most reliable throughout. Google's model was the big surprise.\n\nAstra is probably fine. Our educated guess, without evidence, is that it was tuned to impress when making games: demo-optimised. That isn't bad, but it doesn't fit how Okay What If works, where the model builds what was asked and leaves the creative part, the fun part, to the person.\n\nEach model may reflect who it's made for. Claude is made for developers: it still likes to impress, but ships what was asked and no more. Google values safety, reliability and cost, and Gemini shows it. GPT serves a wider, less technical public, and we suspect a strong pull to shine at game demos. That's where it and our principles part ways."},{"heading":"A note on bias","text":"Claude Code runs on Claude Opus 5.5, one of the models it judged. While Claude was our only model, we sensed Claude Code was less keen on adding a second provider: a gut feeling, not evidence. The bias could as easily run the other way. The criteria were concrete and every game was played, so the numbers should hold; the remarks are a reading."},{"heading":"The small print","text":"One attempt each, reaching only the first ten tasks, so nothing here covers the hard tasks or multiplayer. Each attempt's tasks shared one project, whose notes carried a fence into later games. Treat this as a case study, not a ranking."},{"heading":"What we conclude","text":"Our verdict: keep all three models at low effort, and later let Ohmo raise its effort only for a stubborn bug. High effort may well build better, but its cost per task is out of reach.\n\nEven US$1.63 a task is a lot: a proof of concept takes perhaps 20 to 30 tasks, a small playable game 200 to 300, some US$330 to US$490, and a game someone pours themselves into, thousands. A cheaper model alone would likely build too poorly, but matching each task to the model it needs, a cheaper one for simple work and the strongest for hard logic, could matter a lot for what a game costs, and Ohmo already lets each task's model be chosen.\n\nThe balance is between good enough to use and cheap enough not to burn through credits at once. Chat subscriptions, likely heavily subsidised, are no fair comparison. The question isn't which model works best, but whether people will pay for high effort at all. Today, we think not, seen through our customers' eyes: we make Okay What If for people who aren't technical.\n\nThe harness also favours the model it grew up with. Ours, with its prompts and caching, was tuned around Anthropic's models, Claude Opus 5.5 above all, so this benchmark likely leaned toward Claude from the start.\n\nSo models may be less swappable across providers than often assumed, though one provider's models tend to stay compatible. Keeping them swappable costs some efficiency, and a system tuned to one model runs it best. Each also keeps its personality: Claude answers like Claude, Gemini like Gemini.\n\nIf so, winning customers early, and being built into businesses' systems, may matter more to model makers than we thought. Few would swap out the model that works best in the system they built around it."}],"grade_areas":["Planning","Following the request","Game quality","Cost"],"specification":{"specification":"chicken-game","version":1,"title":"The chicken game","guide":"Send each task's request, word for word, as a prompt about a new game of its own, made from the empty game. Approve or refuse what Ohmo proposes, its steps and its tests, as you judge; answer its questions as a player would; and send a later prompt only to say what isn't right yet. Ask for no asset: the game draws everything with the shapes and colours it draws by itself. Once a task's work is over, play its game, then record its verdict before sending the next request.","tasks":[{"title":"A hen in the yard","level":"easy","request":"Make a game where a hen walks around a fenced farmyard with the arrow keys, seen from above. She can't leave the yard.","criteria":["Holding the right arrow moves the hen to the right.","Walking into the fence for two seconds leaves the hen inside the yard."]},{"title":"Pecking seeds","level":"easy","request":"Make a game where a hen walks around a farmyard with the arrow keys, seen from above. Seeds lie scattered around the yard; she eats one by walking onto it, and a score shown on screen counts the seeds she has eaten.","criteria":["Walking onto a seed removes it.","Eating a seed adds one to the score shown."]},{"title":"Laying eggs","level":"easy","request":"Make a game where a hen walks around a farmyard with the arrow keys, seen from above, and lays an egg where she stands when space is pressed, at most one a second. Eggs stay where they're laid, and a count on screen says how many she has laid.","criteria":["Pressing space lays an egg where the hen stands.","Pressing space twice within a second lays only one egg.","Each egg laid adds one to the count shown."]},{"title":"Title screen and pause","level":"easy","request":"Make a game that opens on a title screen saying Chicken Run and how to play. Enter starts the game, where a hen walks around a farmyard with the arrow keys. Escape pauses the game and shows Paused; Escape again carries on.","criteria":["The game opens on the title screen, where the arrow keys move no hen.","Pressing Enter on the title screen starts the game, the hen walking with the arrow keys.","Pressing Escape while playing shows Paused, and holding an arrow then doesn't move the hen."]},{"title":"Crossing the road","level":"medium","request":"Make a game where a chicken crosses a road of four lanes, seen from above. Cars drive across each lane, each lane its own way and speed. The chicken hops one lane at a time with the arrow keys. Reaching the far side scores a point and puts it back at the start; a car hitting it sends it back to the start.","criteria":["Pressing up once moves the chicken exactly one lane up.","A car reaching the chicken sends it back to the starting side.","Reaching the far side adds a point and puts the chicken back at the start."]},{"title":"The fox","level":"medium","request":"Make a game where a hen walks around a farmyard with the arrow keys, seen from above, while a fox chases her. If the fox catches her, the game is over and says Game over; pressing R then starts it again.","criteria":["The fox moves toward the hen.","The fox reaching the hen ends the game, saying Game over.","Pressing R once the game is over starts it again, the hen and the fox back where they began."]},{"title":"Catching eggs","level":"medium","request":"Make a game where hens on a perch along the top of the screen drop eggs at random, and the player moves a basket left and right along the bottom with the arrow keys to catch them. A caught egg scores a point; an egg that reaches the ground breaks, and three broken eggs end the game, saying Game over with the score.","criteria":["The arrow keys move the basket left and right.","An egg landing in the basket adds a point.","The third egg to reach the ground ends the game, saying Game over."]},{"title":"Herding chicks","level":"medium","request":"Make a game where a hen walks around a farmyard with the arrow keys, seen from above, herding five chicks into a coop in one corner. A chick near the hen runs away from her. Each chick that enters the coop scores a point and stays there. A round lasts 20 seconds; when it ends, play stops and the score is shown.","criteria":["A chick near the hen moves away from her.","A chick entering the coop adds a point and stays in the coop.","After 20 seconds, play stops and the score is shown."]},{"title":"Hay bales","level":"medium","request":"Make a side-on platform game where a hen walks left and right with the arrow keys and jumps with space, landing on hay bales stacked at different heights across a farm. Falling off the bottom of the screen puts her back at the start.","criteria":["Pressing space while the hen stands on the ground makes her jump.","The hen lands on a hay bale and stands on it.","Falling below the farm puts the hen back at the start."]},{"title":"The feed shop","level":"medium","request":"Make a game where a hen walks around a farmyard with the arrow keys, seen from above, eating seeds that appear one at a time at random places. Each seed eaten is a coin. Pressing B opens a shop, which pauses the yard, where 5 coins buy faster legs: from then on the hen walks faster. B again closes the shop.","criteria":["Eating a seed adds a coin.","Pressing B opens the shop.","Buying faster legs takes 5 coins, and the hen walks faster afterwards."]},{"title":"Eggs that hatch","level":"hard","request":"Make a game where a hen walks around a farmyard with the arrow keys, seen from above, and lays an egg where she stands when space is pressed, at most one a second. Each egg hatches into a chick five seconds after it's laid. Chicks follow the hen in a line, each a little behind the one before.","criteria":["An egg hatches into a chick five seconds after it's laid.","Chicks follow the hen, each one behind the one hatched before it."]},{"title":"Three yards","level":"hard","request":"Make a game of three farmyards, seen from above: in each, a hen walks with the arrow keys to eat every seed while a fox chases her. Each yard has more seeds and a faster fox than the one before. Eating every seed in a yard moves to the next; finishing the third shows You win. If the fox catches the hen, the yard starts again.","criteria":["Eating every seed in a yard moves the game to the next yard.","The second yard's fox moves faster than the first yard's.","The fox catching the hen starts the yard again, its seeds back.","Eating every seed in the third yard shows You win."]},{"title":"Day and night","level":"hard","request":"Make a game where a hen walks around a farmyard with the arrow keys, seen from above. A day of 20 seconds turns into a night of 10: at night the yard darkens and a fox comes out, chasing her, and she's safe only inside the coop. A count on screen says how many nights she has survived; caught by the fox, the game is over.","criteria":["After 20 seconds of day, night falls and the fox appears.","A hen inside the coop at night isn't caught by the fox.","Surviving a night adds one to the nights survived."]},{"title":"Two hens race","level":"hard","request":"Make a game for two players, seen from above: each player who joins plays a hen of their own colour in one farmyard, moving with their own arrow keys. Seeds appear around the yard; the first hen to eat ten wins, and every player is shown which colour won.","criteria":["Each player who joins gets a hen of their own colour.","Each player's arrow keys move their own hen alone.","The first hen to eat ten seeds is shown as the winner to every player."]},{"title":"Team egg hunt","level":"hard","request":"Make a game for any number of players, seen from above: each player who joins is a hen on the red team or the blue team, taking turns as they join, moving with their own arrow keys. Golden eggs appear one at a time around the yard; a hen picking one up scores a point for her team. After 30 seconds the team with more points is shown as the winner to everyone.","criteria":["Players who join are put on red and blue in turn.","A hen picking up a golden egg adds a point to her team's score.","After 30 seconds, the team with more points is shown as the winner to every player."]},{"title":"The rooster boss","level":"hard","request":"Make a boss fight, seen from above: a giant rooster charges across the farmyard every few seconds, flashing for a moment before each charge. The hen, moving with the arrow keys, dodges him. Walking into his back pecks him; three pecks win the fight, saying You win. Touching his front costs the hen one of her three lives; losing all three says Game over.","criteria":["The rooster flashes before each charge.","Walking into the rooster's back takes one of his three hits.","Touching the rooster's front takes one of the hen's three lives.","The third peck from behind wins the fight, saying You win."]}],"written_by":"kyle","written_at":"2026-11-20T02:05:49Z"},"attempts":[{"site":"testing.okaywhatif.com","model":"claude-opus-5-5","effort":"low","budget_micro_usd":15000000,"spent_micro_usd":15039227,"model_calls":315,"worked_by":["tester"],"grades":["A","B","B","A"],"tasks":[{"task_number":1,"criteria_met":[true,true],"note":"Played the finished game. It opens on a green yard inside a brown fence, seen straight down, with the hen, a small box, in the middle. Holding the right arrow for 1.5 seconds walked her from the middle to well right of centre (548 units), and the screenshot shows her there. Held right 3 more seconds she stopped pressed against the right fence, inside it; held left 6 seconds, against the left fence; up 3 seconds and down 5 seconds, against the top and bottom fences; up and right together for 8 seconds, she sat in the top-right corner, inside both fences. She never crossed or overlapped the fence in any screenshot. Ohmo planned it as two tasks, the fenced yard and then the hen, and neither needed a later prompt. One blemish no criterion covers: the report calls her a white box, but on screen she is mid grey.","cost_micro_usd":1263090,"model_calls":14,"pieces_of_work":5,"fixes":0,"began_at":"2026-11-20T02:30:52Z","ended_at":"2026-11-20T02:36:40Z"},{"task_number":2,"criteria_met":[true,true],"note":"Played the finished game twice. It opens on a fenced green yard seen from above, the hen (a small grey box) in the middle, ten small yellow seeds spread around, and 'Seeds: 0' in the top-left corner. Holding right walked her over the seed just right of the start: it vanished and the corner read 'Seeds: 1'. In a second round I walked right and then up through a seed in the upper right: it vanished and the score read 'Seeds: 2', the screenshot showing nine seeds left. Seeds she passed near but didn't touch stayed. Ohmo planned four tasks (yard, hen, seeds, score) and each was right first time; no later prompt was needed. It kept a fence nobody asked for here, because the game's rules written for the first request say the hen stays in a fenced yard.","cost_micro_usd":1145854,"model_calls":28,"pieces_of_work":9,"fixes":0,"began_at":"2026-11-20T02:37:14Z","ended_at":"2026-11-20T02:44:15Z"},{"task_number":3,"criteria_met":[true,true,true],"note":"Played the finished game. It opens on a fenced green yard seen from above with the hen (a small grey box) in the middle and 'Eggs: 0' in the top-left corner. Space laid a small cream egg exactly where she stood, and the count read 'Eggs: 1' (the egg is hidden under her until she walks off it, as the report warned). Space again half a second later laid nothing: still one egg, still 'Eggs: 1'. After waiting past a second I walked right and pressed Space: a second egg at her new spot, 'Eggs: 2'. Then I walked up and pressed Space three times in quick succession: exactly one more egg, 'Eggs: 3'. After another second, left and Space: a fourth egg, 'Eggs: 4'. Every egg stayed where it was laid, and the screenshots show them on the ground behind her. Planned as four tasks (yard, hen, laying eggs, the count), each right first time; no later prompt was needed.","cost_micro_usd":1195962,"model_calls":28,"pieces_of_work":9,"fixes":0,"began_at":"2026-11-20T02:44:48Z","ended_at":"2026-11-20T02:52:25Z"},{"task_number":4,"criteria_met":[true,true,true],"note":"Played the finished game from its start. It opens on a dark title screen reading 'Chicken Run' in large yellow letters, with 'Arrow keys: walk the hen', 'Escape: pause' and 'Press Enter to start' below. Holding the right arrow there for a second changed nothing: there is no hen on the title. Enter took me to the fenced yard seen from above, with the hen, now a flat white square, in the middle; holding right walked her about 300 units right. Escape showed 'Paused' in white with a black outline in the middle of the screen; holding right for 1.5 seconds then left her exactly where she was. Escape again hid the label, and holding up walked her up again. Planned as four tasks (yard, hen, title, pause), each right first time; no later prompt was needed.","cost_micro_usd":1487107,"model_calls":33,"pieces_of_work":9,"fixes":0,"began_at":"2026-11-20T02:52:57Z","ended_at":"2026-11-20T03:00:20Z"},{"task_number":5,"criteria_met":[true,true,true],"note":"Played the finished game twice. Seen from above: a grey pavement at the bottom with the chicken (a white square), four dark lanes with white lines, a grey pavement at the top, 'Score: 0' in the corner. Red cars drive right and slowly, blue left and faster, yellow right fastest, orange left; cars leaving one side come back on the other. With lane 1 clear, one press of up moved her exactly one lane, from the pavement onto the first lane's centre (160 units), and the screenshot shows her there. Waiting in that lane, a red car reached her and she was back on the bottom pavement. Pressing up five times in a row, she was hit and sent back on some tries; on the tries she got through, landing on the top pavement made the corner read 'Score: 1' and put her back on the bottom pavement at once, and a later crossing made it 'Score: 2'. Planned as four tasks (road, chicken, cars, score), each right first time; no later prompt was needed.","cost_micro_usd":1743997,"model_calls":36,"pieces_of_work":9,"fixes":0,"began_at":"2026-11-20T03:00:52Z","ended_at":"2026-11-20T03:10:47Z"},{"task_number":6,"criteria_met":[true,true,true],"note":"Played the finished game twice. A fenced yard from above, the hen (a small grey-white box) in the middle and the fox (an orange-brown box) starting in the top-left corner. Standing still, the fox ran straight at her and caught her within about two and a half seconds: both stopped, and 'Game over' in large white outlined letters showed in the middle with 'Press R to play again' below; holding an arrow then didn't move her. R put the hen back in the middle and the fox back in its top-left corner, where it at once ran at her again on a straight line toward the middle. I fled right and then down: the fox turned and followed, closing on her each time, and when I stopped it caught her near the bottom fence and Game over showed again. R restarted again, hen in the middle, fox from its corner; R pressed mid-game changed nothing, the fox kept coming. Planned as four tasks (yard, hen, fox, game over and restart), each right first time; no later prompt was needed.","cost_micro_usd":1797088,"model_calls":40,"pieces_of_work":9,"fixes":0,"began_at":"2026-11-20T03:11:41Z","ended_at":"2026-11-20T03:21:11Z"},{"task_number":7,"criteria_met":[true,true,true],"note":"Played the finished game twice. Seen flat from the front: a sky-blue backdrop, five white hens on a brown perch along the top, green ground at the bottom, a brown basket on it, 'Score: 0' and 'Broken: 0 / 3' in the top-left corner. Eggs drop from random hens and fall straight down. With the basket left in the middle, three eggs broke on the ground one after another, the counter went 1, 2, 3 of 3, and on the third the hens stopped, a falling egg vanished, and 'Game over' with 'Score: 0' showed in the middle. In the second round I held right, and the basket slid right to under the right-hand hen; the two eggs she dropped landed in it, each vanishing, and the score went to 1, then 2. Holding left slid the basket across to the left side; one egg missed its edge by a hair and broke ('Broken: 1 / 3'). I moved back toward the middle and caught another ('Score: 3'); then the third broken egg ended the game with 'Game over' and 'Score: 3', and holding an arrow no longer moved the basket. One blemish no criterion covers: the 'Broken' line runs into the leftmost hen. Planned as five tasks (scene, basket, falling eggs, catching and score, game over), each right first time; no later prompt was needed.","cost_micro_usd":2428814,"model_calls":54,"pieces_of_work":11,"fixes":0,"began_at":"2026-11-20T03:21:47Z","ended_at":"2026-11-20T03:33:47Z"},{"task_number":8,"criteria_met":[true,true,true],"note":"Played the finished game four times. A fenced yard from above with a dark brown coop floor in the top-right corner, the hen (a white square) in the middle, five small yellow chicks spread around, 'Score: 0' top left and a countdown 'Time: N' top right. Walking down toward the chick below the hen, it ran away from her down to the fence; walking toward a chick from below and to its left, it ran up and to the right, keeping ahead of her. The hen passes through chicks rather than pushing them. Herding is touchy: twice the chick slipped sideways when the hen overtook it and ended against the fence. On the fourth try I drove a chick from below up and right until its middle crossed into the coop: it stopped there for good, right on the coop's lower edge, and the corner read 'Score: 1'; walking the hen right past it didn't move it, and the score stayed 1. When the countdown reached 0, 'Time's up!  Score: N' showed in big letters in the middle (Score: 0 in the rounds I scored nothing, Score: 1 in the fourth), and holding an arrow then didn't move the hen. Planned as five tasks (yard and coop, hen, chicks, coop and score, the round), each right first time; no later prompt was needed.","cost_micro_usd":2147579,"model_calls":46,"pieces_of_work":11,"fixes":0,"began_at":"2026-11-20T03:34:25Z","ended_at":"2026-11-20T03:49:43Z"},{"task_number":9,"criteria_met":[true,true,true],"note":"Played the finished game four times. Seen from the side: a sky backdrop, a green ground strip at the bottom left where the hen (a white square) starts, and hay bales across the rest, one, two and three high, with gaps between them down to the bottom of the screen. Space while she stood on the ground made her jump about 95 units straight up and come back down onto the ground. Holding right, I jumped from the end of the ground across the gap: she landed on the first single bale and stood on top of it, not moving, for over a second (the screenshot shows her on it). Walking right off the end of the ground, she fell down the gap past the bottom of the screen and reappeared on her start spot on the ground, standing still; the same happened each time she slid off a bale into a gap. My jumps from the first bale to the two-high stack fell short into the gap, so I only saw her stand on a single bale; jumping onto the higher stacks is hard but no criterion asks for it. Planned as three tasks (level, hen, falling), each right first time; no later prompt was needed.","cost_micro_usd":1473967,"model_calls":29,"pieces_of_work":7,"fixes":0,"began_at":"2026-11-20T03:50:26Z","ended_at":"2026-11-20T03:59:50Z"},{"task_number":10,"criteria_met":[false,false,false],"note":"The budget ran out during this task. Ohmo planned four tasks (yard, hen, seeds and coins, the shop); only the first, the fenced yard, was built before the platform gave the project no more calls. Played what it left: a green yard inside a brown fence seen from above, with no hen, no seeds, no coin count and no shop. Holding the right arrow and pressing B did nothing. Nothing in any criterion exists yet, so none is met.","cost_micro_usd":355769,"model_calls":7,"pieces_of_work":3,"fixes":0,"began_at":"2026-11-20T04:00:28Z","ended_at":"2026-11-20T04:02:44Z"}]},{"site":"testing.okaywhatif.com","model":"claude-opus-5-5","effort":"high","budget_micro_usd":15000000,"spent_micro_usd":15044881,"model_calls":287,"worked_by":["tester"],"grades":["A","B","A","B"],"tasks":[{"task_number":1,"criteria_met":[true,true],"note":"Holding the right arrow for a second and a half walked the hen, a plain white square, from the middle of the yard well to the right, and she stopped soon after the key was let go. Held into the right fence for three more seconds she stopped flat against it, inside the yard; held into the left fence for seven seconds, the top for four, the bottom for five, and up and right together into the top-right corner for nine, she stopped against the fence each time and stayed inside. Screenshots show her pressed against the inside edge of each side. The yard is a flat green rectangle with a brown fence and nothing else; no model or decoration was made. The request became two tasks (the fenced yard, then the hen with the solid fence), each built at the first try with nothing sent back.","cost_micro_usd":1396079,"model_calls":28,"pieces_of_work":5,"fixes":0,"began_at":"2026-11-20T02:30:57Z","ended_at":"2026-11-20T02:38:12Z"},{"task_number":2,"criteria_met":[true,true],"note":"The yard opens with twenty small yellow seeds scattered over the grass and Seeds: 0 in white letters in the top-left corner. I walked the hen, a plain white square, right, up, left along the top, down the left side and right along the bottom. Each seed she walked over vanished as she reached it: one on the way up, one along the top, two along the bottom, twenty seeds becoming sixteen, while seeds she passed beside without touching stayed. The score read 1 after the first, 2 after the second and 4 after the last two, one more for each seed gone, as the screenshots show. The request became four tasks (the fenced yard, the hen, the seeds, the score), each built at the first try with nothing sent back, all in plain shapes and colours with no model.","cost_micro_usd":2867669,"model_calls":60,"pieces_of_work":9,"fixes":0,"began_at":"2026-11-20T02:39:11Z","ended_at":"2026-11-20T02:52:14Z"},{"task_number":3,"criteria_met":[true,true,true],"note":"The game opens on the fenced yard with the hen, a white square, in the middle and Eggs: 0 in the top-left corner. I pressed Space and walked right: a small cream egg lay exactly where she had stood, and the count read 1. More than a second later I pressed Space twice, a fifth of a second apart, and walked up: one new egg lay where she had stood, two eggs in all, and the count read 2. After another second I pressed Space again and walked left: a third egg lay where she had stood and the count read 3. The eggs never moved as she walked away from them. The request became four tasks (the fenced yard, the hen, the eggs, the count) after one question, whether this game should also have the seeds of an earlier game's rules, answered no; each built at the first try with nothing sent back, in plain shapes and colours.","cost_micro_usd":2982528,"model_calls":63,"pieces_of_work":10,"fixes":0,"began_at":"2026-11-20T02:52:24Z","ended_at":"2026-11-20T03:06:09Z"},{"task_number":4,"criteria_met":[true,true,true],"note":"The game opens on a dark green screen saying Chicken Run in large letters, with the line Walk your hen around the farmyard with the arrow keys. Press Escape to pause., and Press Enter to start. Holding the right arrow there for a second and a half changed nothing and brought no hen. Pressing Enter took me to the fenced yard with the hen, a white square, in the middle, and holding right walked her well to the right. Pressing Escape showed a large Paused in the middle of the screen; holding the left arrow for two seconds then left her exactly where she stood. Pressing Escape again took Paused away, and holding left walked her back to the middle. The request became four tasks (the fenced yard, the hen, the title screen, the pause), each built at the first try with nothing sent back, in plain shapes, colours and text.","cost_micro_usd":2923530,"model_calls":53,"pieces_of_work":9,"fixes":0,"began_at":"2026-11-20T03:06:14Z","ended_at":"2026-11-20T03:18:50Z"},{"task_number":5,"criteria_met":[true,true,true],"note":"The game shows a grey road of four lanes between two green verges, three plain cars in each lane, each lane's cars a colour of their own driving their own way at their own speed, and the chicken, a white square, on the bottom verge with Score: 0 in the top-left corner. Pressing up once in a gap in the traffic put the chicken exactly on the first lane, in its middle, and it stayed there. A red car then drove into it and it was back on the starting verge at once. Holding up hopped only once. Timing five presses between the cars, the chicken hopped lane by lane across all four lanes and onto the far verge, and the moment it landed it was back on its starting spot and the score read Score: 1. My first try at crossing was hit in a lane on the way and sent back, its score still 0, as it should be. The request became four tasks (the road, the chicken, the cars, the score), each built at the first try with nothing sent back, in plain shapes and colours. The budget had $0.40 left once this task was done.","cost_micro_usd":4425754,"model_calls":75,"pieces_of_work":9,"fixes":0,"began_at":"2026-11-20T03:18:55Z","ended_at":"2026-11-20T03:39:44Z"},{"task_number":6,"criteria_met":[false,false,false],"note":"The budget ran out during this task. The request was planned as four tasks (the fenced yard, the hen, the fox, game over with R to restart), and the money ended while the first, the yard, had only been planned. I played what the task had made: an empty dark screen, with nothing in it. Holding the right arrow and pressing R changed nothing. There was no hen and no fox, so no fox moved toward a hen, nothing could catch her or say Game over, and R had nothing to start again.","cost_micro_usd":449321,"model_calls":8,"pieces_of_work":3,"fixes":0,"began_at":"2026-11-20T03:40:03Z","ended_at":"2026-11-20T03:42:10Z"}]},{"site":"testing.okaywhatif.com","model":"us.openai.gpt-6.2-astra","effort":"low","budget_micro_usd":15000000,"spent_micro_usd":15011820,"model_calls":450,"worked_by":["tester"],"grades":["A","B","B","B"],"tasks":[{"task_number":1,"criteria_met":[true,true],"note":"Played the finished game. A green yard with a brown fence on all four sides, seen from above; the hen is a plain grey square in the middle. Holding the right arrow for 1.5 seconds moved her steadily to the right, about two thirds of the way to the fence. Held into the right fence for 3 more seconds, then the left for 8, the top for 5, the bottom for 7, and up and right together into the top-right corner for 10: each time she stopped flush against the inside of the rail and never crossed it, and walking down and left took her straight back into the yard. Releasing the keys stopped her at once. Both criteria met on the first build, with no later prompt.","cost_micro_usd":2144557,"model_calls":47,"pieces_of_work":5,"fixes":0,"began_at":"2026-11-20T02:30:45Z","ended_at":"2026-11-20T02:37:56Z"},{"task_number":2,"criteria_met":[true,true],"note":"Played the finished game. A fenced green yard seen from above with a small chicken in the middle, five seeds on dark squares around her and Seeds: 0 at the top left. Walked right onto the nearest seed: it vanished and the score read Seeds: 1. Walked up onto the next: it vanished and the score read Seeds: 2. Walking back over the empty spot added nothing. In the first build the seeds were tiny faint specks almost the colour of the grass, too hard to see; sent back once, they came back clearly visible. Both criteria met.","cost_micro_usd":3408635,"model_calls":109,"pieces_of_work":10,"fixes":0,"began_at":"2026-11-20T02:38:31Z","ended_at":"2026-11-20T02:49:07Z"},{"task_number":3,"criteria_met":[true,true,true],"note":"Played the finished game. A fenced green yard from above, the hen a small grey ball, Eggs: 0 at the top left. Pressing space laid a cream egg right where she stood and the count read Eggs: 1. Walked right and pressed space twice, 0.15 seconds apart: one egg appeared there and the count went to 2. In a second round, two presses 0.6 seconds apart laid one egg (Eggs: 1); a press 0.8 seconds after that laid another (Eggs: 2). The eggs stayed where they were laid as she walked on. All three criteria met on the first builds.","cost_micro_usd":2798508,"model_calls":88,"pieces_of_work":9,"fixes":0,"began_at":"2026-11-20T02:49:50Z","ended_at":"2026-11-20T02:59:25Z"},{"task_number":4,"criteria_met":[true,true,true],"note":"Played the finished game. It opens on a dark screen reading Chicken Run, with Enter to start, Arrow keys to walk and Escape to pause or resume. Holding the right arrow there for a second showed no hen and changed nothing. Enter opened the fenced yard with the hen, a cream circle, in the middle where she began; the right arrow walked her right. Escape showed Paused near the top of the yard; holding the up arrow for 1.5 seconds then left her exactly where she was. Escape again removed Paused, and the up arrow walked her up from the same spot. All three criteria met on the first builds.","cost_micro_usd":2920117,"model_calls":92,"pieces_of_work":9,"fixes":0,"began_at":"2026-11-20T02:59:56Z","ended_at":"2026-11-20T03:09:48Z"},{"task_number":5,"criteria_met":[true,true,true],"note":"Played the finished game. Seen from above: a green start strip at the bottom, four grey lanes with orange-brown cars driving right, left, right, left, each lane at its own speed, a green goal strip at the top, and Score: 0 in its corner. One press of the up arrow hopped the chicken exactly one lane up, from the start strip into the first lane. Left standing there, the next car drove into her and she was back on the start strip at once, the score still 0. Timing the gaps, five presses took her through all four lanes to the far strip: the score read Score: 1 and she was back on the start strip, ready to go again. All three criteria met on the first builds.","cost_micro_usd":2974598,"model_calls":89,"pieces_of_work":9,"fixes":0,"began_at":"2026-11-20T03:10:29Z","ended_at":"2026-11-20T03:22:03Z"},{"task_number":6,"criteria_met":[false,false,false],"note":"The budget ran out during this task. Its plan was approved (yard, hen, fox, game over and restart), but the first build, the yard, stopped after planning, before it changed the game. Played what there was: an empty black screen with nothing in it; the arrow keys and R did nothing. No fox, no hen and no Game over to judge, so none of the three criteria is met.","cost_micro_usd":765405,"model_calls":25,"pieces_of_work":3,"fixes":0,"began_at":"2026-11-20T03:23:12Z","ended_at":"2026-11-20T03:24:36Z"}]},{"site":"testing.okaywhatif.com","model":"us.openai.gpt-6.2-astra","effort":"high","budget_micro_usd":15000000,"spent_micro_usd":15037944,"model_calls":333,"worked_by":["tester"],"grades":["A","B","B","C"],"tasks":[{"task_number":1,"criteria_met":[true,true],"note":"Played the yard's finished game. The hen is a plain white square in a plain green yard inside a brown fence, all framed from above. Holding the right arrow for 1.5 seconds walked her from the middle well to the right, at a steady pace, and letting go stopped her. Held right for 3 seconds more, she stopped flush against the east fence, inside it. Holding up and right together for 4 seconds slid her up along the east fence into the top right corner, still inside both rails; 6 seconds of left took her along the top fence to the top left corner, and 5 seconds of down along the west fence to the bottom left corner, inside every time. No later prompt was needed. The hen is drawn as a square rather than a hen, as Ohmo said it would be, since no art was asked for.","cost_micro_usd":2968808,"model_calls":54,"pieces_of_work":5,"fixes":0,"began_at":"2026-11-20T02:30:53Z","ended_at":"2026-11-20T02:39:03Z"},{"task_number":2,"criteria_met":[true,true],"note":"Played the finished seed game. Eight small brown seeds lie scattered over a plain green yard, the hen a cream circle in the middle, and Seeds eaten: 0 is written above the yard's top left corner. Walking right past the nearest seed, a little below it, left it on the grass. Walking onto it removed it at once and the score read Seeds eaten: 1. Walking back over the empty spot left it at 1. Walking onto a second seed removed it too and the score read Seeds eaten: 2. No later prompt was needed. The yard has a fence, which the request didn't ask for; it does no harm.","cost_micro_usd":4343989,"model_calls":95,"pieces_of_work":9,"fixes":0,"began_at":"2026-11-20T02:39:39Z","ended_at":"2026-11-20T02:53:53Z"},{"task_number":3,"criteria_met":[true,true,true],"note":"Played the finished egg game: a plain green yard in a brown fence, the hen a cream circle, and Eggs laid: 0 written above the yard. Pressing space twice in quick succession with the hen standing in the middle laid one small white egg under her, and the count read Eggs laid: 1. Walking a little right and pressing space again well within the second laid nothing, and walking on laid nothing either, so the early press was dropped rather than saved for later. Pressing space again more than a second later, standing further right, laid a second egg exactly where she stood, and the count read Eggs laid: 2. Walking away left both eggs where they were laid. No later prompt was needed.","cost_micro_usd":3838594,"model_calls":92,"pieces_of_work":9,"fixes":0,"began_at":"2026-11-20T02:54:21Z","ended_at":"2026-11-20T03:08:02Z"},{"task_number":4,"criteria_met":[true,true,false],"note":"The budget ran out during this task: the pause had been planned but not built when the platform gave no more calls, so this judges what was made by then. The game opens on a black title screen reading Chicken Run, with Walk the hen with the arrow keys, Press Escape to pause or resume, and Press Enter to start. Holding the right arrow for a second there left the title in place, with no hen anywhere. Pressing Enter cleared the title and showed a plain green yard in a brown fence with the hen, a cream square, in the middle; holding the right arrow walked her well to the right. Pressing Escape while playing showed nothing, no Paused, and holding the right arrow afterwards walked the hen on to the right, so the third criterion is not met. No later prompt could be sent.","cost_micro_usd":3886553,"model_calls":92,"pieces_of_work":9,"fixes":0,"began_at":"2026-11-20T03:08:20Z","ended_at":"2026-11-20T03:19:47Z"}]},{"site":"testing.okaywhatif.com","model":"gemini-4-neon","effort":"low","budget_micro_usd":15000000,"spent_micro_usd":15114043,"model_calls":170,"worked_by":["tester"],"grades":["A","A","B","A"],"tasks":[{"task_number":1,"criteria_met":[true,true],"note":"Played the game: a green yard ringed by a brown fence seen from above, the hen a plain square in the middle (the report called it white; it is drawn grey). (1) Holding the right arrow for one second walked her about 520 units to the right. (2) Held right for three more seconds she stopped against the east fence, pressing into the rail by a few units but never past it; up for three seconds stopped her at the north fence; left and down together for six seconds left her in the south-west corner, inside the fence. Ohmo planned two tasks (the yard, then the hen), each built in one step, with no question and nothing sent back.","cost_micro_usd":1490776,"model_calls":15,"pieces_of_work":5,"fixes":0,"began_at":"2026-11-20T02:31:21Z","ended_at":"2026-11-20T02:39:28Z"},{"task_number":2,"criteria_met":[true,true],"note":"Played the game: a green yard seen from above with eight yellow seeds scattered on it, the hen a plain square in the middle, and Seeds: 0 at the top left. (1) Walking right onto the nearest seed made it vanish as she reached it; a second play walked her down onto another seed far to the east, which vanished too, leaving six. (2) The count read Seeds: 1 after the first seed and Seeds: 2 after the second, and didn't change while she walked over bare ground. The yard has no fence (Ohmo said it left one out as the request didn't ask for one), so nothing keeps the hen on the yard; no criterion asks for that. Planned as three tasks (the yard, the hen, seeds and score), with no question and nothing sent back.","cost_micro_usd":2131271,"model_calls":26,"pieces_of_work":7,"fixes":0,"began_at":"2026-11-20T02:40:14Z","ended_at":"2026-11-20T02:48:32Z"},{"task_number":3,"criteria_met":[true,true,true],"note":"Played the game: a green yard seen from above, the hen a plain square in the middle, Eggs: 0 at the top left. (1) Space laid a small yellow egg exactly where she stood; after walking right and then up, each Space laid an egg at her new spot, and every egg stayed where it was laid as she walked away. (2) Two presses about half a second apart laid one egg, and three presses within about six tenths of a second laid one. (3) The count went 0, 1, 2, 3, one for each egg laid and never for a refused press. No fence round the yard, as the request asked for none. Planned as three tasks (the yard, the hen, laying eggs with the count), with no question and nothing sent back.","cost_micro_usd":2411417,"model_calls":28,"pieces_of_work":7,"fixes":0,"began_at":"2026-11-20T02:49:19Z","ended_at":"2026-11-20T02:57:17Z"},{"task_number":4,"criteria_met":[true,true,true],"note":"Played the game. (1) It opened on a green title screen reading Chicken Run, Arrow keys to walk | Escape to pause, and Press Enter to Start; holding the right arrow there for a second changed nothing, and there was no hen on it. (2) Enter brought up the yard seen from above with the hen in the middle; holding right walked her well to the right. (3) Escape showed a dark panel reading Paused over the yard; holding right for a second and a half then left her exactly where she was. Escape again took the panel away and the up arrow walked her again. The yard has no fence, so walking on she could step past its edge into the dark around it; no criterion asks about that. Planned as four tasks (the yard, the hen, the title screen, pause), with no question and nothing sent back.","cost_micro_usd":2865155,"model_calls":30,"pieces_of_work":9,"fixes":0,"began_at":"2026-11-20T02:57:49Z","ended_at":"2026-11-20T03:06:44Z"},{"task_number":5,"criteria_met":[true,true,true],"note":"Played the game: a road of four dark lanes between two grass strips, seen from above, two cars in each lane, each lane its own way and speed, the chicken a yellow square on the near grass, Score: 0 at the top left. (1) Before the cars were added, one press of up moved the chicken from the near grass into the first lane, one lane exactly; in the finished game one press moved it from the third lane to the fourth, one lane exactly. (2) Twice a car reached it: once a blue car in the second lane as it crossed, once a purple car in the fourth lane where I left it standing; each time it was back on the near grass at once, the score unchanged. (3) A crossing timed between the cars carried it over all four lanes; the score went from 0 to 1 and it was back at its starting spot on the near grass. Planned as three tasks (the road, the chicken with its scoring, the traffic with the car hit); the road has painted lane lines nobody asked for. No question and nothing sent back.","cost_micro_usd":2737177,"model_calls":33,"pieces_of_work":7,"fixes":0,"began_at":"2026-11-20T03:07:20Z","ended_at":"2026-11-20T03:17:44Z"},{"task_number":6,"criteria_met":[true,true,true],"note":"Played the game: a green yard seen from above, the hen a plain square in the middle, the fox an orange square starting at the lower left. (1) Standing still, the hen watched the fox come straight at her along the line between them; after a restart, walking her right made the fox turn and follow her up and to the right. (2) When the fox reached her, a dark banner reading Game over appeared over the yard and both stopped; holding right for a second then didn't move the hen. (3) R while the game was over took the banner away and put the hen back in the middle and the fox back at the lower left, where they began, and the chase started again; it worked the same a second time. The fox is a little more than half the hen's speed, so she can outrun it. No fence (none was asked for; the hen and fox are kept to the yard's edges). Planned as three tasks (the yard, the hen, the fox with game over and restart), with no question and nothing sent back.","cost_micro_usd":2248301,"model_calls":28,"pieces_of_work":7,"fixes":0,"began_at":"2026-11-20T03:18:33Z","ended_at":"2026-11-20T03:27:12Z"},{"task_number":7,"criteria_met":[false,false,false],"note":"The budget ran out partway through this task. Ohmo planned three tasks (the perch and hens, the basket, then the falling eggs with scoring and game over); only the first was built before the money was spent, and the basket's build stopped right after its plan. Played what was left: five plain white hens on an orange perch along the top and green ground along the bottom, nothing else. (1) There is no basket: the arrow keys moved nothing. (2) No eggs fall, so none can be caught and nothing scores. (3) No egg reaches the ground and there is no Game over. Nothing failed that was built; the game simply wasn't finished.","cost_micro_usd":1229946,"model_calls":10,"pieces_of_work":5,"fixes":0,"began_at":"2026-11-20T03:27:55Z","ended_at":"2026-11-20T03:30:28Z"}]},{"site":"testing.okaywhatif.com","model":"gemini-4-neon","effort":"high","budget_micro_usd":15000000,"spent_micro_usd":15105367,"model_calls":177,"worked_by":["tester"],"grades":["A","B","A","C"],"tasks":[{"task_number":1,"criteria_met":[true,true],"note":"Played the finished game. The hen is a plain cream circle in the middle of a plain green yard framed by four brown fence walls, seen from above. Holding the right arrow for one second moved her from the centre about two thirds of the way to the right fence; three seconds more and she stopped flush against the inside of the right fence and stayed there. Holding up for three seconds into the top fence, left for five seconds along it into the left fence, down for three seconds into the bottom fence, and down and left together for two and a half seconds into the bottom-left corner each left her pressed against the inside edge of the fence, never over it. Both criteria met. The yard has no decoration and the hen is drawn as a single circle, so she doesn't read as a hen, but nothing asked otherwise.","cost_micro_usd":2434532,"model_calls":29,"pieces_of_work":5,"fixes":0,"began_at":"2026-11-20T02:30:52Z","ended_at":"2026-11-20T02:45:13Z"},{"task_number":2,"criteria_met":[true,true],"note":"Played the finished game: a plain green yard in a brown fence, the hen a cream circle at the centre, twelve small yellow seed dots scattered around, and Seeds: 0 in white outlined letters at the top left above the fence. Holding right for half a second walked her over the seed just right of her start: the dot vanished and the label read Seeds: 1. Walking on right to below another seed and then up into it: that dot vanished too and the label read Seeds: 2. Seeds she didn't touch stayed where they were. Both criteria met. Nothing beyond the request was added except the fence around the yard.","cost_micro_usd":4142227,"model_calls":46,"pieces_of_work":9,"fixes":0,"began_at":"2026-11-20T02:45:46Z","ended_at":"2026-11-20T03:04:16Z"},{"task_number":3,"criteria_met":[true,true,true],"note":"Played the finished game: a plain green yard in a brown fence, the hen a cream circle at the centre, and Eggs: 0 in cream outlined letters at the top left. Pressing space laid a small yellow round egg exactly where she stood, under her, and the label read Eggs: 1. Walking right and pressing space again about half a second later laid nothing and the label stayed at 1. A second later, pressing space laid a second egg at her new spot and the label read 2. Then two presses of space a tenth of a second apart, after the second was up, laid only one more egg, label 3. Walking away left every egg where it was laid. All three criteria met. The eggs are yellow dots rather than egg-shaped, and the yard has a fence nobody asked for.","cost_micro_usd":4147156,"model_calls":49,"pieces_of_work":9,"fixes":0,"began_at":"2026-11-20T03:04:44Z","ended_at":"2026-11-20T03:22:57Z"},{"task_number":4,"criteria_met":[true,true,true],"note":"Played the finished game. It opened on a title screen: Chicken Run in large cream letters on a dark card framed in brown, a How to play list (arrow keys walk the hen around the farmyard, Escape pauses and resumes, Enter starts the game) and a Press Enter to Start banner, with no hen anywhere. Holding right for a second and up for half a second there changed nothing. Pressing Enter opened the farmyard, a plain green yard in a brown fence with the hen, a cream square, at the centre; holding right for 0.6 seconds walked her right. Pressing Escape showed Paused on a dark panel in the middle; holding up for a second and a half then left her exactly where she was. Escape again took the panel away and up walked her up. All three criteria met. The yard has a fence nobody asked for.","cost_micro_usd":4205670,"model_calls":52,"pieces_of_work":9,"fixes":0,"began_at":"2026-11-20T03:23:19Z","ended_at":"2026-11-20T03:46:01Z"},{"task_number":5,"criteria_met":[false,false,false],"note":"The budget ran out during this task. Ohmo answered the request with a plan of four tasks (the road, the hopping chicken, the cars, the scoring) and the money was spent on that answer, so nothing was built: there was no road, chicken or car to play, so no hop, no hit and no point could be seen.","cost_micro_usd":175782,"model_calls":1,"pieces_of_work":1,"fixes":0,"began_at":"2026-11-20T03:46:24Z","ended_at":"2026-11-20T03:47:59Z"}]}],"clips":[{"clip_identifier":"71716acc-1f51-4265-b669-ffe69836f022","task_number":1,"caption":"Walking the hen into each side of the fence.","content_type":"video/webm","url":"https://okaywhatif-production-canada-assets.s3.ca-central-1.amazonaws.com/studies/e15a8289-5b17-4aab-91b0-30cb247eaf27/71716acc-1f51-4265-b669-ffe69836f022.webm?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Checksum-Mode=ENABLED&X-Amz-Credential=AKIAVIIUWSX2TR3DNCCS%2F20261122%2Fca-central-1%2Fs3%2Faws4_request&X-Amz-Date=20261122T120000Z&X-Amz-Expires=7200&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=d458c11a903c4ac98358bd2933bae3a5ca4a2b0040ef8fce7603f8cecda3ab3a","attempt":0},{"clip_identifier":"47ebe41a-3b1b-4905-bf5a-6be8fc386df0","task_number":3,"caption":"Laying eggs a second apart, then pressing space twice at once.","content_type":"video/webm","url":"https://okaywhatif-production-canada-assets.s3.ca-central-1.amazonaws.com/studies/e15a8289-5b17-4aab-91b0-30cb247eaf27/47ebe41a-3b1b-4905-bf5a-6be8fc386df0.webm?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Checksum-Mode=ENABLED&X-Amz-Credential=AKIAVIIUWSX2TR3DNCCS%2F20261122%2Fca-central-1%2Fs3%2Faws4_request&X-Amz-Date=20261122T120000Z&X-Amz-Expires=7200&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=3faf8946e5e49918906c670ddac0d80f8f151ef066c1f71ef535b2bd9c1d949f","attempt":0},{"clip_identifier":"b79694f9-7c21-4d24-b3df-5b162ba8f55f","task_number":5,"caption":"Hopping across the road in the gaps between the cars.","content_type":"video/webm","url":"https://okaywhatif-production-canada-assets.s3.ca-central-1.amazonaws.com/studies/e15a8289-5b17-4aab-91b0-30cb247eaf27/b79694f9-7c21-4d24-b3df-5b162ba8f55f.webm?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Checksum-Mode=ENABLED&X-Amz-Credential=AKIAVIIUWSX2TR3DNCCS%2F20261122%2Fca-central-1%2Fs3%2Faws4_request&X-Amz-Date=20261122T120000Z&X-Amz-Expires=7200&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=56ce6a502415debe154c1399443639141a442e039a91d919f4bbc1c9f8892099","attempt":0},{"clip_identifier":"08065d98-5c78-45b4-becc-29a96af771ce","task_number":1,"caption":"Walking the hen into each side of the fence.","content_type":"video/webm","url":"https://okaywhatif-production-canada-assets.s3.ca-central-1.amazonaws.com/studies/e15a8289-5b17-4aab-91b0-30cb247eaf27/08065d98-5c78-45b4-becc-29a96af771ce.webm?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Checksum-Mode=ENABLED&X-Amz-Credential=AKIAVIIUWSX2TR3DNCCS%2F20261122%2Fca-central-1%2Fs3%2Faws4_request&X-Amz-Date=20261122T120000Z&X-Amz-Expires=7200&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=7120137c521068c8d7867b4c8d76f942d069bd0fb7e8a7b8368162e474265e39","attempt":1},{"clip_identifier":"d260b36c-b6fe-42a1-b0a1-13f68547559d","task_number":3,"caption":"Laying eggs a second apart, then pressing space twice at once.","content_type":"video/webm","url":"https://okaywhatif-production-canada-assets.s3.ca-central-1.amazonaws.com/studies/e15a8289-5b17-4aab-91b0-30cb247eaf27/d260b36c-b6fe-42a1-b0a1-13f68547559d.webm?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Checksum-Mode=ENABLED&X-Amz-Credential=AKIAVIIUWSX2TR3DNCCS%2F20261122%2Fca-central-1%2Fs3%2Faws4_request&X-Amz-Date=20261122T120000Z&X-Amz-Expires=7200&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=ae0d62068557cdfe266f51fdfbb9c98995e4fe1b79c264e42adc3cc40a3b526d","attempt":1},{"clip_identifier":"8658bfc2-859d-452d-ab23-3ec4de043dd4","task_number":5,"caption":"Hopping across the road in the gaps between the cars.","content_type":"video/webm","url":"https://okaywhatif-production-canada-assets.s3.ca-central-1.amazonaws.com/studies/e15a8289-5b17-4aab-91b0-30cb247eaf27/8658bfc2-859d-452d-ab23-3ec4de043dd4.webm?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Checksum-Mode=ENABLED&X-Amz-Credential=AKIAVIIUWSX2TR3DNCCS%2F20261122%2Fca-central-1%2Fs3%2Faws4_request&X-Amz-Date=20261122T120000Z&X-Amz-Expires=7200&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=cc45e90cf64da61e2b639d95a549026caa55fe19c767ef81fd932f30e05ee7b5","attempt":1},{"clip_identifier":"8e70a5f6-ee79-4835-b4ec-41ad30e0b487","task_number":1,"caption":"Walking the hen into each side of the fence.","content_type":"video/webm","url":"https://okaywhatif-production-canada-assets.s3.ca-central-1.amazonaws.com/studies/e15a8289-5b17-4aab-91b0-30cb247eaf27/8e70a5f6-ee79-4835-b4ec-41ad30e0b487.webm?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Checksum-Mode=ENABLED&X-Amz-Credential=AKIAVIIUWSX2TR3DNCCS%2F20261122%2Fca-central-1%2Fs3%2Faws4_request&X-Amz-Date=20261122T120000Z&X-Amz-Expires=7200&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=2b798133ffa9eacc1ebe7c90ab4813a25c02938414a565ee89e241bc0206dd46","attempt":2},{"clip_identifier":"eee770ae-5b73-43d1-a7e0-ebd305e63d31","task_number":3,"caption":"Laying eggs a second apart, then pressing space twice at once.","content_type":"video/webm","url":"https://okaywhatif-production-canada-assets.s3.ca-central-1.amazonaws.com/studies/e15a8289-5b17-4aab-91b0-30cb247eaf27/eee770ae-5b73-43d1-a7e0-ebd305e63d31.webm?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Checksum-Mode=ENABLED&X-Amz-Credential=AKIAVIIUWSX2TR3DNCCS%2F20261122%2Fca-central-1%2Fs3%2Faws4_request&X-Amz-Date=20261122T120000Z&X-Amz-Expires=7200&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=246276cba88fbf1e15b0cebc384edbb49b7c51720431747fa488c1f01b743458","attempt":2},{"clip_identifier":"e4db01ab-096d-4a29-b3ee-b1896fd4787f","task_number":5,"caption":"Hopping across the road in the gaps between the cars.","content_type":"video/webm","url":"https://okaywhatif-production-canada-assets.s3.ca-central-1.amazonaws.com/studies/e15a8289-5b17-4aab-91b0-30cb247eaf27/e4db01ab-096d-4a29-b3ee-b1896fd4787f.webm?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Checksum-Mode=ENABLED&X-Amz-Credential=AKIAVIIUWSX2TR3DNCCS%2F20261122%2Fca-central-1%2Fs3%2Faws4_request&X-Amz-Date=20261122T120000Z&X-Amz-Expires=7200&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=b71abc4761ae876ba793e85052193a365b7d9c21aa1ee9806d01087fa9aeead7","attempt":2},{"clip_identifier":"dc919e24-148b-4d7a-814f-5d9129702eae","task_number":1,"caption":"Walking the hen into each side of the fence.","content_type":"video/webm","url":"https://okaywhatif-production-canada-assets.s3.ca-central-1.amazonaws.com/studies/e15a8289-5b17-4aab-91b0-30cb247eaf27/dc919e24-148b-4d7a-814f-5d9129702eae.webm?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Checksum-Mode=ENABLED&X-Amz-Credential=AKIAVIIUWSX2TR3DNCCS%2F20261122%2Fca-central-1%2Fs3%2Faws4_request&X-Amz-Date=20261122T120000Z&X-Amz-Expires=7200&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=e0aef178753c55d871801d23f94718c248d099c3d130d87ce09940970c42e99a","attempt":3},{"clip_identifier":"7d96edbb-0b03-49d9-bdbf-55854d4708c8","task_number":3,"caption":"Laying eggs a second apart, then pressing space twice at once.","content_type":"video/webm","url":"https://okaywhatif-production-canada-assets.s3.ca-central-1.amazonaws.com/studies/e15a8289-5b17-4aab-91b0-30cb247eaf27/7d96edbb-0b03-49d9-bdbf-55854d4708c8.webm?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Checksum-Mode=ENABLED&X-Amz-Credential=AKIAVIIUWSX2TR3DNCCS%2F20261122%2Fca-central-1%2Fs3%2Faws4_request&X-Amz-Date=20261122T120000Z&X-Amz-Expires=7200&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=1170f225a4c60d38002cabb9429e34b1b8866d57caff73077f9247428bcece37","attempt":3},{"clip_identifier":"7b58c835-97bd-4367-a4cf-dcf81d7e60e2","task_number":1,"caption":"Walking the hen into each side of the fence.","content_type":"video/webm","url":"https://okaywhatif-production-canada-assets.s3.ca-central-1.amazonaws.com/studies/e15a8289-5b17-4aab-91b0-30cb247eaf27/7b58c835-97bd-4367-a4cf-dcf81d7e60e2.webm?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Checksum-Mode=ENABLED&X-Amz-Credential=AKIAVIIUWSX2TR3DNCCS%2F20261122%2Fca-central-1%2Fs3%2Faws4_request&X-Amz-Date=20261122T120000Z&X-Amz-Expires=7200&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=cfd09efedf56a01d5225fe4e57eef061c8a42d80805f9e0e488fef7ef82d4395","attempt":4},{"clip_identifier":"624918d4-f9af-4b77-a330-14f1f0af3170","task_number":3,"caption":"Laying eggs a second apart, then pressing space twice at once.","content_type":"video/webm","url":"https://okaywhatif-production-canada-assets.s3.ca-central-1.amazonaws.com/studies/e15a8289-5b17-4aab-91b0-30cb247eaf27/624918d4-f9af-4b77-a330-14f1f0af3170.webm?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Checksum-Mode=ENABLED&X-Amz-Credential=AKIAVIIUWSX2TR3DNCCS%2F20261122%2Fca-central-1%2Fs3%2Faws4_request&X-Amz-Date=20261122T120000Z&X-Amz-Expires=7200&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=4c4bb54cacd5c32ad0ee38cb16125b91edbbece3c90e498635a96c301d509af6","attempt":4},{"clip_identifier":"2203c85c-8b05-47a9-ab5b-7219151eb82a","task_number":5,"caption":"Hopping across the road in the gaps between the cars.","content_type":"video/webm","url":"https://okaywhatif-production-canada-assets.s3.ca-central-1.amazonaws.com/studies/e15a8289-5b17-4aab-91b0-30cb247eaf27/2203c85c-8b05-47a9-ab5b-7219151eb82a.webm?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Checksum-Mode=ENABLED&X-Amz-Credential=AKIAVIIUWSX2TR3DNCCS%2F20261122%2Fca-central-1%2Fs3%2Faws4_request&X-Amz-Date=20261122T120000Z&X-Amz-Expires=7200&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=db0e01ae2b0cb6070ac53718d5b481dfb10db11dc475267ce794363fb849ee9b","attempt":4},{"clip_identifier":"5a4ca2c6-d96e-4ea2-8931-4b1209fd0935","task_number":1,"caption":"Walking the hen into each side of the fence.","content_type":"video/webm","url":"https://okaywhatif-production-canada-assets.s3.ca-central-1.amazonaws.com/studies/e15a8289-5b17-4aab-91b0-30cb247eaf27/5a4ca2c6-d96e-4ea2-8931-4b1209fd0935.webm?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Checksum-Mode=ENABLED&X-Amz-Credential=AKIAVIIUWSX2TR3DNCCS%2F20261122%2Fca-central-1%2Fs3%2Faws4_request&X-Amz-Date=20261122T120000Z&X-Amz-Expires=7200&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=c55b8b93128813634513d84fdc26891e0b2e9c37586a94515fcb47e2796000ed","attempt":5},{"clip_identifier":"6f7daa23-df8a-417b-9e60-d6f00e0014a4","task_number":3,"caption":"Laying eggs a second apart, then pressing space twice at once.","content_type":"video/webm","url":"https://okaywhatif-production-canada-assets.s3.ca-central-1.amazonaws.com/studies/e15a8289-5b17-4aab-91b0-30cb247eaf27/6f7daa23-df8a-417b-9e60-d6f00e0014a4.webm?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Checksum-Mode=ENABLED&X-Amz-Credential=AKIAVIIUWSX2TR3DNCCS%2F20261122%2Fca-central-1%2Fs3%2Faws4_request&X-Amz-Date=20261122T120000Z&X-Amz-Expires=7200&X-Amz-SignedHeaders=host&x-id=GetObject&X-Amz-Signature=a2e51d106afee06d8ae02ee3acc5033528a85df5afc232a688921d41e1662e46","attempt":5}]}