{"attemptsByMaxTokens":[{"count":95,"maxTokens":512,"status":"error"},{"count":3,"maxTokens":20000,"status":"error"},{"count":2173,"maxTokens":512,"status":"invalid"},{"count":797,"maxTokens":3000,"status":"invalid"},{"count":154,"maxTokens":20000,"status":"invalid"},{"count":1,"maxTokens":0,"status":"ok"},{"count":46964,"maxTokens":512,"status":"ok"},{"count":465,"maxTokens":3000,"status":"ok"},{"count":886,"maxTokens":20000,"status":"ok"},{"count":724,"maxTokens":512,"status":"rate_limited"}],"caveats":["The study measures regularities in forced one-word choices, not intent, consciousness, preference, belief, or moral position.","Normal and swapped option orders are both present, which helps separate word preference from positional bias.","baidu/ernie-4.5-21b-a3b was removed after persistent OpenRouter provider 429/rate-limit failures; preserved rows remain in the data.","rekaai/reka-flash-3 was removed after pathological high-token invalid retries; preserved ok/invalid evidence remains in the data.","One baidu/ernie-4.5-300b-a47b row was manually overridden to evening with an audit trail after repeated explanatory answers made the final one-word choice unambiguous.","OpenRouter provider routing was not pinned: a single nominal model id was free to be served by any of OpenRouter's available backends. Closed-source routes effectively hit one backend each, but open-weight routes hit many in the same run (DeepSeek v3.2: 9 providers; Llama 3.3 70B: 13; DeepSeek v4 Pro: 6). Within-model first-option rates vary up to roughly 8 pp across serving providers, so per-model rankings on open-weight routes carry some routing noise on top of the model itself.","Per-cell statistical power is small: 10 reps per (model, pair, condition) gives a binomial 95% CI half-width of about plus or minus 15 pp at p = 0.5. Aggregate findings are robust; single (model, pair, condition) cell claims should be treated as exploratory.","Per-pair preferences are not just unigram corpus frequency. Regressing the order-balanced option-A share on the wordfreq Zipf log-frequency gap across the 30 pairs gives Pearson r = 0.235, R-squared = 0.055, slope p = 0.21; the more frequent token wins only 19 of 30 pairs. Clear counter-frequency cases include sharp/mellow, smooth/rough, warm/cold, and circle/square. This rules out the simplest unigram-frequency confound but does not rule out richer frequency-based stories.","AI assistance was used for code, orchestration, analysis, and this public presentation. Daniel Alonso conducted the study with AI assistance."],"conditionSummary":[{"condition":"bare","firstShare":0.7575,"okRate":0.9588,"okTrials":12081,"totalTrials":12600},{"condition":"bare_swapped","firstShare":0.5932,"okRate":0.9581,"okTrials":12072,"totalTrials":12600},{"condition":"context","firstShare":0.5111,"okRate":0.9583,"okTrials":12074,"totalTrials":12600},{"condition":"context_swapped","firstShare":0.5553,"okRate":0.9594,"okTrials":12089,"totalTrials":12600}],"contextEffects":[{"absMeanLift":0.8919,"baselineShare":0.1008,"contextId":"ctx_black_coffee","contextShare":0.998,"intendedAssociation":"coffee may weakly relate to bitter","intendedOption":"bitter","meanLift":0.8919,"models":41,"n":488,"pairId":"taste_sweet_bitter","text":"The coffee was served without milk while the meeting started."},{"absMeanLift":0.8779,"baselineShare":0.117,"contextId":"ctx_old_rope","contextShare":1.0,"intendedAssociation":"old rope may weakly relate to rough","intendedOption":"rough","meanLift":0.8779,"models":41,"n":402,"pairId":"texture_smooth_rough","text":"The old rope had been stored in a shed for years beside gardening tools."},{"absMeanLift":0.8693,"baselineShare":0.1307,"contextId":"ctx_concert_line","contextShare":1.0,"intendedAssociation":"venue/rehearsal may weakly relate to loud","intendedOption":"loud","meanLift":0.8693,"models":40,"n":320,"pairId":"sound_loud_quiet","text":"People outside the venue could hear the final rehearsal through the doors."},{"absMeanLift":0.8564,"baselineShare":0.1356,"contextId":"ctx_old_turtle","contextShare":0.9938,"intendedAssociation":"turtle may weakly relate to slow","intendedOption":"slow","meanLift":0.8564,"models":41,"n":162,"pairId":"motion_fast_slow","text":"A turtle crossed the garden path while nobody interrupted it."},{"absMeanLift":0.7776,"baselineShare":0.1758,"contextId":"ctx_stairs_basement","contextShare":0.9545,"intendedAssociation":"basement/stairs may weakly relate to down","intendedOption":"down","meanLift":0.7776,"models":41,"n":484,"pairId":"direction_up_down","text":"The stairwell light flickered near the door to the basement."},{"absMeanLift":0.7406,"baselineShare":0.2552,"contextId":"ctx_suitcase","contextShare":0.9958,"intendedAssociation":"suitcase/dull thud may weakly relate to heavy","intendedOption":"heavy","meanLift":0.7406,"models":40,"n":238,"pairId":"density_light_heavy","text":"The suitcase made a dull sound when it was set down."},{"absMeanLift":0.7334,"baselineShare":0.2548,"contextId":"ctx_sunset_walk","contextShare":0.9979,"intendedAssociation":"horizon/warm light may weakly relate to red","intendedOption":"red","meanLift":0.7334,"models":41,"n":482,"pairId":"color_blue_red","text":"People were heading home while the light near the horizon looked unusually warm."},{"absMeanLift":0.7272,"baselineShare":0.2668,"contextId":"ctx_corridor","contextShare":0.9939,"intendedAssociation":"corridor/single file may weakly relate to narrow","intendedOption":"narrow","meanLift":0.7272,"models":41,"n":488,"pairId":"abstract_narrow_wide","text":"The corridor made people walk in single file."},{"absMeanLift":0.7229,"baselineShare":0.2659,"contextId":"ctx_dinner_lights","contextShare":0.9969,"intendedAssociation":"dinner/street lights may weakly relate to evening","intendedOption":"evening","meanLift":0.7229,"models":41,"n":322,"pairId":"time_morning_evening","text":"The lights along the street came on before dinner."},{"absMeanLift":0.6805,"baselineShare":0.2143,"contextId":"ctx_machine_diagram","contextShare":0.8993,"intendedAssociation":"diagram with labels may weakly relate to complex","intendedOption":"complex","meanLift":0.6805,"models":41,"n":566,"pairId":"abstract_simple_complex","text":"The diagram had several labels connected across the page."},{"absMeanLift":0.668,"baselineShare":0.1883,"contextId":"ctx_ice_box","contextShare":0.8562,"intendedAssociation":"ice/cold storage may weakly relate to cold","intendedOption":"cold","meanLift":0.668,"models":40,"n":480,"pairId":"temperature_warm_cold","text":"The box had to be carried quickly before anything inside changed."},{"absMeanLift":0.667,"baselineShare":0.2901,"contextId":"ctx_window_frame","contextShare":0.9588,"intendedAssociation":"frame/sections may weakly relate to square","intendedOption":"square","meanLift":0.667,"models":41,"n":486,"pairId":"shape_circle_square","text":"The window frame divided the view into neat sections."},{"absMeanLift":0.6547,"baselineShare":0.2911,"contextId":"ctx_bridge_water","contextShare":0.9668,"intendedAssociation":"bridge may weakly relate to river","intendedOption":"river","meanLift":0.6547,"models":41,"n":482,"pairId":"nature_river_forest","text":"The bridge was narrow enough that people crossed one at a time."},{"absMeanLift":0.6339,"baselineShare":0.1804,"contextId":"ctx_low_fields","contextShare":0.823,"intendedAssociation":"below/low fields may weakly relate to valley","intendedOption":"valley","meanLift":0.6339,"models":41,"n":322,"pairId":"terrain_mountain_valley","text":"The fields below were quiet after the rain moved away."},{"absMeanLift":0.6321,"baselineShare":0.1806,"contextId":"ctx_last_train","contextShare":0.815,"intendedAssociation":"final train may weakly relate to late","intendedOption":"late","meanLift":0.6321,"models":40,"n":319,"pairId":"time_early_late","text":"The platform was almost empty when the final train was announced."},{"absMeanLift":0.5999,"baselineShare":0.3547,"contextId":"ctx_workbench_block","contextShare":0.9536,"intendedAssociation":"block/workbench may weakly relate to hard","intendedOption":"hard","meanLift":0.5999,"models":41,"n":323,"pairId":"texture_soft_hard","text":"A small block on the workbench kept the papers from sliding around."},{"absMeanLift":0.5966,"baselineShare":0.377,"contextId":"ctx_balcony_flags","contextShare":0.9835,"intendedAssociation":"flags moving may weakly relate to windy","intendedOption":"windy","meanLift":0.5966,"models":41,"n":242,"pairId":"weather_windy_still","text":"Small flags on a balcony moved every now and then during lunch."},{"absMeanLift":0.5854,"baselineShare":0.2935,"contextId":"ctx_pencil_tip","contextShare":0.8787,"intendedAssociation":"point may weakly relate to sharp","intendedOption":"sharp","meanLift":0.5854,"models":40,"n":239,"pairId":"sound_sharp_mellow","text":"The pencil point broke just as the list was nearly finished."},{"absMeanLift":0.5708,"baselineShare":0.4157,"contextId":"ctx_clear_vase","contextShare":0.9975,"intendedAssociation":"vase/light may weakly relate to glass","intendedOption":"glass","meanLift":0.5708,"models":41,"n":402,"pairId":"material_glass_stone","text":"A vase on the table caught the afternoon light."},{"absMeanLift":0.5481,"baselineShare":0.4548,"contextId":"ctx_matchbox","contextShare":1.0,"intendedAssociation":"pocket fit may weakly relate to small","intendedOption":"small","meanLift":0.5481,"models":41,"n":485,"pairId":"size_small_large","text":"The item fit easily inside a jacket pocket."},{"absMeanLift":0.5402,"baselineShare":0.2698,"contextId":"ctx_power_cut","contextShare":0.8144,"intendedAssociation":"power cut may weakly relate to candle","intendedOption":"candle","meanLift":0.5402,"models":41,"n":404,"pairId":"object_candle_lamp","text":"The power went out for a few minutes during the storm."},{"absMeanLift":0.527,"baselineShare":0.4605,"contextId":"ctx_old_pavement","contextShare":0.9875,"intendedAssociation":"pavement may weakly relate to gray","intendedOption":"gray","meanLift":0.527,"models":40,"n":80,"pairId":"color_yellow_gray","text":"The pavement outside had a flat, even tone after a long week of traffic."},{"absMeanLift":0.5175,"baselineShare":0.3525,"contextId":"ctx_dinner_stack","contextShare":0.87,"intendedAssociation":"dinner stack may weakly relate to plate","intendedOption":"plate","meanLift":0.5175,"models":40,"n":400,"pairId":"object_cup_plate","text":"After dinner, a small stack was left beside the sink."},{"absMeanLift":0.5169,"baselineShare":0.9033,"contextId":"ctx_bakery_case","contextShare":0.3832,"intendedAssociation":"bakery may weakly relate to sweet","intendedOption":"sweet","meanLift":-0.5169,"models":41,"n":321,"pairId":"taste_sweet_bitter","text":"The bakery case was almost empty by the time the queue moved."},{"absMeanLift":0.5042,"baselineShare":0.4543,"contextId":"ctx_parking_meter","contextShare":0.95,"intendedAssociation":"parking meter may weakly relate to coin","intendedOption":"coin","meanLift":0.5042,"models":41,"n":480,"pairId":"object_key_coin","text":"The parking meter was older than the cars around it."},{"absMeanLift":0.4782,"baselineShare":0.5171,"contextId":"ctx_garden_after_rain","contextShare":0.9954,"intendedAssociation":"garden/fresh may weakly relate to green","intendedOption":"green","meanLift":0.4782,"models":41,"n":652,"pairId":"color_green_purple","text":"After the rain, the garden paths looked fresh and the air smelled clean."},{"absMeanLift":0.474,"baselineShare":0.5016,"contextId":"ctx_warning_sign","contextShare":0.9698,"intendedAssociation":"warning sign may weakly relate to triangle","intendedOption":"triangle","meanLift":0.474,"models":41,"n":562,"pairId":"shape_triangle_oval","text":"A sign near the road made drivers slow down before the turn."},{"absMeanLift":0.4392,"baselineShare":0.5477,"contextId":"ctx_warehouse","contextShare":0.9877,"intendedAssociation":"warehouse/large door may weakly relate to large","intendedOption":"large","meanLift":0.4392,"models":41,"n":326,"pairId":"size_small_large","text":"The warehouse door took two people to slide open."},{"absMeanLift":0.4237,"baselineShare":0.5762,"contextId":"ctx_cabin_shelf","contextShare":1.0,"intendedAssociation":"cabin/shelf may weakly relate to wood","intendedOption":"wood","meanLift":0.4237,"models":40,"n":240,"pairId":"material_wood_metal","text":"The shelf in the cabin had a familiar smell after the rain."},{"absMeanLift":0.4048,"baselineShare":0.5808,"contextId":"ctx_old_wall","contextShare":0.9852,"intendedAssociation":"old wall/path may weakly relate to stone","intendedOption":"stone","meanLift":0.4048,"models":41,"n":405,"pairId":"material_glass_stone","text":"The wall beside the path had been there longer than anyone remembered."},{"absMeanLift":0.3976,"baselineShare":0.5399,"contextId":"ctx_seaside_table","contextShare":0.9336,"intendedAssociation":"seaside may weakly relate to salty","intendedOption":"salty","meanLift":0.3976,"models":41,"n":482,"pairId":"taste_salty_sour","text":"Lunch was served near the water with windows open to the breeze."},{"absMeanLift":0.3733,"baselineShare":0.4985,"contextId":"ctx_egg_bowl","contextShare":0.8703,"intendedAssociation":"breakfast/egg may weakly relate to oval","intendedOption":"oval","meanLift":0.3733,"models":40,"n":239,"pairId":"shape_triangle_oval","text":"Breakfast was already on the counter next to a small bowl."},{"absMeanLift":0.3712,"baselineShare":0.6261,"contextId":"ctx_desert_note","contextShare":0.9975,"intendedAssociation":"arid plain may weakly relate to dry","intendedOption":"dry","meanLift":0.3712,"models":40,"n":399,"pairId":"weather_humid_dry","text":"The notebook mentioned a wide plain with almost no shade in sight."},{"absMeanLift":0.3651,"baselineShare":0.6228,"contextId":"ctx_library_room","contextShare":0.9858,"intendedAssociation":"settled room may weakly relate to still","intendedOption":"still","meanLift":0.3651,"models":41,"n":563,"pairId":"weather_windy_still","text":"The reading room felt settled enough that small sounds carried clearly."},{"absMeanLift":0.3575,"baselineShare":0.4588,"contextId":"ctx_lemon_slice","contextShare":0.8168,"intendedAssociation":"citrus slice may weakly relate to sour","intendedOption":"sour","meanLift":0.3575,"models":41,"n":322,"pairId":"taste_salty_sour","text":"A thin slice was placed on the rim of the glass."},{"absMeanLift":0.3519,"baselineShare":0.5452,"contextId":"ctx_locked_drawer","contextShare":0.8966,"intendedAssociation":"locked drawer may weakly relate to key","intendedOption":"key","meanLift":0.3519,"models":40,"n":319,"pairId":"object_key_coin","text":"The drawer would not open until someone checked the bowl near the door."},{"absMeanLift":0.35,"baselineShare":0.6479,"contextId":"ctx_tea_break","contextShare":1.0,"intendedAssociation":"tea may weakly relate to cup","intendedOption":"cup","meanLift":0.35,"models":41,"n":402,"pairId":"object_cup_plate","text":"The break was short, but someone still made tea."},{"absMeanLift":0.3452,"baselineShare":0.6449,"contextId":"ctx_folded_blanket","contextShare":0.9959,"intendedAssociation":"blanket may weakly relate to soft","intendedOption":"soft","meanLift":0.3452,"models":41,"n":484,"pairId":"texture_soft_hard","text":"A folded blanket sat at the end of the sofa before anyone used it."},{"absMeanLift":0.3049,"baselineShare":0.7007,"contextId":"ctx_evening_music","contextShare":0.9982,"intendedAssociation":"background music may weakly relate to mellow","intendedOption":"mellow","meanLift":0.3049,"models":41,"n":563,"pairId":"sound_sharp_mellow","text":"The music in the cafe sat in the background without drawing much attention."},{"absMeanLift":0.3026,"baselineShare":0.4228,"contextId":"ctx_train_station","contextShare":0.7255,"intendedAssociation":"train/platform may weakly relate to metal","intendedOption":"metal","meanLift":0.3026,"models":41,"n":561,"pairId":"material_wood_metal","text":"The station platform made a low sound as the train approached."},{"absMeanLift":0.2935,"baselineShare":0.706,"contextId":"ctx_tall_trees","contextShare":0.9907,"intendedAssociation":"tall trees may weakly relate to forest","intendedOption":"forest","meanLift":0.2935,"models":41,"n":323,"pairId":"nature_river_forest","text":"The path disappeared where the tall trees grew closer together."},{"absMeanLift":0.2685,"baselineShare":0.7352,"contextId":"ctx_feather_note","contextShare":1.0,"intendedAssociation":"feather may weakly relate to light","intendedOption":"light","meanLift":0.2685,"models":41,"n":570,"pairId":"density_light_heavy","text":"A feather was found between the pages of the book."},{"absMeanLift":0.2681,"baselineShare":0.7287,"contextId":"ctx_open_field","contextShare":0.9969,"intendedAssociation":"open field may weakly relate to wide","intendedOption":"wide","meanLift":0.2681,"models":40,"n":320,"pairId":"abstract_narrow_wide","text":"The field continued past the fence with no clear endpoint."},{"absMeanLift":0.2536,"baselineShare":0.7369,"contextId":"ctx_alarm_clock","contextShare":0.4833,"intendedAssociation":"alarm may weakly relate to morning","intendedOption":"morning","meanLift":-0.2536,"models":40,"n":480,"pairId":"time_morning_evening","text":"The alarm was set before the bag was packed."},{"absMeanLift":0.2202,"baselineShare":0.7819,"contextId":"ctx_plain_recipe","contextShare":1.0,"intendedAssociation":"few steps may weakly relate to simple","intendedOption":"simple","meanLift":0.2202,"models":41,"n":245,"pairId":"abstract_simple_complex","text":"The recipe had only a few steps and no special equipment."},{"absMeanLift":0.1903,"baselineShare":0.7115,"contextId":"ctx_coffee_ring","contextShare":0.8972,"intendedAssociation":"cup mark may weakly relate to circle","intendedOption":"circle","meanLift":0.1903,"models":41,"n":321,"pairId":"shape_circle_square","text":"A cup left a faint mark on the page beside the notes."},{"absMeanLift":0.1825,"baselineShare":0.7342,"contextId":"ctx_desk_reading","contextShare":0.9167,"intendedAssociation":"reading after dark may weakly relate to lamp","intendedOption":"lamp","meanLift":0.1825,"models":40,"n":396,"pairId":"object_candle_lamp","text":"The desk was set up for reading after dark."},{"absMeanLift":0.1731,"baselineShare":0.742,"contextId":"ctx_sky_clear_day","contextShare":0.9138,"intendedAssociation":"sky/open-air wording may weakly relate to blue","intendedOption":"blue","meanLift":0.1731,"models":41,"n":325,"pairId":"color_blue_red","text":"The walk outside was easy to remember because the day felt open and clear."},{"absMeanLift":0.1638,"baselineShare":0.8651,"contextId":"ctx_race_start","contextShare":0.7039,"intendedAssociation":"race may weakly relate to fast","intendedOption":"fast","meanLift":-0.1638,"models":41,"n":645,"pairId":"motion_fast_slow","text":"The runners waited for the signal at the start line."},{"absMeanLift":0.1602,"baselineShare":0.8169,"contextId":"ctx_summit_path","contextShare":0.9732,"intendedAssociation":"climbing/cold path may weakly relate to mountain","intendedOption":"mountain","meanLift":0.1602,"models":41,"n":485,"pairId":"terrain_mountain_valley","text":"The path became colder as the group kept climbing."},{"absMeanLift":0.1275,"baselineShare":0.8709,"contextId":"ctx_late_reading","contextShare":1.0,"intendedAssociation":"late reading may weakly relate to quiet","intendedOption":"quiet","meanLift":0.1275,"models":41,"n":486,"pairId":"sound_loud_quiet","text":"Everyone in the apartment had gone to bed before the last chapter."},{"absMeanLift":0.1221,"baselineShare":0.8792,"contextId":"ctx_polished_table","contextShare":1.0,"intendedAssociation":"polished surface may weakly relate to smooth","intendedOption":"smooth","meanLift":0.1221,"models":41,"n":407,"pairId":"texture_smooth_rough","text":"Someone had wiped the table until the reflection looked almost uninterrupted."},{"absMeanLift":0.1008,"baselineShare":0.8117,"contextId":"ctx_kitchen_steam","contextShare":0.9125,"intendedAssociation":"steam may weakly relate to warm","intendedOption":"warm","meanLift":0.1008,"models":40,"n":320,"pairId":"temperature_warm_cold","text":"Steam rose from the bowl while the kitchen window stayed closed."},{"absMeanLift":0.09,"baselineShare":0.5433,"contextId":"ctx_morning_window","contextShare":0.4573,"intendedAssociation":"morning light may weakly relate to yellow","intendedOption":"yellow","meanLift":-0.09,"models":41,"n":726,"pairId":"color_yellow_gray","text":"The room was quiet when light first came through the window."},{"absMeanLift":0.0882,"baselineShare":0.4806,"contextId":"ctx_market_flowers","contextShare":0.5687,"intendedAssociation":"flowers may weakly relate to purple","intendedOption":"purple","meanLift":0.0882,"models":40,"n":160,"pairId":"color_green_purple","text":"A small market stall had flowers arranged beside plain paper bags."}],"cost":{"attemptCompletionTokens":10908206,"attemptPromptTokens":2270506,"attemptReasoningTokens":10471809,"attemptUsageObservedUsd":22.210051,"dashboardSpendUsd":28.6,"note":"The OpenRouter dashboard spend was about USD 28.60. The attempts table sums recorded usage rows only; earlier superseded retry attempts were not all captured.","trialUsageObservedUsd":20.781281},"insights":{"acceptedNonExactOkRows":225,"exactParseOkRows":48091,"exactParseOkShare":0.9953,"manualOverrideRows":1,"mostFirstOptionModel":{"firstShare":0.8239,"label":"LFM2-24B-A2B","modelId":"liquid/lfm-2-24b-a2b","provider":"Liquid AI"},"mostNeutralPair":{"category":"shape","majorityOption":"triangle","n":808,"optionA":"triangle","optionACount":404,"optionAShare":0.5,"optionB":"oval","optionBShare":0.5,"pairId":"shape_triangle_oval","preferenceStrength":0.0},"mostSecondOptionModel":{"firstShare":0.3475,"label":"GPT-5.4","modelId":"openai/gpt-5.4","provider":"OpenAI"},"overallFirstShare":0.6043,"rekaFlashTokenShare":{"attemptCostShare":0.0359,"completionTokenShare":0.362,"okRows":382,"reasoningTokenShare":0.3933},"strongestPositiveContext":{"absMeanLift":0.8919,"baselineShare":0.1008,"contextId":"ctx_black_coffee","contextShare":0.998,"intendedAssociation":"coffee may weakly relate to bitter","intendedOption":"bitter","meanLift":0.8919,"models":41,"n":488,"pairId":"taste_sweet_bitter","text":"The coffee was served without milk while the meeting started."},"strongestReverseContext":{"absMeanLift":0.5169,"baselineShare":0.9033,"contextId":"ctx_bakery_case","contextShare":0.3832,"intendedAssociation":"bakery may weakly relate to sweet","intendedOption":"sweet","meanLift":-0.5169,"models":41,"n":321,"pairId":"taste_sweet_bitter","text":"The bakery case was almost empty by the time the queue moved."},"topNonOkModels":[{"label":"ERNIE 4.5 21B A3B","modelId":"baidu/ernie-4.5-21b-a3b","nonOkRows":1200,"okRows":0,"provider":"Baidu","shareOfAllNonOk":0.5758,"status":{"error":34,"model_removed":444,"rate_limited":722},"totalTrials":1200},{"label":"Reka Flash 3","modelId":"rekaai/reka-flash-3","nonOkRows":818,"okRows":382,"provider":"Reka AI","shareOfAllNonOk":0.3925,"status":{"invalid":126,"model_removed":692,"ok":382},"totalTrials":1200},{"label":"Grok 4.3","modelId":"x-ai/grok-4.3","nonOkRows":29,"okRows":1171,"provider":"xAI","shareOfAllNonOk":0.0139,"status":{"error":29,"ok":1171},"totalTrials":1200},{"label":"Qwen3.6 Max Preview","modelId":"qwen/qwen3.6-max-preview","nonOkRows":20,"okRows":1180,"provider":"Alibaba/Qwen","shareOfAllNonOk":0.0096,"status":{"error":18,"ok":1180,"rate_limited":2},"totalTrials":1200}],"topTwoNonOkShare":0.9683,"totalNonOkRows":2084},"modelPairBias":[{"category":"color","firstShare":0.55,"majorityOption":"blue","modelId":"amazon/nova-pro-v1","n":20,"optionA":"blue","optionAShare":0.95,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.9},{"category":"color","firstShare":0.9,"majorityOption":"blue","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"blue","optionAShare":0.6,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.2},{"category":"color","firstShare":0.5,"majorityOption":"blue","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"blue","optionAShare":1.0,"optionB":"red","pairId":"color_blue_red","preferenceStrength":1.0},{"category":"color","firstShare":0.65,"majorityOption":"blue","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"blue","optionAShare":0.85,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.7},{"category":"color","firstShare":0.75,"majorityOption":"red","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"blue","optionAShare":0.45,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.1},{"category":"color","firstShare":0.5,"majorityOption":"blue","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"blue","optionAShare":1.0,"optionB":"red","pairId":"color_blue_red","preferenceStrength":1.0},{"category":"color","firstShare":1.0,"majorityOption":"blue","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"blue","optionAShare":0.5,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.0},{"category":"color","firstShare":0.95,"majorityOption":"blue","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"blue","optionAShare":0.55,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.1},{"category":"color","firstShare":0.5,"majorityOption":"blue","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"blue","optionAShare":1.0,"optionB":"red","pairId":"color_blue_red","preferenceStrength":1.0},{"category":"color","firstShare":0.55,"majorityOption":"blue","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"blue","optionAShare":0.95,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.9},{"category":"color","firstShare":0.5,"majorityOption":"blue","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"blue","optionAShare":1.0,"optionB":"red","pairId":"color_blue_red","preferenceStrength":1.0},{"category":"color","firstShare":0.55,"majorityOption":"blue","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"blue","optionAShare":0.95,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.9},{"category":"color","firstShare":0.6,"majorityOption":"blue","modelId":"inception/mercury-2","n":20,"optionA":"blue","optionAShare":0.9,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.8},{"category":"color","firstShare":1.0,"majorityOption":"blue","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"blue","optionAShare":0.5,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.0},{"category":"color","firstShare":1.0,"majorityOption":"blue","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"blue","optionAShare":0.5,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.0},{"category":"color","firstShare":0.5,"majorityOption":"blue","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"blue","optionAShare":1.0,"optionB":"red","pairId":"color_blue_red","preferenceStrength":1.0},{"category":"color","firstShare":0.7,"majorityOption":"blue","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"blue","optionAShare":0.8,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.6},{"category":"color","firstShare":0.45,"majorityOption":"blue","modelId":"microsoft/phi-4","n":20,"optionA":"blue","optionAShare":0.95,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.9},{"category":"color","firstShare":0.8,"majorityOption":"blue","modelId":"minimax/minimax-m2","n":20,"optionA":"blue","optionAShare":0.7,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.4},{"category":"color","firstShare":0.6,"majorityOption":"blue","modelId":"minimax/minimax-m2.5","n":20,"optionA":"blue","optionAShare":0.9,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.8},{"category":"color","firstShare":0.9,"majorityOption":"blue","modelId":"minimax/minimax-m2.7","n":20,"optionA":"blue","optionAShare":0.6,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.2},{"category":"color","firstShare":0.85,"majorityOption":"blue","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"blue","optionAShare":0.55,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.1},{"category":"color","firstShare":0.7,"majorityOption":"red","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"blue","optionAShare":0.3,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.4},{"category":"color","firstShare":0.55,"majorityOption":"blue","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"blue","optionAShare":0.95,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.9},{"category":"color","firstShare":0.5,"majorityOption":"red","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"blue","optionAShare":0.3,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.4},{"category":"color","firstShare":0.85,"majorityOption":"blue","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"blue","optionAShare":0.65,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.3},{"category":"color","firstShare":0.8,"majorityOption":"blue","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"blue","optionAShare":0.6,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.2},{"category":"color","firstShare":0.5,"majorityOption":"blue","modelId":"openai/gpt-5-nano","n":20,"optionA":"blue","optionAShare":1.0,"optionB":"red","pairId":"color_blue_red","preferenceStrength":1.0},{"category":"color","firstShare":0.45,"majorityOption":"blue","modelId":"openai/gpt-5.4","n":20,"optionA":"blue","optionAShare":0.95,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.9},{"category":"color","firstShare":0.5789,"majorityOption":"red","modelId":"perplexity/sonar","n":19,"optionA":"blue","optionAShare":0.1579,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.6842},{"category":"color","firstShare":0.55,"majorityOption":"blue","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"blue","optionAShare":0.85,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.7},{"category":"color","firstShare":0.4737,"majorityOption":"blue","modelId":"qwen/qwen3.6-max-preview","n":19,"optionA":"blue","optionAShare":1.0,"optionB":"red","pairId":"color_blue_red","preferenceStrength":1.0},{"category":"color","firstShare":0.55,"majorityOption":"blue","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"blue","optionAShare":0.95,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.9},{"category":"color","firstShare":0.4545,"majorityOption":"blue","modelId":"rekaai/reka-flash-3","n":11,"optionA":"blue","optionAShare":0.5455,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.0909},{"category":"color","firstShare":1.0,"majorityOption":"blue","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"blue","optionAShare":0.5,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.0},{"category":"color","firstShare":0.9,"majorityOption":"blue","modelId":"tencent/hy3-preview:free","n":20,"optionA":"blue","optionAShare":0.6,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.2},{"category":"color","firstShare":0.9,"majorityOption":"blue","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"blue","optionAShare":0.5,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.0},{"category":"color","firstShare":0.75,"majorityOption":"blue","modelId":"x-ai/grok-4.3","n":20,"optionA":"blue","optionAShare":0.75,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.5},{"category":"color","firstShare":0.75,"majorityOption":"blue","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"blue","optionAShare":0.65,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.3},{"category":"color","firstShare":0.55,"majorityOption":"blue","modelId":"z-ai/glm-5","n":20,"optionA":"blue","optionAShare":0.95,"optionB":"red","pairId":"color_blue_red","preferenceStrength":0.9},{"category":"color","firstShare":0.5,"majorityOption":"blue","modelId":"z-ai/glm-5.1","n":20,"optionA":"blue","optionAShare":1.0,"optionB":"red","pairId":"color_blue_red","preferenceStrength":1.0},{"category":"color","firstShare":0.65,"majorityOption":"green","modelId":"amazon/nova-pro-v1","n":20,"optionA":"green","optionAShare":0.75,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.5},{"category":"color","firstShare":0.75,"majorityOption":"green","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"green","optionAShare":0.75,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.5},{"category":"color","firstShare":0.35,"majorityOption":"purple","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"green","optionAShare":0.15,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.7},{"category":"color","firstShare":0.5,"majorityOption":"purple","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"green","optionAShare":0.0,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":1.0},{"category":"color","firstShare":0.35,"majorityOption":"green","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"green","optionAShare":0.75,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.5},{"category":"color","firstShare":0.5,"majorityOption":"green","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"green","optionAShare":0.6,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.2},{"category":"color","firstShare":0.95,"majorityOption":"purple","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"green","optionAShare":0.45,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.1},{"category":"color","firstShare":0.65,"majorityOption":"green","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"green","optionAShare":0.85,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.7},{"category":"color","firstShare":0.5,"majorityOption":"purple","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"green","optionAShare":0.0,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":1.0},{"category":"color","firstShare":0.55,"majorityOption":"purple","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"green","optionAShare":0.05,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.9},{"category":"color","firstShare":0.45,"majorityOption":"purple","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"green","optionAShare":0.05,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.9},{"category":"color","firstShare":1.0,"majorityOption":"green","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"green","optionAShare":0.5,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.0},{"category":"color","firstShare":0.95,"majorityOption":"green","modelId":"inception/mercury-2","n":20,"optionA":"green","optionAShare":0.55,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.1},{"category":"color","firstShare":1.0,"majorityOption":"green","modelId":"liquid/lfm-2-24b-a2b","n":19,"optionA":"green","optionAShare":0.5263,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.0526},{"category":"color","firstShare":1.0,"majorityOption":"green","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"green","optionAShare":0.5,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.0},{"category":"color","firstShare":0.5,"majorityOption":"green","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"green","optionAShare":1.0,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":1.0},{"category":"color","firstShare":1.0,"majorityOption":"green","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"green","optionAShare":0.5,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.0},{"category":"color","firstShare":0.45,"majorityOption":"green","modelId":"microsoft/phi-4","n":20,"optionA":"green","optionAShare":0.75,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.5},{"category":"color","firstShare":1.0,"majorityOption":"green","modelId":"minimax/minimax-m2","n":20,"optionA":"green","optionAShare":0.5,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.0},{"category":"color","firstShare":1.0,"majorityOption":"green","modelId":"minimax/minimax-m2.5","n":20,"optionA":"green","optionAShare":0.5,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.0},{"category":"color","firstShare":1.0,"majorityOption":"green","modelId":"minimax/minimax-m2.7","n":20,"optionA":"green","optionAShare":0.5,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.0},{"category":"color","firstShare":0.65,"majorityOption":"green","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"green","optionAShare":0.65,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.3},{"category":"color","firstShare":0.8,"majorityOption":"green","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"green","optionAShare":0.6,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.2},{"category":"color","firstShare":0.5,"majorityOption":"purple","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"green","optionAShare":0.0,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":1.0},{"category":"color","firstShare":0.65,"majorityOption":"green","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"green","optionAShare":0.85,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.7},{"category":"color","firstShare":1.0,"majorityOption":"green","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"green","optionAShare":0.5,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.0},{"category":"color","firstShare":0.8,"majorityOption":"green","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"green","optionAShare":0.6,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.2},{"category":"color","firstShare":0.85,"majorityOption":"green","modelId":"openai/gpt-5-nano","n":20,"optionA":"green","optionAShare":0.65,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.3},{"category":"color","firstShare":0.1,"majorityOption":"green","modelId":"openai/gpt-5.4","n":20,"optionA":"green","optionAShare":0.6,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.2},{"category":"color","firstShare":0.35,"majorityOption":"green","modelId":"perplexity/sonar","n":20,"optionA":"green","optionAShare":0.65,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.3},{"category":"color","firstShare":0.95,"majorityOption":"green","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"green","optionAShare":0.55,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.1},{"category":"color","firstShare":0.85,"majorityOption":"green","modelId":"qwen/qwen3.6-max-preview","n":20,"optionA":"green","optionAShare":0.65,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.3},{"category":"color","firstShare":0.8,"majorityOption":"purple","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"green","optionAShare":0.4,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.2},{"category":"color","firstShare":0.2,"majorityOption":"purple","modelId":"rekaai/reka-flash-3","n":5,"optionA":"green","optionAShare":0.4,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.2},{"category":"color","firstShare":1.0,"majorityOption":"green","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"green","optionAShare":0.5,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.0},{"category":"color","firstShare":1.0,"majorityOption":"green","modelId":"tencent/hy3-preview:free","n":20,"optionA":"green","optionAShare":0.5,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.0},{"category":"color","firstShare":1.0,"majorityOption":"green","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"green","optionAShare":0.5,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.0},{"category":"color","firstShare":1.0,"majorityOption":"green","modelId":"x-ai/grok-4.3","n":20,"optionA":"green","optionAShare":0.5,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.0},{"category":"color","firstShare":0.75,"majorityOption":"green","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"green","optionAShare":0.65,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.3},{"category":"color","firstShare":0.85,"majorityOption":"green","modelId":"z-ai/glm-5","n":20,"optionA":"green","optionAShare":0.55,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.1},{"category":"color","firstShare":0.15,"majorityOption":"green","modelId":"z-ai/glm-5.1","n":20,"optionA":"green","optionAShare":0.65,"optionB":"purple","pairId":"color_green_purple","preferenceStrength":0.3},{"category":"color","firstShare":0.7,"majorityOption":"yellow","modelId":"amazon/nova-pro-v1","n":20,"optionA":"yellow","optionAShare":0.6,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.2},{"category":"color","firstShare":1.0,"majorityOption":"yellow","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"yellow","optionAShare":0.5,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.0},{"category":"color","firstShare":0.5,"majorityOption":"yellow","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"yellow","optionAShare":1.0,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":1.0},{"category":"color","firstShare":0.7,"majorityOption":"gray","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"yellow","optionAShare":0.2,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.6},{"category":"color","firstShare":0.25,"majorityOption":"yellow","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"yellow","optionAShare":0.65,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.3},{"category":"color","firstShare":0.35,"majorityOption":"gray","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"yellow","optionAShare":0.15,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.7},{"category":"color","firstShare":0.95,"majorityOption":"yellow","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"yellow","optionAShare":0.55,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.1},{"category":"color","firstShare":0.8,"majorityOption":"gray","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"yellow","optionAShare":0.3,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.4},{"category":"color","firstShare":0.6,"majorityOption":"yellow","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"yellow","optionAShare":0.7,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.4},{"category":"color","firstShare":0.7,"majorityOption":"yellow","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"yellow","optionAShare":0.8,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.6},{"category":"color","firstShare":0.9,"majorityOption":"gray","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"yellow","optionAShare":0.4,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.2},{"category":"color","firstShare":1.0,"majorityOption":"yellow","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"yellow","optionAShare":0.5,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.0},{"category":"color","firstShare":0.95,"majorityOption":"yellow","modelId":"inception/mercury-2","n":20,"optionA":"yellow","optionAShare":0.55,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.1},{"category":"color","firstShare":1.0,"majorityOption":"yellow","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"yellow","optionAShare":0.5,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.0},{"category":"color","firstShare":1.0,"majorityOption":"yellow","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"yellow","optionAShare":0.5,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.0},{"category":"color","firstShare":0.95,"majorityOption":"gray","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"yellow","optionAShare":0.45,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.1},{"category":"color","firstShare":0.9,"majorityOption":"yellow","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"yellow","optionAShare":0.6,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.2},{"category":"color","firstShare":0.6,"majorityOption":"gray","modelId":"microsoft/phi-4","n":20,"optionA":"yellow","optionAShare":0.1,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.8},{"category":"color","firstShare":0.8,"majorityOption":"yellow","modelId":"minimax/minimax-m2","n":20,"optionA":"yellow","optionAShare":0.5,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.0},{"category":"color","firstShare":0.85,"majorityOption":"gray","modelId":"minimax/minimax-m2.5","n":20,"optionA":"yellow","optionAShare":0.45,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.1},{"category":"color","firstShare":0.8,"majorityOption":"gray","modelId":"minimax/minimax-m2.7","n":20,"optionA":"yellow","optionAShare":0.3,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.4},{"category":"color","firstShare":1.0,"majorityOption":"yellow","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"yellow","optionAShare":0.5,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.0},{"category":"color","firstShare":0.85,"majorityOption":"gray","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"yellow","optionAShare":0.45,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.1},{"category":"color","firstShare":0.7,"majorityOption":"yellow","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"yellow","optionAShare":0.7,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.4},{"category":"color","firstShare":0.35,"majorityOption":"yellow","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"yellow","optionAShare":0.65,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.3},{"category":"color","firstShare":0.9,"majorityOption":"gray","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"yellow","optionAShare":0.4,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.2},{"category":"color","firstShare":1.0,"majorityOption":"yellow","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"yellow","optionAShare":0.5,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.0},{"category":"color","firstShare":0.7,"majorityOption":"gray","modelId":"openai/gpt-5-nano","n":20,"optionA":"yellow","optionAShare":0.3,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.4},{"category":"color","firstShare":0.1,"majorityOption":"gray","modelId":"openai/gpt-5.4","n":20,"optionA":"yellow","optionAShare":0.4,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.2},{"category":"color","firstShare":0.2,"majorityOption":"yellow","modelId":"perplexity/sonar","n":20,"optionA":"yellow","optionAShare":0.5,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.0},{"category":"color","firstShare":0.8,"majorityOption":"gray","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"yellow","optionAShare":0.4,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.2},{"category":"color","firstShare":0.4737,"majorityOption":"yellow","modelId":"qwen/qwen3.6-max-preview","n":19,"optionA":"yellow","optionAShare":1.0,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":1.0},{"category":"color","firstShare":0.85,"majorityOption":"yellow","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"yellow","optionAShare":0.65,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.3},{"category":"color","firstShare":0.3333,"majorityOption":"yellow","modelId":"rekaai/reka-flash-3","n":3,"optionA":"yellow","optionAShare":1.0,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":1.0},{"category":"color","firstShare":0.9,"majorityOption":"gray","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"yellow","optionAShare":0.4,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.2},{"category":"color","firstShare":1.0,"majorityOption":"yellow","modelId":"tencent/hy3-preview:free","n":20,"optionA":"yellow","optionAShare":0.5,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.0},{"category":"color","firstShare":1.0,"majorityOption":"yellow","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"yellow","optionAShare":0.5,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.0},{"category":"color","firstShare":0.9474,"majorityOption":"yellow","modelId":"x-ai/grok-4.3","n":19,"optionA":"yellow","optionAShare":0.5789,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.1579},{"category":"color","firstShare":0.6,"majorityOption":"yellow","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"yellow","optionAShare":0.9,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.8},{"category":"color","firstShare":0.5,"majorityOption":"yellow","modelId":"z-ai/glm-5","n":20,"optionA":"yellow","optionAShare":1.0,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":1.0},{"category":"color","firstShare":0.45,"majorityOption":"yellow","modelId":"z-ai/glm-5.1","n":20,"optionA":"yellow","optionAShare":0.95,"optionB":"gray","pairId":"color_yellow_gray","preferenceStrength":0.9},{"category":"weather","firstShare":0.8,"majorityOption":"humid","modelId":"amazon/nova-pro-v1","n":20,"optionA":"humid","optionAShare":0.5,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.0},{"category":"weather","firstShare":1.0,"majorityOption":"humid","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"humid","optionAShare":0.5,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.0},{"category":"weather","firstShare":1.0,"majorityOption":"humid","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"humid","optionAShare":0.5,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.0},{"category":"weather","firstShare":1.0,"majorityOption":"humid","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"humid","optionAShare":0.5,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.0},{"category":"weather","firstShare":0.55,"majorityOption":"dry","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"humid","optionAShare":0.05,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.9},{"category":"weather","firstShare":0.5,"majorityOption":"dry","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"humid","optionAShare":0.0,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":1.0},{"category":"weather","firstShare":0.9,"majorityOption":"dry","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"humid","optionAShare":0.4,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.2},{"category":"weather","firstShare":0.75,"majorityOption":"dry","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"humid","optionAShare":0.25,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.5},{"category":"weather","firstShare":0.45,"majorityOption":"dry","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"humid","optionAShare":0.05,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.9},{"category":"weather","firstShare":1.0,"majorityOption":"humid","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"humid","optionAShare":0.5,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.0},{"category":"weather","firstShare":0.5,"majorityOption":"dry","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"humid","optionAShare":0.0,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":1.0},{"category":"weather","firstShare":0.95,"majorityOption":"dry","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"humid","optionAShare":0.45,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.1},{"category":"weather","firstShare":0.6,"majorityOption":"dry","modelId":"inception/mercury-2","n":20,"optionA":"humid","optionAShare":0.1,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.8},{"category":"weather","firstShare":1.0,"majorityOption":"humid","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"humid","optionAShare":0.5,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.0},{"category":"weather","firstShare":1.0,"majorityOption":"humid","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"humid","optionAShare":0.5,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.0},{"category":"weather","firstShare":0.75,"majorityOption":"humid","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"humid","optionAShare":0.75,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.5},{"category":"weather","firstShare":1.0,"majorityOption":"humid","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"humid","optionAShare":0.5,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.0},{"category":"weather","firstShare":0.4,"majorityOption":"humid","modelId":"microsoft/phi-4","n":20,"optionA":"humid","optionAShare":0.9,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.8},{"category":"weather","firstShare":0.85,"majorityOption":"dry","modelId":"minimax/minimax-m2","n":20,"optionA":"humid","optionAShare":0.45,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.1},{"category":"weather","firstShare":1.0,"majorityOption":"humid","modelId":"minimax/minimax-m2.5","n":20,"optionA":"humid","optionAShare":0.5,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.0},{"category":"weather","firstShare":0.85,"majorityOption":"dry","modelId":"minimax/minimax-m2.7","n":20,"optionA":"humid","optionAShare":0.45,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.1},{"category":"weather","firstShare":0.75,"majorityOption":"dry","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"humid","optionAShare":0.25,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.5},{"category":"weather","firstShare":0.8,"majorityOption":"dry","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"humid","optionAShare":0.3,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.4},{"category":"weather","firstShare":0.5,"majorityOption":"humid","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"humid","optionAShare":1.0,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":1.0},{"category":"weather","firstShare":0.5,"majorityOption":"dry","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"humid","optionAShare":0.4,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.2},{"category":"weather","firstShare":0.8,"majorityOption":"dry","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"humid","optionAShare":0.3,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.4},{"category":"weather","firstShare":0.6,"majorityOption":"dry","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"humid","optionAShare":0.2,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.6},{"category":"weather","firstShare":1.0,"majorityOption":"humid","modelId":"openai/gpt-5-nano","n":20,"optionA":"humid","optionAShare":0.5,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.0},{"category":"weather","firstShare":0.1,"majorityOption":"humid","modelId":"openai/gpt-5.4","n":20,"optionA":"humid","optionAShare":0.5,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.0},{"category":"weather","firstShare":0.3,"majorityOption":"dry","modelId":"perplexity/sonar","n":20,"optionA":"humid","optionAShare":0.4,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.2},{"category":"weather","firstShare":0.75,"majorityOption":"dry","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"humid","optionAShare":0.35,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.3},{"category":"weather","firstShare":0.7,"majorityOption":"dry","modelId":"qwen/qwen3.6-max-preview","n":20,"optionA":"humid","optionAShare":0.2,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.6},{"category":"weather","firstShare":0.7,"majorityOption":"dry","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"humid","optionAShare":0.2,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.6},{"category":"weather","firstShare":0.5,"majorityOption":"dry","modelId":"rekaai/reka-flash-3","n":6,"optionA":"humid","optionAShare":0.1667,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.6667},{"category":"weather","firstShare":0.95,"majorityOption":"dry","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"humid","optionAShare":0.45,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.1},{"category":"weather","firstShare":0.85,"majorityOption":"dry","modelId":"tencent/hy3-preview:free","n":20,"optionA":"humid","optionAShare":0.35,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.3},{"category":"weather","firstShare":1.0,"majorityOption":"humid","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"humid","optionAShare":0.5,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.0},{"category":"weather","firstShare":0.8,"majorityOption":"dry","modelId":"x-ai/grok-4.3","n":20,"optionA":"humid","optionAShare":0.3,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.4},{"category":"weather","firstShare":0.65,"majorityOption":"dry","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"humid","optionAShare":0.15,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.7},{"category":"weather","firstShare":0.75,"majorityOption":"dry","modelId":"z-ai/glm-5","n":20,"optionA":"humid","optionAShare":0.25,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":0.5},{"category":"weather","firstShare":0.5,"majorityOption":"dry","modelId":"z-ai/glm-5.1","n":20,"optionA":"humid","optionAShare":0.0,"optionB":"dry","pairId":"weather_humid_dry","preferenceStrength":1.0},{"category":"weather","firstShare":0.55,"majorityOption":"windy","modelId":"amazon/nova-pro-v1","n":20,"optionA":"windy","optionAShare":0.75,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.5},{"category":"weather","firstShare":1.0,"majorityOption":"windy","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"windy","optionAShare":0.5,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.0},{"category":"weather","firstShare":1.0,"majorityOption":"windy","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"windy","optionAShare":0.5,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.0},{"category":"weather","firstShare":1.0,"majorityOption":"windy","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"windy","optionAShare":0.5,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.0},{"category":"weather","firstShare":0.45,"majorityOption":"windy","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"windy","optionAShare":0.95,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.9},{"category":"weather","firstShare":0.45,"majorityOption":"still","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"windy","optionAShare":0.25,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.5},{"category":"weather","firstShare":1.0,"majorityOption":"windy","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"windy","optionAShare":0.5,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.0},{"category":"weather","firstShare":0.6,"majorityOption":"still","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"windy","optionAShare":0.1,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.8},{"category":"weather","firstShare":0.5,"majorityOption":"still","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"windy","optionAShare":0.0,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":1.0},{"category":"weather","firstShare":0.9,"majorityOption":"still","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"windy","optionAShare":0.4,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.2},{"category":"weather","firstShare":0.55,"majorityOption":"still","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"windy","optionAShare":0.05,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.9},{"category":"weather","firstShare":0.5,"majorityOption":"still","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"windy","optionAShare":0.0,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":1.0},{"category":"weather","firstShare":0.8,"majorityOption":"still","modelId":"inception/mercury-2","n":20,"optionA":"windy","optionAShare":0.3,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.4},{"category":"weather","firstShare":0.75,"majorityOption":"windy","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"windy","optionAShare":0.75,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.5},{"category":"weather","firstShare":1.0,"majorityOption":"windy","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"windy","optionAShare":0.5,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.0},{"category":"weather","firstShare":0.5,"majorityOption":"still","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"windy","optionAShare":0.0,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":1.0},{"category":"weather","firstShare":1.0,"majorityOption":"windy","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"windy","optionAShare":0.5,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.0},{"category":"weather","firstShare":0.3684,"majorityOption":"windy","modelId":"microsoft/phi-4","n":19,"optionA":"windy","optionAShare":0.6842,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.3684},{"category":"weather","firstShare":0.95,"majorityOption":"still","modelId":"minimax/minimax-m2","n":20,"optionA":"windy","optionAShare":0.45,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.1},{"category":"weather","firstShare":0.95,"majorityOption":"still","modelId":"minimax/minimax-m2.5","n":20,"optionA":"windy","optionAShare":0.45,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.1},{"category":"weather","firstShare":0.95,"majorityOption":"windy","modelId":"minimax/minimax-m2.7","n":20,"optionA":"windy","optionAShare":0.55,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.1},{"category":"weather","firstShare":0.9,"majorityOption":"still","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"windy","optionAShare":0.4,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.2},{"category":"weather","firstShare":0.85,"majorityOption":"still","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"windy","optionAShare":0.35,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.3},{"category":"weather","firstShare":0.55,"majorityOption":"still","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"windy","optionAShare":0.25,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.5},{"category":"weather","firstShare":0.3,"majorityOption":"still","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"windy","optionAShare":0.2,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.6},{"category":"weather","firstShare":1.0,"majorityOption":"windy","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"windy","optionAShare":0.5,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.0},{"category":"weather","firstShare":0.55,"majorityOption":"still","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"windy","optionAShare":0.05,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.9},{"category":"weather","firstShare":0.65,"majorityOption":"windy","modelId":"openai/gpt-5-nano","n":20,"optionA":"windy","optionAShare":0.85,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.7},{"category":"weather","firstShare":0.05,"majorityOption":"windy","modelId":"openai/gpt-5.4","n":20,"optionA":"windy","optionAShare":0.55,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.1},{"category":"weather","firstShare":0.7,"majorityOption":"windy","modelId":"perplexity/sonar","n":20,"optionA":"windy","optionAShare":0.5,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.0},{"category":"weather","firstShare":0.6,"majorityOption":"still","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"windy","optionAShare":0.1,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.8},{"category":"weather","firstShare":0.6,"majorityOption":"windy","modelId":"qwen/qwen3.6-max-preview","n":20,"optionA":"windy","optionAShare":0.6,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.2},{"category":"weather","firstShare":0.8,"majorityOption":"windy","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"windy","optionAShare":0.7,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.4},{"category":"weather","firstShare":0.5,"majorityOption":"windy","modelId":"rekaai/reka-flash-3","n":2,"optionA":"windy","optionAShare":0.5,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.0},{"category":"weather","firstShare":0.5789,"majorityOption":"still","modelId":"tencent/hunyuan-a13b-instruct","n":19,"optionA":"windy","optionAShare":0.1053,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.7895},{"category":"weather","firstShare":0.65,"majorityOption":"still","modelId":"tencent/hy3-preview:free","n":20,"optionA":"windy","optionAShare":0.15,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.7},{"category":"weather","firstShare":0.75,"majorityOption":"windy","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"windy","optionAShare":0.55,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.1},{"category":"weather","firstShare":0.6,"majorityOption":"still","modelId":"x-ai/grok-4.3","n":20,"optionA":"windy","optionAShare":0.1,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.8},{"category":"weather","firstShare":0.55,"majorityOption":"still","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"windy","optionAShare":0.05,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.9},{"category":"weather","firstShare":0.7,"majorityOption":"still","modelId":"z-ai/glm-5","n":20,"optionA":"windy","optionAShare":0.2,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.6},{"category":"weather","firstShare":0.65,"majorityOption":"still","modelId":"z-ai/glm-5.1","n":20,"optionA":"windy","optionAShare":0.15,"optionB":"still","pairId":"weather_windy_still","preferenceStrength":0.7},{"category":"texture","firstShare":0.65,"majorityOption":"smooth","modelId":"amazon/nova-pro-v1","n":20,"optionA":"smooth","optionAShare":0.85,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":0.7},{"category":"texture","firstShare":0.5,"majorityOption":"smooth","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"smooth","optionAShare":1.0,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":1.0},{"category":"texture","firstShare":0.5,"majorityOption":"smooth","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"smooth","optionAShare":1.0,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":1.0},{"category":"texture","firstShare":0.95,"majorityOption":"smooth","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"smooth","optionAShare":0.55,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":0.1},{"category":"texture","firstShare":0.5,"majorityOption":"smooth","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"smooth","optionAShare":1.0,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":1.0},{"category":"texture","firstShare":0.5,"majorityOption":"smooth","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"smooth","optionAShare":0.8,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":0.6},{"category":"texture","firstShare":0.55,"majorityOption":"smooth","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"smooth","optionAShare":0.95,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":0.9},{"category":"texture","firstShare":0.5,"majorityOption":"smooth","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"smooth","optionAShare":1.0,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":1.0},{"category":"texture","firstShare":0.5,"majorityOption":"smooth","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"smooth","optionAShare":1.0,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":1.0},{"category":"texture","firstShare":0.5,"majorityOption":"smooth","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"smooth","optionAShare":1.0,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":1.0},{"category":"texture","firstShare":0.5,"majorityOption":"smooth","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"smooth","optionAShare":1.0,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":1.0},{"category":"texture","firstShare":0.5,"majorityOption":"smooth","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"smooth","optionAShare":1.0,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":1.0},{"category":"texture","firstShare":0.5,"majorityOption":"smooth","modelId":"inception/mercury-2","n":20,"optionA":"smooth","optionAShare":1.0,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":1.0},{"category":"texture","firstShare":1.0,"majorityOption":"smooth","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"smooth","optionAShare":0.5,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":0.0},{"category":"texture","firstShare":0.65,"majorityOption":"smooth","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"smooth","optionAShare":0.85,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":0.7},{"category":"texture","firstShare":0.6,"majorityOption":"smooth","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"smooth","optionAShare":0.9,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":0.8},{"category":"texture","firstShare":0.55,"majorityOption":"smooth","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"smooth","optionAShare":0.95,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":0.9},{"category":"texture","firstShare":0.2,"majorityOption":"smooth","modelId":"microsoft/phi-4","n":20,"optionA":"smooth","optionAShare":0.7,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":0.4},{"category":"texture","firstShare":0.65,"majorityOption":"smooth","modelId":"minimax/minimax-m2","n":20,"optionA":"smooth","optionAShare":0.85,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":0.7},{"category":"texture","firstShare":0.6,"majorityOption":"smooth","modelId":"minimax/minimax-m2.5","n":20,"optionA":"smooth","optionAShare":0.9,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":0.8},{"category":"texture","firstShare":0.8,"majorityOption":"smooth","modelId":"minimax/minimax-m2.7","n":20,"optionA":"smooth","optionAShare":0.7,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":0.4},{"category":"texture","firstShare":0.65,"majorityOption":"smooth","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"smooth","optionAShare":0.85,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":0.7},{"category":"texture","firstShare":0.8,"majorityOption":"smooth","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"smooth","optionAShare":0.7,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":0.4},{"category":"texture","firstShare":0.5,"majorityOption":"smooth","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"smooth","optionAShare":1.0,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":1.0},{"category":"texture","firstShare":0.6,"majorityOption":"smooth","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"smooth","optionAShare":0.8,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":0.6},{"category":"texture","firstShare":0.55,"majorityOption":"smooth","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"smooth","optionAShare":0.95,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":0.9},{"category":"texture","firstShare":0.5,"majorityOption":"smooth","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"smooth","optionAShare":1.0,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":1.0},{"category":"texture","firstShare":0.65,"majorityOption":"smooth","modelId":"openai/gpt-5-nano","n":20,"optionA":"smooth","optionAShare":0.85,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":0.7},{"category":"texture","firstShare":0.35,"majorityOption":"smooth","modelId":"openai/gpt-5.4","n":20,"optionA":"smooth","optionAShare":0.85,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":0.7},{"category":"texture","firstShare":0.6,"majorityOption":"smooth","modelId":"perplexity/sonar","n":20,"optionA":"smooth","optionAShare":0.9,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":0.8},{"category":"texture","firstShare":0.5,"majorityOption":"smooth","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"smooth","optionAShare":1.0,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":1.0},{"category":"texture","firstShare":0.5,"majorityOption":"smooth","modelId":"qwen/qwen3.6-max-preview","n":20,"optionA":"smooth","optionAShare":1.0,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":1.0},{"category":"texture","firstShare":0.5,"majorityOption":"smooth","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"smooth","optionAShare":1.0,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":1.0},{"category":"texture","firstShare":1.0,"majorityOption":"smooth","modelId":"rekaai/reka-flash-3","n":7,"optionA":"smooth","optionAShare":0.5714,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":0.1429},{"category":"texture","firstShare":1.0,"majorityOption":"smooth","modelId":"tencent/hunyuan-a13b-instruct","n":19,"optionA":"smooth","optionAShare":0.5263,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":0.0526},{"category":"texture","firstShare":0.5,"majorityOption":"smooth","modelId":"tencent/hy3-preview:free","n":20,"optionA":"smooth","optionAShare":1.0,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":1.0},{"category":"texture","firstShare":0.85,"majorityOption":"smooth","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"smooth","optionAShare":0.65,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":0.3},{"category":"texture","firstShare":0.5,"majorityOption":"smooth","modelId":"x-ai/grok-4.3","n":18,"optionA":"smooth","optionAShare":0.9444,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":0.8889},{"category":"texture","firstShare":0.6,"majorityOption":"smooth","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"smooth","optionAShare":0.9,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":0.8},{"category":"texture","firstShare":0.5,"majorityOption":"smooth","modelId":"z-ai/glm-5","n":20,"optionA":"smooth","optionAShare":1.0,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":1.0},{"category":"texture","firstShare":0.5,"majorityOption":"smooth","modelId":"z-ai/glm-5.1","n":20,"optionA":"smooth","optionAShare":1.0,"optionB":"rough","pairId":"texture_smooth_rough","preferenceStrength":1.0},{"category":"texture","firstShare":0.5,"majorityOption":"soft","modelId":"amazon/nova-pro-v1","n":20,"optionA":"soft","optionAShare":1.0,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":1.0},{"category":"texture","firstShare":0.5,"majorityOption":"soft","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"soft","optionAShare":1.0,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":1.0},{"category":"texture","firstShare":1.0,"majorityOption":"soft","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"soft","optionAShare":0.5,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.0},{"category":"texture","firstShare":1.0,"majorityOption":"soft","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"soft","optionAShare":0.5,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.0},{"category":"texture","firstShare":0.8,"majorityOption":"hard","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"soft","optionAShare":0.3,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.4},{"category":"texture","firstShare":0.7,"majorityOption":"soft","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"soft","optionAShare":0.8,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.6},{"category":"texture","firstShare":0.9,"majorityOption":"soft","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"soft","optionAShare":0.6,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.2},{"category":"texture","firstShare":0.7,"majorityOption":"soft","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"soft","optionAShare":0.8,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.6},{"category":"texture","firstShare":0.5,"majorityOption":"soft","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"soft","optionAShare":1.0,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":1.0},{"category":"texture","firstShare":0.95,"majorityOption":"soft","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"soft","optionAShare":0.55,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.1},{"category":"texture","firstShare":0.5,"majorityOption":"soft","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"soft","optionAShare":1.0,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":1.0},{"category":"texture","firstShare":0.65,"majorityOption":"soft","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"soft","optionAShare":0.85,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.7},{"category":"texture","firstShare":1.0,"majorityOption":"soft","modelId":"inception/mercury-2","n":20,"optionA":"soft","optionAShare":0.5,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.0},{"category":"texture","firstShare":1.0,"majorityOption":"soft","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"soft","optionAShare":0.5,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.0},{"category":"texture","firstShare":1.0,"majorityOption":"soft","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"soft","optionAShare":0.5,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.0},{"category":"texture","firstShare":0.65,"majorityOption":"soft","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"soft","optionAShare":0.85,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.7},{"category":"texture","firstShare":0.55,"majorityOption":"soft","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"soft","optionAShare":0.95,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.9},{"category":"texture","firstShare":0.4,"majorityOption":"soft","modelId":"microsoft/phi-4","n":20,"optionA":"soft","optionAShare":0.6,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.2},{"category":"texture","firstShare":1.0,"majorityOption":"soft","modelId":"minimax/minimax-m2","n":20,"optionA":"soft","optionAShare":0.5,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.0},{"category":"texture","firstShare":0.95,"majorityOption":"hard","modelId":"minimax/minimax-m2.5","n":20,"optionA":"soft","optionAShare":0.45,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.1},{"category":"texture","firstShare":0.95,"majorityOption":"soft","modelId":"minimax/minimax-m2.7","n":20,"optionA":"soft","optionAShare":0.55,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.1},{"category":"texture","firstShare":0.95,"majorityOption":"hard","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"soft","optionAShare":0.45,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.1},{"category":"texture","firstShare":0.45,"majorityOption":"soft","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"soft","optionAShare":0.85,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.7},{"category":"texture","firstShare":0.75,"majorityOption":"soft","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"soft","optionAShare":0.75,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.5},{"category":"texture","firstShare":0.5,"majorityOption":"hard","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"soft","optionAShare":0.0,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":1.0},{"category":"texture","firstShare":0.85,"majorityOption":"soft","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"soft","optionAShare":0.65,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.3},{"category":"texture","firstShare":0.95,"majorityOption":"soft","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"soft","optionAShare":0.55,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.1},{"category":"texture","firstShare":0.6,"majorityOption":"soft","modelId":"openai/gpt-5-nano","n":20,"optionA":"soft","optionAShare":0.9,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.8},{"category":"texture","firstShare":0.25,"majorityOption":"soft","modelId":"openai/gpt-5.4","n":20,"optionA":"soft","optionAShare":0.65,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.3},{"category":"texture","firstShare":0.55,"majorityOption":"hard","modelId":"perplexity/sonar","n":20,"optionA":"soft","optionAShare":0.45,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.1},{"category":"texture","firstShare":0.8,"majorityOption":"soft","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"soft","optionAShare":0.7,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.4},{"category":"texture","firstShare":0.9,"majorityOption":"soft","modelId":"qwen/qwen3.6-max-preview","n":20,"optionA":"soft","optionAShare":0.6,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.2},{"category":"texture","firstShare":0.85,"majorityOption":"soft","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"soft","optionAShare":0.65,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.3},{"category":"texture","firstShare":0.2,"majorityOption":"soft","modelId":"rekaai/reka-flash-3","n":5,"optionA":"soft","optionAShare":1.0,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":1.0},{"category":"texture","firstShare":0.95,"majorityOption":"soft","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"soft","optionAShare":0.55,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.1},{"category":"texture","firstShare":0.9,"majorityOption":"soft","modelId":"tencent/hy3-preview:free","n":20,"optionA":"soft","optionAShare":0.6,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.2},{"category":"texture","firstShare":0.7,"majorityOption":"hard","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"soft","optionAShare":0.2,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.6},{"category":"texture","firstShare":0.8947,"majorityOption":"soft","modelId":"x-ai/grok-4.3","n":19,"optionA":"soft","optionAShare":0.5789,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.1579},{"category":"texture","firstShare":0.6,"majorityOption":"soft","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"soft","optionAShare":0.7,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.4},{"category":"texture","firstShare":0.75,"majorityOption":"soft","modelId":"z-ai/glm-5","n":20,"optionA":"soft","optionAShare":0.75,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.5},{"category":"texture","firstShare":0.7,"majorityOption":"soft","modelId":"z-ai/glm-5.1","n":20,"optionA":"soft","optionAShare":0.8,"optionB":"hard","pairId":"texture_soft_hard","preferenceStrength":0.6},{"category":"shape","firstShare":0.55,"majorityOption":"circle","modelId":"amazon/nova-pro-v1","n":20,"optionA":"circle","optionAShare":0.95,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.9},{"category":"shape","firstShare":0.85,"majorityOption":"circle","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"circle","optionAShare":0.65,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.3},{"category":"shape","firstShare":0.5,"majorityOption":"circle","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"circle","optionAShare":1.0,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":1.0},{"category":"shape","firstShare":0.5,"majorityOption":"circle","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"circle","optionAShare":1.0,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":1.0},{"category":"shape","firstShare":0.55,"majorityOption":"circle","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"circle","optionAShare":0.95,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.9},{"category":"shape","firstShare":0.4,"majorityOption":"circle","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"circle","optionAShare":0.5,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.0},{"category":"shape","firstShare":0.9,"majorityOption":"circle","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"circle","optionAShare":0.6,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.2},{"category":"shape","firstShare":0.9,"majorityOption":"circle","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"circle","optionAShare":0.6,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.2},{"category":"shape","firstShare":0.25,"majorityOption":"circle","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"circle","optionAShare":0.75,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.5},{"category":"shape","firstShare":0.9,"majorityOption":"circle","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"circle","optionAShare":0.6,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.2},{"category":"shape","firstShare":0.5,"majorityOption":"circle","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"circle","optionAShare":1.0,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":1.0},{"category":"shape","firstShare":0.55,"majorityOption":"circle","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"circle","optionAShare":0.95,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.9},{"category":"shape","firstShare":0.75,"majorityOption":"circle","modelId":"inception/mercury-2","n":20,"optionA":"circle","optionAShare":0.75,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.5},{"category":"shape","firstShare":1.0,"majorityOption":"circle","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"circle","optionAShare":0.5,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.0},{"category":"shape","firstShare":0.95,"majorityOption":"circle","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"circle","optionAShare":0.55,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.1},{"category":"shape","firstShare":0.15,"majorityOption":"circle","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"circle","optionAShare":0.65,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.3},{"category":"shape","firstShare":0.5,"majorityOption":"circle","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"circle","optionAShare":1.0,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":1.0},{"category":"shape","firstShare":0.5,"majorityOption":"circle","modelId":"microsoft/phi-4","n":20,"optionA":"circle","optionAShare":1.0,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":1.0},{"category":"shape","firstShare":0.7,"majorityOption":"circle","modelId":"minimax/minimax-m2","n":20,"optionA":"circle","optionAShare":0.7,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.4},{"category":"shape","firstShare":0.9,"majorityOption":"circle","modelId":"minimax/minimax-m2.5","n":20,"optionA":"circle","optionAShare":0.6,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.2},{"category":"shape","firstShare":0.95,"majorityOption":"circle","modelId":"minimax/minimax-m2.7","n":20,"optionA":"circle","optionAShare":0.55,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.1},{"category":"shape","firstShare":0.8,"majorityOption":"circle","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"circle","optionAShare":0.5,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.0},{"category":"shape","firstShare":0.35,"majorityOption":"square","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"circle","optionAShare":0.15,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.7},{"category":"shape","firstShare":0.5,"majorityOption":"square","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"circle","optionAShare":0.0,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":1.0},{"category":"shape","firstShare":0.65,"majorityOption":"circle","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"circle","optionAShare":0.55,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.1},{"category":"shape","firstShare":0.9,"majorityOption":"circle","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"circle","optionAShare":0.6,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.2},{"category":"shape","firstShare":1.0,"majorityOption":"circle","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"circle","optionAShare":0.5,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.0},{"category":"shape","firstShare":0.5,"majorityOption":"circle","modelId":"openai/gpt-5-nano","n":20,"optionA":"circle","optionAShare":1.0,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":1.0},{"category":"shape","firstShare":0.2,"majorityOption":"circle","modelId":"openai/gpt-5.4","n":20,"optionA":"circle","optionAShare":0.7,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.4},{"category":"shape","firstShare":0.5,"majorityOption":"square","modelId":"perplexity/sonar","n":20,"optionA":"circle","optionAShare":0.3,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.4},{"category":"shape","firstShare":0.55,"majorityOption":"circle","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"circle","optionAShare":0.95,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.9},{"category":"shape","firstShare":0.5,"majorityOption":"circle","modelId":"qwen/qwen3.6-max-preview","n":20,"optionA":"circle","optionAShare":1.0,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":1.0},{"category":"shape","firstShare":0.6,"majorityOption":"circle","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"circle","optionAShare":0.9,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.8},{"category":"shape","firstShare":0.1429,"majorityOption":"circle","modelId":"rekaai/reka-flash-3","n":7,"optionA":"circle","optionAShare":0.5714,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.1429},{"category":"shape","firstShare":1.0,"majorityOption":"circle","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"circle","optionAShare":0.5,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.0},{"category":"shape","firstShare":0.85,"majorityOption":"circle","modelId":"tencent/hy3-preview:free","n":20,"optionA":"circle","optionAShare":0.65,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.3},{"category":"shape","firstShare":0.55,"majorityOption":"circle","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"circle","optionAShare":0.95,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.9},{"category":"shape","firstShare":0.65,"majorityOption":"circle","modelId":"x-ai/grok-4.3","n":20,"optionA":"circle","optionAShare":0.75,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.5},{"category":"shape","firstShare":0.7,"majorityOption":"circle","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"circle","optionAShare":0.7,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.4},{"category":"shape","firstShare":0.55,"majorityOption":"circle","modelId":"z-ai/glm-5","n":20,"optionA":"circle","optionAShare":0.95,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":0.9},{"category":"shape","firstShare":0.5,"majorityOption":"circle","modelId":"z-ai/glm-5.1","n":20,"optionA":"circle","optionAShare":1.0,"optionB":"square","pairId":"shape_circle_square","preferenceStrength":1.0},{"category":"shape","firstShare":0.35,"majorityOption":"oval","modelId":"amazon/nova-pro-v1","n":20,"optionA":"triangle","optionAShare":0.45,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.1},{"category":"shape","firstShare":1.0,"majorityOption":"triangle","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"triangle","optionAShare":0.5,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.0},{"category":"shape","firstShare":0.9,"majorityOption":"oval","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"triangle","optionAShare":0.4,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.2},{"category":"shape","firstShare":1.0,"majorityOption":"triangle","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"triangle","optionAShare":0.5,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.0},{"category":"shape","firstShare":0.3,"majorityOption":"triangle","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"triangle","optionAShare":0.5,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.0},{"category":"shape","firstShare":0.75,"majorityOption":"triangle","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"triangle","optionAShare":0.65,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.3},{"category":"shape","firstShare":1.0,"majorityOption":"triangle","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"triangle","optionAShare":0.5,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.0},{"category":"shape","firstShare":0.9,"majorityOption":"oval","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"triangle","optionAShare":0.4,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.2},{"category":"shape","firstShare":0.5,"majorityOption":"triangle","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"triangle","optionAShare":1.0,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":1.0},{"category":"shape","firstShare":1.0,"majorityOption":"triangle","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"triangle","optionAShare":0.5,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.0},{"category":"shape","firstShare":0.5,"majorityOption":"triangle","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"triangle","optionAShare":1.0,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":1.0},{"category":"shape","firstShare":1.0,"majorityOption":"triangle","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"triangle","optionAShare":0.5,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.0},{"category":"shape","firstShare":1.0,"majorityOption":"triangle","modelId":"inception/mercury-2","n":20,"optionA":"triangle","optionAShare":0.5,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.0},{"category":"shape","firstShare":1.0,"majorityOption":"triangle","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"triangle","optionAShare":0.5,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.0},{"category":"shape","firstShare":1.0,"majorityOption":"triangle","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"triangle","optionAShare":0.5,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.0},{"category":"shape","firstShare":0.8,"majorityOption":"oval","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"triangle","optionAShare":0.3,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.4},{"category":"shape","firstShare":0.5,"majorityOption":"oval","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"triangle","optionAShare":0.0,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":1.0},{"category":"shape","firstShare":0.95,"majorityOption":"oval","modelId":"microsoft/phi-4","n":20,"optionA":"triangle","optionAShare":0.45,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.1},{"category":"shape","firstShare":0.95,"majorityOption":"oval","modelId":"minimax/minimax-m2","n":20,"optionA":"triangle","optionAShare":0.45,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.1},{"category":"shape","firstShare":1.0,"majorityOption":"triangle","modelId":"minimax/minimax-m2.5","n":20,"optionA":"triangle","optionAShare":0.5,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.0},{"category":"shape","firstShare":1.0,"majorityOption":"triangle","modelId":"minimax/minimax-m2.7","n":20,"optionA":"triangle","optionAShare":0.5,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.0},{"category":"shape","firstShare":0.95,"majorityOption":"triangle","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"triangle","optionAShare":0.55,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.1},{"category":"shape","firstShare":0.85,"majorityOption":"triangle","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"triangle","optionAShare":0.55,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.1},{"category":"shape","firstShare":0.5,"majorityOption":"oval","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"triangle","optionAShare":0.0,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":1.0},{"category":"shape","firstShare":0.8,"majorityOption":"triangle","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"triangle","optionAShare":0.6,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.2},{"category":"shape","firstShare":0.95,"majorityOption":"oval","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"triangle","optionAShare":0.45,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.1},{"category":"shape","firstShare":1.0,"majorityOption":"triangle","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"triangle","optionAShare":0.5,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.0},{"category":"shape","firstShare":0.6,"majorityOption":"oval","modelId":"openai/gpt-5-nano","n":20,"optionA":"triangle","optionAShare":0.1,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.8},{"category":"shape","firstShare":0.45,"majorityOption":"triangle","modelId":"openai/gpt-5.4","n":20,"optionA":"triangle","optionAShare":0.95,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.9},{"category":"shape","firstShare":0.7,"majorityOption":"oval","modelId":"perplexity/sonar","n":20,"optionA":"triangle","optionAShare":0.3,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.4},{"category":"shape","firstShare":0.85,"majorityOption":"oval","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"triangle","optionAShare":0.45,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.1},{"category":"shape","firstShare":0.75,"majorityOption":"triangle","modelId":"qwen/qwen3.6-max-preview","n":20,"optionA":"triangle","optionAShare":0.75,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.5},{"category":"shape","firstShare":0.7,"majorityOption":"triangle","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"triangle","optionAShare":0.8,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.6},{"category":"shape","firstShare":0.375,"majorityOption":"oval","modelId":"rekaai/reka-flash-3","n":8,"optionA":"triangle","optionAShare":0.25,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.5},{"category":"shape","firstShare":1.0,"majorityOption":"triangle","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"triangle","optionAShare":0.5,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.0},{"category":"shape","firstShare":0.95,"majorityOption":"triangle","modelId":"tencent/hy3-preview:free","n":20,"optionA":"triangle","optionAShare":0.55,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.1},{"category":"shape","firstShare":1.0,"majorityOption":"triangle","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"triangle","optionAShare":0.5,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.0},{"category":"shape","firstShare":0.9,"majorityOption":"triangle","modelId":"x-ai/grok-4.3","n":20,"optionA":"triangle","optionAShare":0.5,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.0},{"category":"shape","firstShare":0.85,"majorityOption":"oval","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"triangle","optionAShare":0.35,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.3},{"category":"shape","firstShare":0.95,"majorityOption":"triangle","modelId":"z-ai/glm-5","n":20,"optionA":"triangle","optionAShare":0.55,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.1},{"category":"shape","firstShare":0.95,"majorityOption":"triangle","modelId":"z-ai/glm-5.1","n":20,"optionA":"triangle","optionAShare":0.55,"optionB":"oval","pairId":"shape_triangle_oval","preferenceStrength":0.1},{"category":"material","firstShare":0.75,"majorityOption":"wood","modelId":"amazon/nova-pro-v1","n":20,"optionA":"wood","optionAShare":0.65,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.3},{"category":"material","firstShare":0.5,"majorityOption":"wood","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"wood","optionAShare":1.0,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":1.0},{"category":"material","firstShare":0.5,"majorityOption":"wood","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"wood","optionAShare":1.0,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":1.0},{"category":"material","firstShare":0.5,"majorityOption":"wood","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"wood","optionAShare":1.0,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":1.0},{"category":"material","firstShare":0.1,"majorityOption":"metal","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"wood","optionAShare":0.4,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.2},{"category":"material","firstShare":0.55,"majorityOption":"wood","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"wood","optionAShare":0.85,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.7},{"category":"material","firstShare":0.9,"majorityOption":"metal","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"wood","optionAShare":0.4,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.2},{"category":"material","firstShare":0.9,"majorityOption":"wood","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"wood","optionAShare":0.5,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.0},{"category":"material","firstShare":0.3,"majorityOption":"wood","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"wood","optionAShare":0.6,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.2},{"category":"material","firstShare":0.5,"majorityOption":"wood","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"wood","optionAShare":0.9,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.8},{"category":"material","firstShare":0.45,"majorityOption":"wood","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"wood","optionAShare":0.95,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.9},{"category":"material","firstShare":0.4,"majorityOption":"metal","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"wood","optionAShare":0.4,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.2},{"category":"material","firstShare":0.95,"majorityOption":"metal","modelId":"inception/mercury-2","n":20,"optionA":"wood","optionAShare":0.45,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.1},{"category":"material","firstShare":1.0,"majorityOption":"wood","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"wood","optionAShare":0.5,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.0},{"category":"material","firstShare":1.0,"majorityOption":"wood","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"wood","optionAShare":0.5,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.0},{"category":"material","firstShare":1.0,"majorityOption":"wood","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"wood","optionAShare":0.5,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.0},{"category":"material","firstShare":1.0,"majorityOption":"wood","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"wood","optionAShare":0.5,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.0},{"category":"material","firstShare":0.35,"majorityOption":"metal","modelId":"microsoft/phi-4","n":20,"optionA":"wood","optionAShare":0.45,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.1},{"category":"material","firstShare":0.95,"majorityOption":"metal","modelId":"minimax/minimax-m2","n":20,"optionA":"wood","optionAShare":0.45,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.1},{"category":"material","firstShare":0.9,"majorityOption":"metal","modelId":"minimax/minimax-m2.5","n":20,"optionA":"wood","optionAShare":0.4,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.2},{"category":"material","firstShare":0.95,"majorityOption":"metal","modelId":"minimax/minimax-m2.7","n":20,"optionA":"wood","optionAShare":0.45,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.1},{"category":"material","firstShare":0.95,"majorityOption":"wood","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"wood","optionAShare":0.55,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.1},{"category":"material","firstShare":0.75,"majorityOption":"wood","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"wood","optionAShare":0.75,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.5},{"category":"material","firstShare":0.45,"majorityOption":"metal","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"wood","optionAShare":0.05,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.9},{"category":"material","firstShare":0.7,"majorityOption":"metal","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"wood","optionAShare":0.3,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.4},{"category":"material","firstShare":0.9,"majorityOption":"wood","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"wood","optionAShare":0.6,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.2},{"category":"material","firstShare":1.0,"majorityOption":"wood","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"wood","optionAShare":0.5,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.0},{"category":"material","firstShare":0.55,"majorityOption":"wood","modelId":"openai/gpt-5-nano","n":20,"optionA":"wood","optionAShare":0.85,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.7},{"category":"material","firstShare":0.2,"majorityOption":"wood","modelId":"openai/gpt-5.4","n":20,"optionA":"wood","optionAShare":0.6,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.2},{"category":"material","firstShare":0.55,"majorityOption":"metal","modelId":"perplexity/sonar","n":20,"optionA":"wood","optionAShare":0.15,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.7},{"category":"material","firstShare":0.85,"majorityOption":"wood","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"wood","optionAShare":0.65,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.3},{"category":"material","firstShare":0.5,"majorityOption":"wood","modelId":"qwen/qwen3.6-max-preview","n":20,"optionA":"wood","optionAShare":0.7,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.4},{"category":"material","firstShare":0.65,"majorityOption":"wood","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"wood","optionAShare":0.85,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.7},{"category":"material","firstShare":0.2,"majorityOption":"wood","modelId":"rekaai/reka-flash-3","n":5,"optionA":"wood","optionAShare":0.8,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.6},{"category":"material","firstShare":1.0,"majorityOption":"wood","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"wood","optionAShare":0.5,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.0},{"category":"material","firstShare":0.9,"majorityOption":"wood","modelId":"tencent/hy3-preview:free","n":20,"optionA":"wood","optionAShare":0.6,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.2},{"category":"material","firstShare":0.95,"majorityOption":"metal","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"wood","optionAShare":0.45,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.1},{"category":"material","firstShare":1.0,"majorityOption":"wood","modelId":"x-ai/grok-4.3","n":20,"optionA":"wood","optionAShare":0.5,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.0},{"category":"material","firstShare":0.65,"majorityOption":"wood","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"wood","optionAShare":0.85,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.7},{"category":"material","firstShare":0.8,"majorityOption":"wood","modelId":"z-ai/glm-5","n":20,"optionA":"wood","optionAShare":0.5,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.0},{"category":"material","firstShare":0.55,"majorityOption":"metal","modelId":"z-ai/glm-5.1","n":20,"optionA":"wood","optionAShare":0.25,"optionB":"metal","pairId":"material_wood_metal","preferenceStrength":0.5},{"category":"material","firstShare":0.35,"majorityOption":"stone","modelId":"amazon/nova-pro-v1","n":20,"optionA":"glass","optionAShare":0.45,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.1},{"category":"material","firstShare":0.5,"majorityOption":"stone","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"glass","optionAShare":0.3,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.4},{"category":"material","firstShare":0.5,"majorityOption":"stone","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"glass","optionAShare":0.0,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":1.0},{"category":"material","firstShare":0.8,"majorityOption":"glass","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"glass","optionAShare":0.7,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.4},{"category":"material","firstShare":0.1,"majorityOption":"glass","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"glass","optionAShare":0.5,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.0},{"category":"material","firstShare":0.6,"majorityOption":"stone","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"glass","optionAShare":0.4,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.2},{"category":"material","firstShare":0.9,"majorityOption":"glass","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"glass","optionAShare":0.5,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.0},{"category":"material","firstShare":0.5,"majorityOption":"stone","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"glass","optionAShare":0.1,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.8},{"category":"material","firstShare":0.35,"majorityOption":"stone","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"glass","optionAShare":0.15,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.7},{"category":"material","firstShare":0.5,"majorityOption":"stone","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"glass","optionAShare":0.0,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":1.0},{"category":"material","firstShare":0.55,"majorityOption":"stone","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"glass","optionAShare":0.15,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.7},{"category":"material","firstShare":1.0,"majorityOption":"glass","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"glass","optionAShare":0.5,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.0},{"category":"material","firstShare":1.0,"majorityOption":"glass","modelId":"inception/mercury-2","n":20,"optionA":"glass","optionAShare":0.5,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.0},{"category":"material","firstShare":1.0,"majorityOption":"glass","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"glass","optionAShare":0.5,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.0},{"category":"material","firstShare":1.0,"majorityOption":"glass","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"glass","optionAShare":0.5,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.0},{"category":"material","firstShare":1.0,"majorityOption":"glass","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"glass","optionAShare":0.5,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.0},{"category":"material","firstShare":0.5,"majorityOption":"glass","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"glass","optionAShare":1.0,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":1.0},{"category":"material","firstShare":0.2,"majorityOption":"glass","modelId":"microsoft/phi-4","n":20,"optionA":"glass","optionAShare":0.5,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.0},{"category":"material","firstShare":0.8,"majorityOption":"glass","modelId":"minimax/minimax-m2","n":20,"optionA":"glass","optionAShare":0.7,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.4},{"category":"material","firstShare":0.8,"majorityOption":"glass","modelId":"minimax/minimax-m2.5","n":20,"optionA":"glass","optionAShare":0.7,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.4},{"category":"material","firstShare":0.9,"majorityOption":"glass","modelId":"minimax/minimax-m2.7","n":20,"optionA":"glass","optionAShare":0.6,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.2},{"category":"material","firstShare":0.95,"majorityOption":"glass","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"glass","optionAShare":0.55,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.1},{"category":"material","firstShare":0.8,"majorityOption":"glass","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"glass","optionAShare":0.5,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.0},{"category":"material","firstShare":0.6,"majorityOption":"stone","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"glass","optionAShare":0.3,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.4},{"category":"material","firstShare":0.7,"majorityOption":"glass","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"glass","optionAShare":0.7,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.4},{"category":"material","firstShare":1.0,"majorityOption":"glass","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"glass","optionAShare":0.5,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.0},{"category":"material","firstShare":0.95,"majorityOption":"stone","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"glass","optionAShare":0.45,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.1},{"category":"material","firstShare":0.65,"majorityOption":"glass","modelId":"openai/gpt-5-nano","n":20,"optionA":"glass","optionAShare":0.55,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.1},{"category":"material","firstShare":0.05,"majorityOption":"stone","modelId":"openai/gpt-5.4","n":20,"optionA":"glass","optionAShare":0.45,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.1},{"category":"material","firstShare":0.5,"majorityOption":"glass","modelId":"perplexity/sonar","n":20,"optionA":"glass","optionAShare":0.9,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.8},{"category":"material","firstShare":0.6,"majorityOption":"stone","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"glass","optionAShare":0.1,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.8},{"category":"material","firstShare":0.5,"majorityOption":"stone","modelId":"qwen/qwen3.6-max-preview","n":20,"optionA":"glass","optionAShare":0.0,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":1.0},{"category":"material","firstShare":0.6,"majorityOption":"stone","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"glass","optionAShare":0.1,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.8},{"category":"material","firstShare":0.4286,"majorityOption":"glass","modelId":"rekaai/reka-flash-3","n":7,"optionA":"glass","optionAShare":0.7143,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.4286},{"category":"material","firstShare":0.95,"majorityOption":"glass","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"glass","optionAShare":0.55,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.1},{"category":"material","firstShare":0.95,"majorityOption":"stone","modelId":"tencent/hy3-preview:free","n":20,"optionA":"glass","optionAShare":0.45,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.1},{"category":"material","firstShare":0.85,"majorityOption":"stone","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"glass","optionAShare":0.45,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.1},{"category":"material","firstShare":0.95,"majorityOption":"glass","modelId":"x-ai/grok-4.3","n":20,"optionA":"glass","optionAShare":0.55,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.1},{"category":"material","firstShare":0.6,"majorityOption":"stone","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"glass","optionAShare":0.2,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":0.6},{"category":"material","firstShare":0.5,"majorityOption":"stone","modelId":"z-ai/glm-5","n":20,"optionA":"glass","optionAShare":0.0,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":1.0},{"category":"material","firstShare":0.5,"majorityOption":"stone","modelId":"z-ai/glm-5.1","n":20,"optionA":"glass","optionAShare":0.0,"optionB":"stone","pairId":"material_glass_stone","preferenceStrength":1.0},{"category":"direction","firstShare":0.7,"majorityOption":"left","modelId":"amazon/nova-pro-v1","n":20,"optionA":"left","optionAShare":0.7,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.4},{"category":"direction","firstShare":0.6,"majorityOption":"right","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"left","optionAShare":0.1,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.8},{"category":"direction","firstShare":0.5,"majorityOption":"right","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"left","optionAShare":0.0,"optionB":"right","pairId":"direction_left_right","preferenceStrength":1.0},{"category":"direction","firstShare":1.0,"majorityOption":"left","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"left","optionAShare":0.5,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.0},{"category":"direction","firstShare":0.95,"majorityOption":"right","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"left","optionAShare":0.45,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.1},{"category":"direction","firstShare":0.2,"majorityOption":"left","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"left","optionAShare":0.5,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.0},{"category":"direction","firstShare":1.0,"majorityOption":"left","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"left","optionAShare":0.5,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.0},{"category":"direction","firstShare":0.95,"majorityOption":"right","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"left","optionAShare":0.45,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.1},{"category":"direction","firstShare":0.4,"majorityOption":"right","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"left","optionAShare":0.2,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.6},{"category":"direction","firstShare":0.7,"majorityOption":"right","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"left","optionAShare":0.2,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.6},{"category":"direction","firstShare":0.85,"majorityOption":"right","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"left","optionAShare":0.45,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.1},{"category":"direction","firstShare":0.8,"majorityOption":"right","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"left","optionAShare":0.3,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.4},{"category":"direction","firstShare":0.9,"majorityOption":"right","modelId":"inception/mercury-2","n":20,"optionA":"left","optionAShare":0.4,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.2},{"category":"direction","firstShare":1.0,"majorityOption":"left","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"left","optionAShare":0.5,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.0},{"category":"direction","firstShare":1.0,"majorityOption":"left","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"left","optionAShare":0.5,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.0},{"category":"direction","firstShare":1.0,"majorityOption":"left","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"left","optionAShare":0.5,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.0},{"category":"direction","firstShare":1.0,"majorityOption":"left","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"left","optionAShare":0.5,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.0},{"category":"direction","firstShare":0.45,"majorityOption":"right","modelId":"microsoft/phi-4","n":20,"optionA":"left","optionAShare":0.05,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.9},{"category":"direction","firstShare":0.9,"majorityOption":"right","modelId":"minimax/minimax-m2","n":20,"optionA":"left","optionAShare":0.4,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.2},{"category":"direction","firstShare":1.0,"majorityOption":"left","modelId":"minimax/minimax-m2.5","n":20,"optionA":"left","optionAShare":0.5,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.0},{"category":"direction","firstShare":0.95,"majorityOption":"left","modelId":"minimax/minimax-m2.7","n":20,"optionA":"left","optionAShare":0.55,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.1},{"category":"direction","firstShare":0.8,"majorityOption":"left","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"left","optionAShare":0.7,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.4},{"category":"direction","firstShare":0.85,"majorityOption":"right","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"left","optionAShare":0.45,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.1},{"category":"direction","firstShare":0.25,"majorityOption":"right","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"left","optionAShare":0.25,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.5},{"category":"direction","firstShare":0.2,"majorityOption":"right","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"left","optionAShare":0.3,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.4},{"category":"direction","firstShare":0.85,"majorityOption":"right","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"left","optionAShare":0.35,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.3},{"category":"direction","firstShare":0.95,"majorityOption":"right","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"left","optionAShare":0.45,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.1},{"category":"direction","firstShare":0.9,"majorityOption":"left","modelId":"openai/gpt-5-nano","n":20,"optionA":"left","optionAShare":0.6,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.2},{"category":"direction","firstShare":0.0,"majorityOption":"left","modelId":"openai/gpt-5.4","n":20,"optionA":"left","optionAShare":0.5,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.0},{"category":"direction","firstShare":0.2,"majorityOption":"left","modelId":"perplexity/sonar","n":20,"optionA":"left","optionAShare":0.7,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.4},{"category":"direction","firstShare":0.95,"majorityOption":"right","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"left","optionAShare":0.45,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.1},{"category":"direction","firstShare":0.8,"majorityOption":"left","modelId":"qwen/qwen3.6-max-preview","n":20,"optionA":"left","optionAShare":0.7,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.4},{"category":"direction","firstShare":0.8,"majorityOption":"left","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"left","optionAShare":0.6,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.2},{"category":"direction","firstShare":0.25,"majorityOption":"right","modelId":"rekaai/reka-flash-3","n":8,"optionA":"left","optionAShare":0.25,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.5},{"category":"direction","firstShare":1.0,"majorityOption":"left","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"left","optionAShare":0.5,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.0},{"category":"direction","firstShare":0.8,"majorityOption":"right","modelId":"tencent/hy3-preview:free","n":20,"optionA":"left","optionAShare":0.3,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.4},{"category":"direction","firstShare":1.0,"majorityOption":"left","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"left","optionAShare":0.5,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.0},{"category":"direction","firstShare":1.0,"majorityOption":"right","modelId":"x-ai/grok-4.3","n":19,"optionA":"left","optionAShare":0.4737,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.0526},{"category":"direction","firstShare":0.75,"majorityOption":"left","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"left","optionAShare":0.55,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.1},{"category":"direction","firstShare":0.65,"majorityOption":"right","modelId":"z-ai/glm-5","n":20,"optionA":"left","optionAShare":0.15,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.7},{"category":"direction","firstShare":0.55,"majorityOption":"right","modelId":"z-ai/glm-5.1","n":20,"optionA":"left","optionAShare":0.15,"optionB":"right","pairId":"direction_left_right","preferenceStrength":0.7},{"category":"direction","firstShare":0.8,"majorityOption":"up","modelId":"amazon/nova-pro-v1","n":20,"optionA":"up","optionAShare":0.6,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.2},{"category":"direction","firstShare":0.5,"majorityOption":"up","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"up","optionAShare":1.0,"optionB":"down","pairId":"direction_up_down","preferenceStrength":1.0},{"category":"direction","firstShare":0.5,"majorityOption":"up","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"up","optionAShare":1.0,"optionB":"down","pairId":"direction_up_down","preferenceStrength":1.0},{"category":"direction","firstShare":1.0,"majorityOption":"up","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"up","optionAShare":0.5,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.0},{"category":"direction","firstShare":0.55,"majorityOption":"up","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"up","optionAShare":0.95,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.9},{"category":"direction","firstShare":0.5,"majorityOption":"down","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"up","optionAShare":0.0,"optionB":"down","pairId":"direction_up_down","preferenceStrength":1.0},{"category":"direction","firstShare":0.55,"majorityOption":"up","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"up","optionAShare":0.95,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.9},{"category":"direction","firstShare":0.9,"majorityOption":"up","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"up","optionAShare":0.6,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.2},{"category":"direction","firstShare":0.5,"majorityOption":"up","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"up","optionAShare":1.0,"optionB":"down","pairId":"direction_up_down","preferenceStrength":1.0},{"category":"direction","firstShare":0.5,"majorityOption":"up","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"up","optionAShare":1.0,"optionB":"down","pairId":"direction_up_down","preferenceStrength":1.0},{"category":"direction","firstShare":0.5,"majorityOption":"up","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"up","optionAShare":1.0,"optionB":"down","pairId":"direction_up_down","preferenceStrength":1.0},{"category":"direction","firstShare":1.0,"majorityOption":"up","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"up","optionAShare":0.5,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.0},{"category":"direction","firstShare":0.6,"majorityOption":"up","modelId":"inception/mercury-2","n":20,"optionA":"up","optionAShare":0.9,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.8},{"category":"direction","firstShare":0.55,"majorityOption":"up","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"up","optionAShare":0.95,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.9},{"category":"direction","firstShare":0.55,"majorityOption":"up","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"up","optionAShare":0.95,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.9},{"category":"direction","firstShare":0.5,"majorityOption":"up","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"up","optionAShare":1.0,"optionB":"down","pairId":"direction_up_down","preferenceStrength":1.0},{"category":"direction","firstShare":0.5,"majorityOption":"up","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"up","optionAShare":1.0,"optionB":"down","pairId":"direction_up_down","preferenceStrength":1.0},{"category":"direction","firstShare":0.55,"majorityOption":"up","modelId":"microsoft/phi-4","n":20,"optionA":"up","optionAShare":0.65,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.3},{"category":"direction","firstShare":0.6,"majorityOption":"up","modelId":"minimax/minimax-m2","n":20,"optionA":"up","optionAShare":0.9,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.8},{"category":"direction","firstShare":0.85,"majorityOption":"up","modelId":"minimax/minimax-m2.5","n":20,"optionA":"up","optionAShare":0.65,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.3},{"category":"direction","firstShare":0.8,"majorityOption":"up","modelId":"minimax/minimax-m2.7","n":20,"optionA":"up","optionAShare":0.7,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.4},{"category":"direction","firstShare":0.8,"majorityOption":"up","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"up","optionAShare":0.7,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.4},{"category":"direction","firstShare":0.55,"majorityOption":"up","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"up","optionAShare":0.75,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.5},{"category":"direction","firstShare":0.45,"majorityOption":"up","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"up","optionAShare":0.65,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.3},{"category":"direction","firstShare":0.35,"majorityOption":"up","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"up","optionAShare":0.65,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.3},{"category":"direction","firstShare":0.6,"majorityOption":"up","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"up","optionAShare":0.9,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.8},{"category":"direction","firstShare":0.55,"majorityOption":"up","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"up","optionAShare":0.95,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.9},{"category":"direction","firstShare":0.5,"majorityOption":"up","modelId":"openai/gpt-5-nano","n":20,"optionA":"up","optionAShare":1.0,"optionB":"down","pairId":"direction_up_down","preferenceStrength":1.0},{"category":"direction","firstShare":0.2,"majorityOption":"up","modelId":"openai/gpt-5.4","n":20,"optionA":"up","optionAShare":0.7,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.4},{"category":"direction","firstShare":0.8,"majorityOption":"up","modelId":"perplexity/sonar","n":20,"optionA":"up","optionAShare":0.7,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.4},{"category":"direction","firstShare":0.65,"majorityOption":"up","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"up","optionAShare":0.85,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.7},{"category":"direction","firstShare":0.4737,"majorityOption":"up","modelId":"qwen/qwen3.6-max-preview","n":19,"optionA":"up","optionAShare":1.0,"optionB":"down","pairId":"direction_up_down","preferenceStrength":1.0},{"category":"direction","firstShare":0.5,"majorityOption":"up","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"up","optionAShare":1.0,"optionB":"down","pairId":"direction_up_down","preferenceStrength":1.0},{"category":"direction","firstShare":0.3333,"majorityOption":"up","modelId":"rekaai/reka-flash-3","n":6,"optionA":"up","optionAShare":0.6667,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.3333},{"category":"direction","firstShare":0.8,"majorityOption":"up","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"up","optionAShare":0.7,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.4},{"category":"direction","firstShare":0.5,"majorityOption":"up","modelId":"tencent/hy3-preview:free","n":20,"optionA":"up","optionAShare":1.0,"optionB":"down","pairId":"direction_up_down","preferenceStrength":1.0},{"category":"direction","firstShare":0.5,"majorityOption":"up","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"up","optionAShare":1.0,"optionB":"down","pairId":"direction_up_down","preferenceStrength":1.0},{"category":"direction","firstShare":0.5,"majorityOption":"up","modelId":"x-ai/grok-4.3","n":20,"optionA":"up","optionAShare":1.0,"optionB":"down","pairId":"direction_up_down","preferenceStrength":1.0},{"category":"direction","firstShare":0.55,"majorityOption":"up","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"up","optionAShare":0.85,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.7},{"category":"direction","firstShare":0.65,"majorityOption":"up","modelId":"z-ai/glm-5","n":20,"optionA":"up","optionAShare":0.85,"optionB":"down","pairId":"direction_up_down","preferenceStrength":0.7},{"category":"direction","firstShare":0.5,"majorityOption":"up","modelId":"z-ai/glm-5.1","n":20,"optionA":"up","optionAShare":1.0,"optionB":"down","pairId":"direction_up_down","preferenceStrength":1.0},{"category":"sound","firstShare":0.75,"majorityOption":"quiet","modelId":"amazon/nova-pro-v1","n":20,"optionA":"loud","optionAShare":0.25,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":0.5},{"category":"sound","firstShare":0.5,"majorityOption":"quiet","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"loud","optionAShare":0.0,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":1.0},{"category":"sound","firstShare":0.5,"majorityOption":"quiet","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"loud","optionAShare":0.0,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":1.0},{"category":"sound","firstShare":0.5,"majorityOption":"quiet","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"loud","optionAShare":0.0,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":1.0},{"category":"sound","firstShare":0.6,"majorityOption":"quiet","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"loud","optionAShare":0.1,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":0.8},{"category":"sound","firstShare":0.6,"majorityOption":"quiet","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"loud","optionAShare":0.1,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":0.8},{"category":"sound","firstShare":0.5,"majorityOption":"quiet","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"loud","optionAShare":0.0,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":1.0},{"category":"sound","firstShare":0.5,"majorityOption":"quiet","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"loud","optionAShare":0.0,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":1.0},{"category":"sound","firstShare":0.5,"majorityOption":"quiet","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"loud","optionAShare":0.0,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":1.0},{"category":"sound","firstShare":0.5,"majorityOption":"quiet","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"loud","optionAShare":0.0,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":1.0},{"category":"sound","firstShare":0.5,"majorityOption":"quiet","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"loud","optionAShare":0.0,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":1.0},{"category":"sound","firstShare":0.5,"majorityOption":"quiet","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"loud","optionAShare":0.0,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":1.0},{"category":"sound","firstShare":0.5,"majorityOption":"quiet","modelId":"inception/mercury-2","n":20,"optionA":"loud","optionAShare":0.0,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":1.0},{"category":"sound","firstShare":1.0,"majorityOption":"loud","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"loud","optionAShare":0.5,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":0.0},{"category":"sound","firstShare":0.9,"majorityOption":"quiet","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"loud","optionAShare":0.4,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":0.2},{"category":"sound","firstShare":1.0,"majorityOption":"loud","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"loud","optionAShare":0.5,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":0.0},{"category":"sound","firstShare":0.5,"majorityOption":"quiet","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"loud","optionAShare":0.0,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":1.0},{"category":"sound","firstShare":0.5,"majorityOption":"quiet","modelId":"microsoft/phi-4","n":20,"optionA":"loud","optionAShare":0.0,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":1.0},{"category":"sound","firstShare":0.8,"majorityOption":"quiet","modelId":"minimax/minimax-m2","n":20,"optionA":"loud","optionAShare":0.3,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":0.4},{"category":"sound","firstShare":0.7,"majorityOption":"quiet","modelId":"minimax/minimax-m2.5","n":20,"optionA":"loud","optionAShare":0.3,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":0.4},{"category":"sound","firstShare":0.85,"majorityOption":"quiet","modelId":"minimax/minimax-m2.7","n":20,"optionA":"loud","optionAShare":0.35,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":0.3},{"category":"sound","firstShare":0.65,"majorityOption":"quiet","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"loud","optionAShare":0.25,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":0.5},{"category":"sound","firstShare":0.7,"majorityOption":"quiet","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"loud","optionAShare":0.3,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":0.4},{"category":"sound","firstShare":0.45,"majorityOption":"quiet","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"loud","optionAShare":0.05,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":0.9},{"category":"sound","firstShare":0.5,"majorityOption":"quiet","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"loud","optionAShare":0.0,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":1.0},{"category":"sound","firstShare":0.55,"majorityOption":"quiet","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"loud","optionAShare":0.05,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":0.9},{"category":"sound","firstShare":0.5,"majorityOption":"quiet","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"loud","optionAShare":0.0,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":1.0},{"category":"sound","firstShare":0.6,"majorityOption":"quiet","modelId":"openai/gpt-5-nano","n":20,"optionA":"loud","optionAShare":0.1,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":0.8},{"category":"sound","firstShare":0.5,"majorityOption":"quiet","modelId":"openai/gpt-5.4","n":20,"optionA":"loud","optionAShare":0.0,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":1.0},{"category":"sound","firstShare":0.5,"majorityOption":"quiet","modelId":"perplexity/sonar","n":20,"optionA":"loud","optionAShare":0.0,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":1.0},{"category":"sound","firstShare":0.75,"majorityOption":"quiet","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"loud","optionAShare":0.25,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":0.5},{"category":"sound","firstShare":0.5,"majorityOption":"quiet","modelId":"qwen/qwen3.6-max-preview","n":20,"optionA":"loud","optionAShare":0.0,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":1.0},{"category":"sound","firstShare":0.55,"majorityOption":"quiet","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"loud","optionAShare":0.05,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":0.9},{"category":"sound","firstShare":0.4,"majorityOption":"quiet","modelId":"rekaai/reka-flash-3","n":5,"optionA":"loud","optionAShare":0.0,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":1.0},{"category":"sound","firstShare":0.9474,"majorityOption":"loud","modelId":"tencent/hunyuan-a13b-instruct","n":19,"optionA":"loud","optionAShare":0.5789,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":0.1579},{"category":"sound","firstShare":0.5,"majorityOption":"quiet","modelId":"tencent/hy3-preview:free","n":20,"optionA":"loud","optionAShare":0.0,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":1.0},{"category":"sound","firstShare":0.8,"majorityOption":"loud","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"loud","optionAShare":0.5,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":0.0},{"category":"sound","firstShare":0.6,"majorityOption":"quiet","modelId":"x-ai/grok-4.3","n":20,"optionA":"loud","optionAShare":0.1,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":0.8},{"category":"sound","firstShare":0.7,"majorityOption":"quiet","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"loud","optionAShare":0.2,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":0.6},{"category":"sound","firstShare":0.5,"majorityOption":"quiet","modelId":"z-ai/glm-5","n":20,"optionA":"loud","optionAShare":0.0,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":1.0},{"category":"sound","firstShare":0.5,"majorityOption":"quiet","modelId":"z-ai/glm-5.1","n":20,"optionA":"loud","optionAShare":0.0,"optionB":"quiet","pairId":"sound_loud_quiet","preferenceStrength":1.0},{"category":"sound","firstShare":0.3,"majorityOption":"mellow","modelId":"amazon/nova-pro-v1","n":20,"optionA":"sharp","optionAShare":0.3,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.4},{"category":"sound","firstShare":0.5,"majorityOption":"mellow","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"sharp","optionAShare":0.0,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":1.0},{"category":"sound","firstShare":1.0,"majorityOption":"sharp","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"sharp","optionAShare":0.5,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.0},{"category":"sound","firstShare":0.5,"majorityOption":"mellow","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"sharp","optionAShare":0.0,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":1.0},{"category":"sound","firstShare":0.5,"majorityOption":"mellow","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"sharp","optionAShare":0.0,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":1.0},{"category":"sound","firstShare":0.6,"majorityOption":"mellow","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"sharp","optionAShare":0.3,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.4},{"category":"sound","firstShare":0.9,"majorityOption":"mellow","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"sharp","optionAShare":0.4,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.2},{"category":"sound","firstShare":0.75,"majorityOption":"mellow","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"sharp","optionAShare":0.25,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.5},{"category":"sound","firstShare":0.5,"majorityOption":"mellow","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"sharp","optionAShare":0.0,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":1.0},{"category":"sound","firstShare":0.5,"majorityOption":"mellow","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"sharp","optionAShare":0.0,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":1.0},{"category":"sound","firstShare":0.5263,"majorityOption":"mellow","modelId":"google/gemini-3.1-pro-preview","n":19,"optionA":"sharp","optionAShare":0.0,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":1.0},{"category":"sound","firstShare":1.0,"majorityOption":"sharp","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"sharp","optionAShare":0.5,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.0},{"category":"sound","firstShare":0.7,"majorityOption":"sharp","modelId":"inception/mercury-2","n":20,"optionA":"sharp","optionAShare":0.8,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.6},{"category":"sound","firstShare":1.0,"majorityOption":"sharp","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"sharp","optionAShare":0.5,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.0},{"category":"sound","firstShare":1.0,"majorityOption":"sharp","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"sharp","optionAShare":0.5,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.0},{"category":"sound","firstShare":0.95,"majorityOption":"mellow","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"sharp","optionAShare":0.45,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.1},{"category":"sound","firstShare":0.5,"majorityOption":"mellow","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"sharp","optionAShare":0.0,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":1.0},{"category":"sound","firstShare":0.45,"majorityOption":"mellow","modelId":"microsoft/phi-4","n":20,"optionA":"sharp","optionAShare":0.05,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.9},{"category":"sound","firstShare":0.7,"majorityOption":"mellow","modelId":"minimax/minimax-m2","n":20,"optionA":"sharp","optionAShare":0.2,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.6},{"category":"sound","firstShare":0.95,"majorityOption":"mellow","modelId":"minimax/minimax-m2.5","n":20,"optionA":"sharp","optionAShare":0.45,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.1},{"category":"sound","firstShare":0.75,"majorityOption":"mellow","modelId":"minimax/minimax-m2.7","n":20,"optionA":"sharp","optionAShare":0.35,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.3},{"category":"sound","firstShare":0.7,"majorityOption":"sharp","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"sharp","optionAShare":0.6,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.2},{"category":"sound","firstShare":0.9,"majorityOption":"sharp","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"sharp","optionAShare":0.6,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.2},{"category":"sound","firstShare":0.5,"majorityOption":"mellow","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"sharp","optionAShare":0.0,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":1.0},{"category":"sound","firstShare":0.5,"majorityOption":"mellow","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"sharp","optionAShare":0.2,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.6},{"category":"sound","firstShare":0.95,"majorityOption":"mellow","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"sharp","optionAShare":0.45,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.1},{"category":"sound","firstShare":0.9,"majorityOption":"sharp","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"sharp","optionAShare":0.6,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.2},{"category":"sound","firstShare":0.85,"majorityOption":"mellow","modelId":"openai/gpt-5-nano","n":20,"optionA":"sharp","optionAShare":0.35,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.3},{"category":"sound","firstShare":0.2,"majorityOption":"mellow","modelId":"openai/gpt-5.4","n":20,"optionA":"sharp","optionAShare":0.4,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.2},{"category":"sound","firstShare":0.55,"majorityOption":"mellow","modelId":"perplexity/sonar","n":20,"optionA":"sharp","optionAShare":0.05,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.9},{"category":"sound","firstShare":0.6,"majorityOption":"mellow","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"sharp","optionAShare":0.1,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.8},{"category":"sound","firstShare":0.4737,"majorityOption":"mellow","modelId":"qwen/qwen3.6-max-preview","n":19,"optionA":"sharp","optionAShare":0.0,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":1.0},{"category":"sound","firstShare":0.55,"majorityOption":"mellow","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"sharp","optionAShare":0.05,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.9},{"category":"sound","firstShare":0.3333,"majorityOption":"sharp","modelId":"rekaai/reka-flash-3","n":3,"optionA":"sharp","optionAShare":1.0,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":1.0},{"category":"sound","firstShare":1.0,"majorityOption":"sharp","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"sharp","optionAShare":0.5,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.0},{"category":"sound","firstShare":0.5,"majorityOption":"mellow","modelId":"tencent/hy3-preview:free","n":20,"optionA":"sharp","optionAShare":0.0,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":1.0},{"category":"sound","firstShare":0.75,"majorityOption":"sharp","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"sharp","optionAShare":0.75,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.5},{"category":"sound","firstShare":0.85,"majorityOption":"mellow","modelId":"x-ai/grok-4.3","n":20,"optionA":"sharp","optionAShare":0.35,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.3},{"category":"sound","firstShare":0.45,"majorityOption":"mellow","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"sharp","optionAShare":0.05,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.9},{"category":"sound","firstShare":0.9,"majorityOption":"sharp","modelId":"z-ai/glm-5","n":20,"optionA":"sharp","optionAShare":0.6,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.2},{"category":"sound","firstShare":0.65,"majorityOption":"sharp","modelId":"z-ai/glm-5.1","n":20,"optionA":"sharp","optionAShare":0.55,"optionB":"mellow","pairId":"sound_sharp_mellow","preferenceStrength":0.1},{"category":"taste","firstShare":0.45,"majorityOption":"sweet","modelId":"amazon/nova-pro-v1","n":20,"optionA":"sweet","optionAShare":0.95,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":0.9},{"category":"taste","firstShare":0.5,"majorityOption":"sweet","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"sweet","optionAShare":1.0,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":1.0},{"category":"taste","firstShare":0.9,"majorityOption":"sweet","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"sweet","optionAShare":0.6,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":0.2},{"category":"taste","firstShare":1.0,"majorityOption":"sweet","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"sweet","optionAShare":0.5,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":0.0},{"category":"taste","firstShare":0.5,"majorityOption":"sweet","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"sweet","optionAShare":1.0,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":1.0},{"category":"taste","firstShare":0.7,"majorityOption":"sweet","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"sweet","optionAShare":0.5,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":0.0},{"category":"taste","firstShare":0.55,"majorityOption":"sweet","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"sweet","optionAShare":0.95,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":0.9},{"category":"taste","firstShare":0.5,"majorityOption":"sweet","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"sweet","optionAShare":1.0,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":1.0},{"category":"taste","firstShare":0.5,"majorityOption":"sweet","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"sweet","optionAShare":1.0,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":1.0},{"category":"taste","firstShare":0.5,"majorityOption":"sweet","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"sweet","optionAShare":1.0,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":1.0},{"category":"taste","firstShare":0.5,"majorityOption":"sweet","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"sweet","optionAShare":1.0,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":1.0},{"category":"taste","firstShare":0.5,"majorityOption":"sweet","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"sweet","optionAShare":1.0,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":1.0},{"category":"taste","firstShare":0.55,"majorityOption":"sweet","modelId":"inception/mercury-2","n":20,"optionA":"sweet","optionAShare":0.95,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":0.9},{"category":"taste","firstShare":1.0,"majorityOption":"sweet","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"sweet","optionAShare":0.5,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":0.0},{"category":"taste","firstShare":0.5,"majorityOption":"sweet","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"sweet","optionAShare":1.0,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":1.0},{"category":"taste","firstShare":0.5,"majorityOption":"sweet","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"sweet","optionAShare":1.0,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":1.0},{"category":"taste","firstShare":0.5,"majorityOption":"sweet","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"sweet","optionAShare":1.0,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":1.0},{"category":"taste","firstShare":0.4,"majorityOption":"sweet","modelId":"microsoft/phi-4","n":20,"optionA":"sweet","optionAShare":0.9,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":0.8},{"category":"taste","firstShare":0.5,"majorityOption":"sweet","modelId":"minimax/minimax-m2","n":20,"optionA":"sweet","optionAShare":1.0,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":1.0},{"category":"taste","firstShare":0.6,"majorityOption":"sweet","modelId":"minimax/minimax-m2.5","n":20,"optionA":"sweet","optionAShare":0.9,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":0.8},{"category":"taste","firstShare":0.5,"majorityOption":"sweet","modelId":"minimax/minimax-m2.7","n":20,"optionA":"sweet","optionAShare":1.0,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":1.0},{"category":"taste","firstShare":0.45,"majorityOption":"sweet","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"sweet","optionAShare":0.95,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":0.9},{"category":"taste","firstShare":0.75,"majorityOption":"sweet","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"sweet","optionAShare":0.75,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":0.5},{"category":"taste","firstShare":0.4,"majorityOption":"sweet","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"sweet","optionAShare":0.9,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":0.8},{"category":"taste","firstShare":0.25,"majorityOption":"bitter","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"sweet","optionAShare":0.45,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":0.1},{"category":"taste","firstShare":0.7,"majorityOption":"sweet","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"sweet","optionAShare":0.8,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":0.6},{"category":"taste","firstShare":0.5,"majorityOption":"sweet","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"sweet","optionAShare":1.0,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":1.0},{"category":"taste","firstShare":0.5,"majorityOption":"sweet","modelId":"openai/gpt-5-nano","n":20,"optionA":"sweet","optionAShare":1.0,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":1.0},{"category":"taste","firstShare":0.45,"majorityOption":"sweet","modelId":"openai/gpt-5.4","n":20,"optionA":"sweet","optionAShare":0.95,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":0.9},{"category":"taste","firstShare":0.5,"majorityOption":"sweet","modelId":"perplexity/sonar","n":20,"optionA":"sweet","optionAShare":1.0,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":1.0},{"category":"taste","firstShare":0.5,"majorityOption":"sweet","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"sweet","optionAShare":1.0,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":1.0},{"category":"taste","firstShare":0.4737,"majorityOption":"sweet","modelId":"qwen/qwen3.6-max-preview","n":19,"optionA":"sweet","optionAShare":1.0,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":1.0},{"category":"taste","firstShare":0.5,"majorityOption":"sweet","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"sweet","optionAShare":1.0,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":1.0},{"category":"taste","firstShare":0.25,"majorityOption":"bitter","modelId":"rekaai/reka-flash-3","n":4,"optionA":"sweet","optionAShare":0.25,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":0.5},{"category":"taste","firstShare":0.65,"majorityOption":"sweet","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"sweet","optionAShare":0.85,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":0.7},{"category":"taste","firstShare":0.5,"majorityOption":"sweet","modelId":"tencent/hy3-preview:free","n":20,"optionA":"sweet","optionAShare":1.0,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":1.0},{"category":"taste","firstShare":0.5,"majorityOption":"sweet","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"sweet","optionAShare":1.0,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":1.0},{"category":"taste","firstShare":0.4737,"majorityOption":"sweet","modelId":"x-ai/grok-4.3","n":19,"optionA":"sweet","optionAShare":1.0,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":1.0},{"category":"taste","firstShare":0.5,"majorityOption":"sweet","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"sweet","optionAShare":1.0,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":1.0},{"category":"taste","firstShare":0.5,"majorityOption":"sweet","modelId":"z-ai/glm-5","n":20,"optionA":"sweet","optionAShare":1.0,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":1.0},{"category":"taste","firstShare":0.5,"majorityOption":"sweet","modelId":"z-ai/glm-5.1","n":20,"optionA":"sweet","optionAShare":1.0,"optionB":"bitter","pairId":"taste_sweet_bitter","preferenceStrength":1.0},{"category":"taste","firstShare":0.55,"majorityOption":"sour","modelId":"amazon/nova-pro-v1","n":20,"optionA":"salty","optionAShare":0.25,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.5},{"category":"taste","firstShare":1.0,"majorityOption":"salty","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"salty","optionAShare":0.5,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.0},{"category":"taste","firstShare":0.5,"majorityOption":"salty","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"salty","optionAShare":1.0,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":1.0},{"category":"taste","firstShare":1.0,"majorityOption":"salty","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"salty","optionAShare":0.5,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.0},{"category":"taste","firstShare":0.55,"majorityOption":"sour","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"salty","optionAShare":0.05,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.9},{"category":"taste","firstShare":0.3,"majorityOption":"sour","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"salty","optionAShare":0.3,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.4},{"category":"taste","firstShare":1.0,"majorityOption":"salty","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"salty","optionAShare":0.5,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.0},{"category":"taste","firstShare":0.7,"majorityOption":"salty","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"salty","optionAShare":0.8,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.6},{"category":"taste","firstShare":0.2,"majorityOption":"salty","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"salty","optionAShare":0.7,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.4},{"category":"taste","firstShare":0.75,"majorityOption":"salty","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"salty","optionAShare":0.75,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.5},{"category":"taste","firstShare":0.5,"majorityOption":"salty","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"salty","optionAShare":1.0,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":1.0},{"category":"taste","firstShare":0.5,"majorityOption":"salty","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"salty","optionAShare":1.0,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":1.0},{"category":"taste","firstShare":0.95,"majorityOption":"salty","modelId":"inception/mercury-2","n":20,"optionA":"salty","optionAShare":0.55,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.1},{"category":"taste","firstShare":1.0,"majorityOption":"salty","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"salty","optionAShare":0.5,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.0},{"category":"taste","firstShare":1.0,"majorityOption":"salty","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"salty","optionAShare":0.5,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.0},{"category":"taste","firstShare":0.8,"majorityOption":"salty","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"salty","optionAShare":0.6,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.2},{"category":"taste","firstShare":0.55,"majorityOption":"sour","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"salty","optionAShare":0.45,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.1},{"category":"taste","firstShare":0.5,"majorityOption":"sour","modelId":"microsoft/phi-4","n":20,"optionA":"salty","optionAShare":0.0,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":1.0},{"category":"taste","firstShare":0.65,"majorityOption":"salty","modelId":"minimax/minimax-m2","n":20,"optionA":"salty","optionAShare":0.65,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.3},{"category":"taste","firstShare":1.0,"majorityOption":"salty","modelId":"minimax/minimax-m2.5","n":20,"optionA":"salty","optionAShare":0.5,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.0},{"category":"taste","firstShare":0.9,"majorityOption":"sour","modelId":"minimax/minimax-m2.7","n":20,"optionA":"salty","optionAShare":0.4,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.2},{"category":"taste","firstShare":0.85,"majorityOption":"sour","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"salty","optionAShare":0.35,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.3},{"category":"taste","firstShare":0.6,"majorityOption":"sour","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"salty","optionAShare":0.1,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.8},{"category":"taste","firstShare":0.5,"majorityOption":"sour","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"salty","optionAShare":0.2,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.6},{"category":"taste","firstShare":0.45,"majorityOption":"sour","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"salty","optionAShare":0.35,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.3},{"category":"taste","firstShare":0.95,"majorityOption":"salty","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"salty","optionAShare":0.55,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.1},{"category":"taste","firstShare":0.7,"majorityOption":"sour","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"salty","optionAShare":0.2,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.6},{"category":"taste","firstShare":1.0,"majorityOption":"salty","modelId":"openai/gpt-5-nano","n":20,"optionA":"salty","optionAShare":0.5,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.0},{"category":"taste","firstShare":0.0,"majorityOption":"salty","modelId":"openai/gpt-5.4","n":20,"optionA":"salty","optionAShare":0.5,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.0},{"category":"taste","firstShare":0.55,"majorityOption":"sour","modelId":"perplexity/sonar","n":20,"optionA":"salty","optionAShare":0.05,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.9},{"category":"taste","firstShare":0.45,"majorityOption":"salty","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"salty","optionAShare":0.85,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.7},{"category":"taste","firstShare":0.5,"majorityOption":"salty","modelId":"qwen/qwen3.6-max-preview","n":20,"optionA":"salty","optionAShare":1.0,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":1.0},{"category":"taste","firstShare":0.65,"majorityOption":"salty","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"salty","optionAShare":0.85,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.7},{"category":"taste","firstShare":1.0,"majorityOption":"sour","modelId":"rekaai/reka-flash-3","n":3,"optionA":"salty","optionAShare":0.3333,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.3333},{"category":"taste","firstShare":0.9,"majorityOption":"sour","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"salty","optionAShare":0.4,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.2},{"category":"taste","firstShare":0.95,"majorityOption":"salty","modelId":"tencent/hy3-preview:free","n":20,"optionA":"salty","optionAShare":0.55,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.1},{"category":"taste","firstShare":1.0,"majorityOption":"salty","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"salty","optionAShare":0.5,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.0},{"category":"taste","firstShare":1.0,"majorityOption":"salty","modelId":"x-ai/grok-4.3","n":20,"optionA":"salty","optionAShare":0.5,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.0},{"category":"taste","firstShare":0.45,"majorityOption":"salty","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"salty","optionAShare":0.75,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":0.5},{"category":"taste","firstShare":0.5,"majorityOption":"salty","modelId":"z-ai/glm-5","n":20,"optionA":"salty","optionAShare":1.0,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":1.0},{"category":"taste","firstShare":0.5,"majorityOption":"salty","modelId":"z-ai/glm-5.1","n":20,"optionA":"salty","optionAShare":1.0,"optionB":"sour","pairId":"taste_salty_sour","preferenceStrength":1.0},{"category":"time","firstShare":0.75,"majorityOption":"morning","modelId":"amazon/nova-pro-v1","n":20,"optionA":"morning","optionAShare":0.75,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.5},{"category":"time","firstShare":0.5,"majorityOption":"morning","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"morning","optionAShare":1.0,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":1.0},{"category":"time","firstShare":0.5,"majorityOption":"morning","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"morning","optionAShare":1.0,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":1.0},{"category":"time","firstShare":1.0,"majorityOption":"morning","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"morning","optionAShare":0.5,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.0},{"category":"time","firstShare":0.5,"majorityOption":"morning","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"morning","optionAShare":1.0,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":1.0},{"category":"time","firstShare":0.45,"majorityOption":"evening","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"morning","optionAShare":0.35,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.3},{"category":"time","firstShare":0.6,"majorityOption":"morning","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"morning","optionAShare":0.9,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.8},{"category":"time","firstShare":0.5,"majorityOption":"morning","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"morning","optionAShare":1.0,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":1.0},{"category":"time","firstShare":0.45,"majorityOption":"morning","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"morning","optionAShare":0.95,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.9},{"category":"time","firstShare":0.9,"majorityOption":"evening","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"morning","optionAShare":0.4,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.2},{"category":"time","firstShare":0.15,"majorityOption":"morning","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"morning","optionAShare":0.55,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.1},{"category":"time","firstShare":1.0,"majorityOption":"morning","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"morning","optionAShare":0.5,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.0},{"category":"time","firstShare":0.55,"majorityOption":"morning","modelId":"inception/mercury-2","n":20,"optionA":"morning","optionAShare":0.95,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.9},{"category":"time","firstShare":1.0,"majorityOption":"morning","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"morning","optionAShare":0.5,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.0},{"category":"time","firstShare":1.0,"majorityOption":"morning","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"morning","optionAShare":0.5,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.0},{"category":"time","firstShare":0.4,"majorityOption":"morning","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"morning","optionAShare":0.6,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.2},{"category":"time","firstShare":0.95,"majorityOption":"morning","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"morning","optionAShare":0.55,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.1},{"category":"time","firstShare":0.55,"majorityOption":"morning","modelId":"microsoft/phi-4","n":20,"optionA":"morning","optionAShare":0.65,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.3},{"category":"time","firstShare":0.6,"majorityOption":"morning","modelId":"minimax/minimax-m2","n":20,"optionA":"morning","optionAShare":0.9,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.8},{"category":"time","firstShare":0.5,"majorityOption":"morning","modelId":"minimax/minimax-m2.5","n":20,"optionA":"morning","optionAShare":1.0,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":1.0},{"category":"time","firstShare":0.5,"majorityOption":"morning","modelId":"minimax/minimax-m2.7","n":20,"optionA":"morning","optionAShare":1.0,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":1.0},{"category":"time","firstShare":0.55,"majorityOption":"morning","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"morning","optionAShare":0.65,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.3},{"category":"time","firstShare":0.8,"majorityOption":"morning","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"morning","optionAShare":0.7,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.4},{"category":"time","firstShare":0.5,"majorityOption":"morning","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"morning","optionAShare":1.0,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":1.0},{"category":"time","firstShare":0.55,"majorityOption":"morning","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"morning","optionAShare":0.65,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.3},{"category":"time","firstShare":0.65,"majorityOption":"morning","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"morning","optionAShare":0.85,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.7},{"category":"time","firstShare":0.5,"majorityOption":"morning","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"morning","optionAShare":1.0,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":1.0},{"category":"time","firstShare":0.95,"majorityOption":"morning","modelId":"openai/gpt-5-nano","n":20,"optionA":"morning","optionAShare":0.55,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.1},{"category":"time","firstShare":0.0,"majorityOption":"morning","modelId":"openai/gpt-5.4","n":20,"optionA":"morning","optionAShare":0.5,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.0},{"category":"time","firstShare":0.5,"majorityOption":"evening","modelId":"perplexity/sonar","n":20,"optionA":"morning","optionAShare":0.0,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":1.0},{"category":"time","firstShare":0.35,"majorityOption":"morning","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"morning","optionAShare":0.75,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.5},{"category":"time","firstShare":0.5,"majorityOption":"morning","modelId":"qwen/qwen3.6-max-preview","n":20,"optionA":"morning","optionAShare":1.0,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":1.0},{"category":"time","firstShare":0.6,"majorityOption":"morning","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"morning","optionAShare":0.9,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.8},{"category":"time","firstShare":0.5714,"majorityOption":"evening","modelId":"rekaai/reka-flash-3","n":7,"optionA":"morning","optionAShare":0.2857,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.4286},{"category":"time","firstShare":0.5,"majorityOption":"morning","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"morning","optionAShare":1.0,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":1.0},{"category":"time","firstShare":0.6,"majorityOption":"morning","modelId":"tencent/hy3-preview:free","n":20,"optionA":"morning","optionAShare":0.9,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.8},{"category":"time","firstShare":0.6,"majorityOption":"morning","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"morning","optionAShare":0.9,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.8},{"category":"time","firstShare":0.6667,"majorityOption":"morning","modelId":"x-ai/grok-4.3","n":18,"optionA":"morning","optionAShare":0.7778,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.5556},{"category":"time","firstShare":0.45,"majorityOption":"morning","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"morning","optionAShare":0.85,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.7},{"category":"time","firstShare":1.0,"majorityOption":"morning","modelId":"z-ai/glm-5","n":20,"optionA":"morning","optionAShare":0.5,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.0},{"category":"time","firstShare":0.85,"majorityOption":"evening","modelId":"z-ai/glm-5.1","n":20,"optionA":"morning","optionAShare":0.45,"optionB":"evening","pairId":"time_morning_evening","preferenceStrength":0.1},{"category":"time","firstShare":0.6,"majorityOption":"early","modelId":"amazon/nova-pro-v1","n":20,"optionA":"early","optionAShare":0.8,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.6},{"category":"time","firstShare":0.5,"majorityOption":"early","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"early","optionAShare":1.0,"optionB":"late","pairId":"time_early_late","preferenceStrength":1.0},{"category":"time","firstShare":0.95,"majorityOption":"early","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"early","optionAShare":0.55,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.1},{"category":"time","firstShare":1.0,"majorityOption":"early","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"early","optionAShare":0.5,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.0},{"category":"time","firstShare":0.5,"majorityOption":"early","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"early","optionAShare":1.0,"optionB":"late","pairId":"time_early_late","preferenceStrength":1.0},{"category":"time","firstShare":0.6,"majorityOption":"early","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"early","optionAShare":0.9,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.8},{"category":"time","firstShare":0.55,"majorityOption":"early","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"early","optionAShare":0.95,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.9},{"category":"time","firstShare":0.8,"majorityOption":"early","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"early","optionAShare":0.7,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.4},{"category":"time","firstShare":0.5,"majorityOption":"early","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"early","optionAShare":1.0,"optionB":"late","pairId":"time_early_late","preferenceStrength":1.0},{"category":"time","firstShare":0.5,"majorityOption":"early","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"early","optionAShare":1.0,"optionB":"late","pairId":"time_early_late","preferenceStrength":1.0},{"category":"time","firstShare":0.5,"majorityOption":"early","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"early","optionAShare":1.0,"optionB":"late","pairId":"time_early_late","preferenceStrength":1.0},{"category":"time","firstShare":1.0,"majorityOption":"early","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"early","optionAShare":0.5,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.0},{"category":"time","firstShare":0.6,"majorityOption":"early","modelId":"inception/mercury-2","n":20,"optionA":"early","optionAShare":0.9,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.8},{"category":"time","firstShare":1.0,"majorityOption":"early","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"early","optionAShare":0.5,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.0},{"category":"time","firstShare":0.75,"majorityOption":"early","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"early","optionAShare":0.75,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.5},{"category":"time","firstShare":0.75,"majorityOption":"early","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"early","optionAShare":0.75,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.5},{"category":"time","firstShare":0.5,"majorityOption":"early","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"early","optionAShare":1.0,"optionB":"late","pairId":"time_early_late","preferenceStrength":1.0},{"category":"time","firstShare":0.45,"majorityOption":"early","modelId":"microsoft/phi-4","n":20,"optionA":"early","optionAShare":0.65,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.3},{"category":"time","firstShare":0.8,"majorityOption":"early","modelId":"minimax/minimax-m2","n":20,"optionA":"early","optionAShare":0.7,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.4},{"category":"time","firstShare":0.7,"majorityOption":"early","modelId":"minimax/minimax-m2.5","n":20,"optionA":"early","optionAShare":0.8,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.6},{"category":"time","firstShare":0.6,"majorityOption":"early","modelId":"minimax/minimax-m2.7","n":20,"optionA":"early","optionAShare":0.9,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.8},{"category":"time","firstShare":0.55,"majorityOption":"early","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"early","optionAShare":0.95,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.9},{"category":"time","firstShare":0.5,"majorityOption":"early","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"early","optionAShare":0.9,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.8},{"category":"time","firstShare":0.5,"majorityOption":"early","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"early","optionAShare":1.0,"optionB":"late","pairId":"time_early_late","preferenceStrength":1.0},{"category":"time","firstShare":0.35,"majorityOption":"early","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"early","optionAShare":0.85,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.7},{"category":"time","firstShare":0.55,"majorityOption":"early","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"early","optionAShare":0.95,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.9},{"category":"time","firstShare":0.5,"majorityOption":"early","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"early","optionAShare":1.0,"optionB":"late","pairId":"time_early_late","preferenceStrength":1.0},{"category":"time","firstShare":0.5,"majorityOption":"early","modelId":"openai/gpt-5-nano","n":20,"optionA":"early","optionAShare":1.0,"optionB":"late","pairId":"time_early_late","preferenceStrength":1.0},{"category":"time","firstShare":0.2,"majorityOption":"late","modelId":"openai/gpt-5.4","n":20,"optionA":"early","optionAShare":0.3,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.4},{"category":"time","firstShare":0.05,"majorityOption":"early","modelId":"perplexity/sonar","n":20,"optionA":"early","optionAShare":0.55,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.1},{"category":"time","firstShare":0.7,"majorityOption":"early","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"early","optionAShare":0.8,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.6},{"category":"time","firstShare":0.5,"majorityOption":"early","modelId":"qwen/qwen3.6-max-preview","n":20,"optionA":"early","optionAShare":1.0,"optionB":"late","pairId":"time_early_late","preferenceStrength":1.0},{"category":"time","firstShare":0.65,"majorityOption":"early","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"early","optionAShare":0.85,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.7},{"category":"time","firstShare":0.3333,"majorityOption":"late","modelId":"rekaai/reka-flash-3","n":6,"optionA":"early","optionAShare":0.3333,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.3333},{"category":"time","firstShare":0.5,"majorityOption":"early","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"early","optionAShare":1.0,"optionB":"late","pairId":"time_early_late","preferenceStrength":1.0},{"category":"time","firstShare":0.95,"majorityOption":"early","modelId":"tencent/hy3-preview:free","n":20,"optionA":"early","optionAShare":0.55,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.1},{"category":"time","firstShare":0.75,"majorityOption":"early","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"early","optionAShare":0.75,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.5},{"category":"time","firstShare":0.9,"majorityOption":"early","modelId":"x-ai/grok-4.3","n":20,"optionA":"early","optionAShare":0.6,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.2},{"category":"time","firstShare":0.55,"majorityOption":"early","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"early","optionAShare":0.95,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.9},{"category":"time","firstShare":0.6,"majorityOption":"early","modelId":"z-ai/glm-5","n":20,"optionA":"early","optionAShare":0.9,"optionB":"late","pairId":"time_early_late","preferenceStrength":0.8},{"category":"time","firstShare":0.5,"majorityOption":"early","modelId":"z-ai/glm-5.1","n":20,"optionA":"early","optionAShare":1.0,"optionB":"late","pairId":"time_early_late","preferenceStrength":1.0},{"category":"abstract","firstShare":0.5,"majorityOption":"complex","modelId":"amazon/nova-pro-v1","n":20,"optionA":"simple","optionAShare":0.0,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":1.0},{"category":"abstract","firstShare":0.5,"majorityOption":"simple","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"simple","optionAShare":1.0,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":1.0},{"category":"abstract","firstShare":0.5,"majorityOption":"simple","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"simple","optionAShare":1.0,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":1.0},{"category":"abstract","firstShare":0.5,"majorityOption":"simple","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"simple","optionAShare":1.0,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":1.0},{"category":"abstract","firstShare":0.5,"majorityOption":"simple","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"simple","optionAShare":1.0,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":1.0},{"category":"abstract","firstShare":0.75,"majorityOption":"simple","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"simple","optionAShare":0.75,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.5},{"category":"abstract","firstShare":0.5,"majorityOption":"simple","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"simple","optionAShare":0.8,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.6},{"category":"abstract","firstShare":0.55,"majorityOption":"simple","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"simple","optionAShare":0.95,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.9},{"category":"abstract","firstShare":0.55,"majorityOption":"simple","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"simple","optionAShare":0.95,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.9},{"category":"abstract","firstShare":0.85,"majorityOption":"complex","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"simple","optionAShare":0.35,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.3},{"category":"abstract","firstShare":0.5,"majorityOption":"simple","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"simple","optionAShare":1.0,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":1.0},{"category":"abstract","firstShare":0.95,"majorityOption":"simple","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"simple","optionAShare":0.55,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.1},{"category":"abstract","firstShare":0.55,"majorityOption":"simple","modelId":"inception/mercury-2","n":20,"optionA":"simple","optionAShare":0.95,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.9},{"category":"abstract","firstShare":1.0,"majorityOption":"simple","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"simple","optionAShare":0.5,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.0},{"category":"abstract","firstShare":1.0,"majorityOption":"simple","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"simple","optionAShare":0.5,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.0},{"category":"abstract","firstShare":0.75,"majorityOption":"simple","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"simple","optionAShare":0.75,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.5},{"category":"abstract","firstShare":1.0,"majorityOption":"simple","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"simple","optionAShare":0.5,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.0},{"category":"abstract","firstShare":0.4,"majorityOption":"complex","modelId":"microsoft/phi-4","n":20,"optionA":"simple","optionAShare":0.1,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.8},{"category":"abstract","firstShare":0.65,"majorityOption":"simple","modelId":"minimax/minimax-m2","n":20,"optionA":"simple","optionAShare":0.85,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.7},{"category":"abstract","firstShare":0.6,"majorityOption":"simple","modelId":"minimax/minimax-m2.5","n":20,"optionA":"simple","optionAShare":0.9,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.8},{"category":"abstract","firstShare":0.5,"majorityOption":"simple","modelId":"minimax/minimax-m2.7","n":20,"optionA":"simple","optionAShare":1.0,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":1.0},{"category":"abstract","firstShare":0.7,"majorityOption":"simple","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"simple","optionAShare":0.8,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.6},{"category":"abstract","firstShare":0.55,"majorityOption":"simple","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"simple","optionAShare":0.95,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.9},{"category":"abstract","firstShare":0.5,"majorityOption":"simple","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"simple","optionAShare":1.0,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":1.0},{"category":"abstract","firstShare":0.7,"majorityOption":"simple","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"simple","optionAShare":0.8,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.6},{"category":"abstract","firstShare":0.5,"majorityOption":"simple","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"simple","optionAShare":1.0,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":1.0},{"category":"abstract","firstShare":0.5,"majorityOption":"simple","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"simple","optionAShare":1.0,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":1.0},{"category":"abstract","firstShare":0.75,"majorityOption":"simple","modelId":"openai/gpt-5-nano","n":20,"optionA":"simple","optionAShare":0.65,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.3},{"category":"abstract","firstShare":0.15,"majorityOption":"complex","modelId":"openai/gpt-5.4","n":20,"optionA":"simple","optionAShare":0.45,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.1},{"category":"abstract","firstShare":0.5,"majorityOption":"complex","modelId":"perplexity/sonar","n":20,"optionA":"simple","optionAShare":0.2,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.6},{"category":"abstract","firstShare":0.6,"majorityOption":"simple","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"simple","optionAShare":0.9,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.8},{"category":"abstract","firstShare":0.5,"majorityOption":"simple","modelId":"qwen/qwen3.6-max-preview","n":20,"optionA":"simple","optionAShare":1.0,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":1.0},{"category":"abstract","firstShare":0.55,"majorityOption":"simple","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"simple","optionAShare":0.95,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.9},{"category":"abstract","firstShare":0.8182,"majorityOption":"complex","modelId":"rekaai/reka-flash-3","n":11,"optionA":"simple","optionAShare":0.2727,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.4545},{"category":"abstract","firstShare":0.55,"majorityOption":"simple","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"simple","optionAShare":0.95,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.9},{"category":"abstract","firstShare":0.55,"majorityOption":"simple","modelId":"tencent/hy3-preview:free","n":20,"optionA":"simple","optionAShare":0.95,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.9},{"category":"abstract","firstShare":0.6,"majorityOption":"simple","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"simple","optionAShare":0.9,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.8},{"category":"abstract","firstShare":0.5,"majorityOption":"simple","modelId":"x-ai/grok-4.3","n":20,"optionA":"simple","optionAShare":1.0,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":1.0},{"category":"abstract","firstShare":0.45,"majorityOption":"simple","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"simple","optionAShare":0.95,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.9},{"category":"abstract","firstShare":0.65,"majorityOption":"simple","modelId":"z-ai/glm-5","n":20,"optionA":"simple","optionAShare":0.85,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":0.7},{"category":"abstract","firstShare":0.5,"majorityOption":"simple","modelId":"z-ai/glm-5.1","n":20,"optionA":"simple","optionAShare":1.0,"optionB":"complex","pairId":"abstract_simple_complex","preferenceStrength":1.0},{"category":"abstract","firstShare":0.6,"majorityOption":"wide","modelId":"amazon/nova-pro-v1","n":20,"optionA":"narrow","optionAShare":0.3,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.4},{"category":"abstract","firstShare":0.5,"majorityOption":"wide","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"narrow","optionAShare":0.0,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":1.0},{"category":"abstract","firstShare":1.0,"majorityOption":"narrow","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"narrow","optionAShare":0.5,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.0},{"category":"abstract","firstShare":1.0,"majorityOption":"narrow","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"narrow","optionAShare":0.5,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.0},{"category":"abstract","firstShare":0.75,"majorityOption":"wide","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"narrow","optionAShare":0.25,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.5},{"category":"abstract","firstShare":0.5,"majorityOption":"narrow","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"narrow","optionAShare":1.0,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":1.0},{"category":"abstract","firstShare":0.9,"majorityOption":"wide","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"narrow","optionAShare":0.4,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.2},{"category":"abstract","firstShare":0.6,"majorityOption":"wide","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"narrow","optionAShare":0.1,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.8},{"category":"abstract","firstShare":0.5,"majorityOption":"wide","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"narrow","optionAShare":0.0,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":1.0},{"category":"abstract","firstShare":0.5,"majorityOption":"wide","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"narrow","optionAShare":0.0,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":1.0},{"category":"abstract","firstShare":0.5,"majorityOption":"wide","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"narrow","optionAShare":0.0,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":1.0},{"category":"abstract","firstShare":0.5,"majorityOption":"wide","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"narrow","optionAShare":0.0,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":1.0},{"category":"abstract","firstShare":0.6,"majorityOption":"wide","modelId":"inception/mercury-2","n":20,"optionA":"narrow","optionAShare":0.1,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.8},{"category":"abstract","firstShare":0.95,"majorityOption":"wide","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"narrow","optionAShare":0.45,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.1},{"category":"abstract","firstShare":1.0,"majorityOption":"narrow","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"narrow","optionAShare":0.5,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.0},{"category":"abstract","firstShare":0.55,"majorityOption":"wide","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"narrow","optionAShare":0.05,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.9},{"category":"abstract","firstShare":1.0,"majorityOption":"narrow","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"narrow","optionAShare":0.5,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.0},{"category":"abstract","firstShare":0.4,"majorityOption":"wide","modelId":"microsoft/phi-4","n":20,"optionA":"narrow","optionAShare":0.3,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.4},{"category":"abstract","firstShare":0.55,"majorityOption":"wide","modelId":"minimax/minimax-m2","n":20,"optionA":"narrow","optionAShare":0.05,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.9},{"category":"abstract","firstShare":0.65,"majorityOption":"wide","modelId":"minimax/minimax-m2.5","n":20,"optionA":"narrow","optionAShare":0.15,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.7},{"category":"abstract","firstShare":0.9,"majorityOption":"wide","modelId":"minimax/minimax-m2.7","n":20,"optionA":"narrow","optionAShare":0.4,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.2},{"category":"abstract","firstShare":0.6,"majorityOption":"wide","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"narrow","optionAShare":0.1,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.8},{"category":"abstract","firstShare":0.7,"majorityOption":"wide","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"narrow","optionAShare":0.4,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.2},{"category":"abstract","firstShare":0.45,"majorityOption":"wide","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"narrow","optionAShare":0.05,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.9},{"category":"abstract","firstShare":0.45,"majorityOption":"narrow","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"narrow","optionAShare":0.55,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.1},{"category":"abstract","firstShare":0.55,"majorityOption":"wide","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"narrow","optionAShare":0.05,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.9},{"category":"abstract","firstShare":0.55,"majorityOption":"wide","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"narrow","optionAShare":0.05,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.9},{"category":"abstract","firstShare":0.8,"majorityOption":"narrow","modelId":"openai/gpt-5-nano","n":20,"optionA":"narrow","optionAShare":0.5,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.0},{"category":"abstract","firstShare":0.35,"majorityOption":"wide","modelId":"openai/gpt-5.4","n":20,"optionA":"narrow","optionAShare":0.15,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.7},{"category":"abstract","firstShare":0.7,"majorityOption":"narrow","modelId":"perplexity/sonar","n":20,"optionA":"narrow","optionAShare":0.7,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.4},{"category":"abstract","firstShare":0.75,"majorityOption":"wide","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"narrow","optionAShare":0.25,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.5},{"category":"abstract","firstShare":0.5263,"majorityOption":"wide","modelId":"qwen/qwen3.6-max-preview","n":19,"optionA":"narrow","optionAShare":0.0,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":1.0},{"category":"abstract","firstShare":0.8,"majorityOption":"wide","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"narrow","optionAShare":0.3,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.4},{"category":"abstract","firstShare":1.0,"majorityOption":"wide","modelId":"rekaai/reka-flash-3","n":2,"optionA":"narrow","optionAShare":0.0,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":1.0},{"category":"abstract","firstShare":0.95,"majorityOption":"wide","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"narrow","optionAShare":0.45,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.1},{"category":"abstract","firstShare":1.0,"majorityOption":"narrow","modelId":"tencent/hy3-preview:free","n":20,"optionA":"narrow","optionAShare":0.5,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.0},{"category":"abstract","firstShare":0.8,"majorityOption":"wide","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"narrow","optionAShare":0.3,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.4},{"category":"abstract","firstShare":0.95,"majorityOption":"narrow","modelId":"x-ai/grok-4.3","n":20,"optionA":"narrow","optionAShare":0.55,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.1},{"category":"abstract","firstShare":0.65,"majorityOption":"wide","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"narrow","optionAShare":0.35,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.3},{"category":"abstract","firstShare":0.55,"majorityOption":"wide","modelId":"z-ai/glm-5","n":20,"optionA":"narrow","optionAShare":0.05,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":0.9},{"category":"abstract","firstShare":0.5,"majorityOption":"wide","modelId":"z-ai/glm-5.1","n":20,"optionA":"narrow","optionAShare":0.0,"optionB":"wide","pairId":"abstract_narrow_wide","preferenceStrength":1.0},{"category":"object","firstShare":0.8,"majorityOption":"cup","modelId":"amazon/nova-pro-v1","n":20,"optionA":"cup","optionAShare":0.5,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.0},{"category":"object","firstShare":0.5,"majorityOption":"cup","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"cup","optionAShare":1.0,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":1.0},{"category":"object","firstShare":0.5,"majorityOption":"cup","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"cup","optionAShare":1.0,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":1.0},{"category":"object","firstShare":1.0,"majorityOption":"cup","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"cup","optionAShare":0.5,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.0},{"category":"object","firstShare":0.45,"majorityOption":"plate","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"cup","optionAShare":0.25,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.5},{"category":"object","firstShare":0.55,"majorityOption":"cup","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"cup","optionAShare":0.65,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.3},{"category":"object","firstShare":0.65,"majorityOption":"cup","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"cup","optionAShare":0.85,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.7},{"category":"object","firstShare":0.9,"majorityOption":"cup","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"cup","optionAShare":0.6,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.2},{"category":"object","firstShare":0.3,"majorityOption":"cup","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"cup","optionAShare":0.8,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.6},{"category":"object","firstShare":0.75,"majorityOption":"cup","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"cup","optionAShare":0.75,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.5},{"category":"object","firstShare":0.5,"majorityOption":"cup","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"cup","optionAShare":1.0,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":1.0},{"category":"object","firstShare":1.0,"majorityOption":"cup","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"cup","optionAShare":0.5,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.0},{"category":"object","firstShare":1.0,"majorityOption":"cup","modelId":"inception/mercury-2","n":20,"optionA":"cup","optionAShare":0.5,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.0},{"category":"object","firstShare":1.0,"majorityOption":"cup","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"cup","optionAShare":0.5,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.0},{"category":"object","firstShare":1.0,"majorityOption":"cup","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"cup","optionAShare":0.5,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.0},{"category":"object","firstShare":0.7,"majorityOption":"cup","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"cup","optionAShare":0.8,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.6},{"category":"object","firstShare":1.0,"majorityOption":"cup","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"cup","optionAShare":0.5,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.0},{"category":"object","firstShare":0.35,"majorityOption":"cup","modelId":"microsoft/phi-4","n":20,"optionA":"cup","optionAShare":0.65,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.3},{"category":"object","firstShare":0.75,"majorityOption":"cup","modelId":"minimax/minimax-m2","n":20,"optionA":"cup","optionAShare":0.75,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.5},{"category":"object","firstShare":0.7,"majorityOption":"cup","modelId":"minimax/minimax-m2.5","n":20,"optionA":"cup","optionAShare":0.8,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.6},{"category":"object","firstShare":0.95,"majorityOption":"plate","modelId":"minimax/minimax-m2.7","n":20,"optionA":"cup","optionAShare":0.45,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.1},{"category":"object","firstShare":1.0,"majorityOption":"cup","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"cup","optionAShare":0.5,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.0},{"category":"object","firstShare":0.65,"majorityOption":"plate","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"cup","optionAShare":0.25,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.5},{"category":"object","firstShare":0.45,"majorityOption":"plate","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"cup","optionAShare":0.05,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.9},{"category":"object","firstShare":0.8,"majorityOption":"cup","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"cup","optionAShare":0.7,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.4},{"category":"object","firstShare":0.95,"majorityOption":"cup","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"cup","optionAShare":0.55,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.1},{"category":"object","firstShare":0.65,"majorityOption":"cup","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"cup","optionAShare":0.85,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.7},{"category":"object","firstShare":0.95,"majorityOption":"cup","modelId":"openai/gpt-5-nano","n":20,"optionA":"cup","optionAShare":0.55,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.1},{"category":"object","firstShare":0.05,"majorityOption":"cup","modelId":"openai/gpt-5.4","n":20,"optionA":"cup","optionAShare":0.55,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.1},{"category":"object","firstShare":0.45,"majorityOption":"cup","modelId":"perplexity/sonar","n":20,"optionA":"cup","optionAShare":0.95,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.9},{"category":"object","firstShare":0.6,"majorityOption":"cup","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"cup","optionAShare":0.9,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.8},{"category":"object","firstShare":0.55,"majorityOption":"cup","modelId":"qwen/qwen3.6-max-preview","n":20,"optionA":"cup","optionAShare":0.95,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.9},{"category":"object","firstShare":0.7,"majorityOption":"cup","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"cup","optionAShare":0.7,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.4},{"category":"object","firstShare":0.25,"majorityOption":"cup","modelId":"rekaai/reka-flash-3","n":4,"optionA":"cup","optionAShare":0.75,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.5},{"category":"object","firstShare":1.0,"majorityOption":"cup","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"cup","optionAShare":0.5,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.0},{"category":"object","firstShare":0.65,"majorityOption":"cup","modelId":"tencent/hy3-preview:free","n":20,"optionA":"cup","optionAShare":0.85,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.7},{"category":"object","firstShare":0.85,"majorityOption":"cup","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"cup","optionAShare":0.65,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.3},{"category":"object","firstShare":0.9,"majorityOption":"cup","modelId":"x-ai/grok-4.3","n":20,"optionA":"cup","optionAShare":0.6,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.2},{"category":"object","firstShare":0.55,"majorityOption":"cup","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"cup","optionAShare":0.75,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.5},{"category":"object","firstShare":1.0,"majorityOption":"cup","modelId":"z-ai/glm-5","n":20,"optionA":"cup","optionAShare":0.5,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.0},{"category":"object","firstShare":0.8,"majorityOption":"cup","modelId":"z-ai/glm-5.1","n":20,"optionA":"cup","optionAShare":0.7,"optionB":"plate","pairId":"object_cup_plate","preferenceStrength":0.4},{"category":"object","firstShare":0.45,"majorityOption":"key","modelId":"amazon/nova-pro-v1","n":20,"optionA":"key","optionAShare":0.75,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.5},{"category":"object","firstShare":1.0,"majorityOption":"key","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"key","optionAShare":0.5,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.0},{"category":"object","firstShare":1.0,"majorityOption":"key","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"key","optionAShare":0.5,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.0},{"category":"object","firstShare":0.5,"majorityOption":"coin","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"key","optionAShare":0.0,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":1.0},{"category":"object","firstShare":1.0,"majorityOption":"key","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"key","optionAShare":0.5,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.0},{"category":"object","firstShare":0.6,"majorityOption":"coin","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"key","optionAShare":0.3,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.4},{"category":"object","firstShare":0.95,"majorityOption":"key","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"key","optionAShare":0.55,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.1},{"category":"object","firstShare":0.7,"majorityOption":"coin","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"key","optionAShare":0.3,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.4},{"category":"object","firstShare":0.65,"majorityOption":"key","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"key","optionAShare":0.75,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.5},{"category":"object","firstShare":0.8,"majorityOption":"key","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"key","optionAShare":0.7,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.4},{"category":"object","firstShare":0.6,"majorityOption":"key","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"key","optionAShare":0.8,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.6},{"category":"object","firstShare":1.0,"majorityOption":"key","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"key","optionAShare":0.5,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.0},{"category":"object","firstShare":1.0,"majorityOption":"key","modelId":"inception/mercury-2","n":20,"optionA":"key","optionAShare":0.5,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.0},{"category":"object","firstShare":1.0,"majorityOption":"key","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"key","optionAShare":0.5,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.0},{"category":"object","firstShare":1.0,"majorityOption":"key","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"key","optionAShare":0.5,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.0},{"category":"object","firstShare":0.55,"majorityOption":"key","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"key","optionAShare":0.95,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.9},{"category":"object","firstShare":1.0,"majorityOption":"key","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"key","optionAShare":0.5,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.0},{"category":"object","firstShare":0.55,"majorityOption":"coin","modelId":"microsoft/phi-4","n":20,"optionA":"key","optionAShare":0.35,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.3},{"category":"object","firstShare":0.95,"majorityOption":"key","modelId":"minimax/minimax-m2","n":20,"optionA":"key","optionAShare":0.55,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.1},{"category":"object","firstShare":0.85,"majorityOption":"key","modelId":"minimax/minimax-m2.5","n":20,"optionA":"key","optionAShare":0.65,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.3},{"category":"object","firstShare":1.0,"majorityOption":"key","modelId":"minimax/minimax-m2.7","n":20,"optionA":"key","optionAShare":0.5,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.0},{"category":"object","firstShare":0.9,"majorityOption":"key","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"key","optionAShare":0.5,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.0},{"category":"object","firstShare":0.75,"majorityOption":"key","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"key","optionAShare":0.55,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.1},{"category":"object","firstShare":0.45,"majorityOption":"coin","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"key","optionAShare":0.15,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.7},{"category":"object","firstShare":0.7,"majorityOption":"key","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"key","optionAShare":0.8,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.6},{"category":"object","firstShare":1.0,"majorityOption":"key","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"key","optionAShare":0.5,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.0},{"category":"object","firstShare":0.9,"majorityOption":"key","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"key","optionAShare":0.6,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.2},{"category":"object","firstShare":0.7,"majorityOption":"coin","modelId":"openai/gpt-5-nano","n":20,"optionA":"key","optionAShare":0.2,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.6},{"category":"object","firstShare":0.05,"majorityOption":"key","modelId":"openai/gpt-5.4","n":20,"optionA":"key","optionAShare":0.55,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.1},{"category":"object","firstShare":0.4,"majorityOption":"key","modelId":"perplexity/sonar","n":20,"optionA":"key","optionAShare":0.5,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.0},{"category":"object","firstShare":0.65,"majorityOption":"key","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"key","optionAShare":0.65,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.3},{"category":"object","firstShare":0.5263,"majorityOption":"key","modelId":"qwen/qwen3.6-max-preview","n":19,"optionA":"key","optionAShare":0.9474,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.8947},{"category":"object","firstShare":0.7,"majorityOption":"key","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"key","optionAShare":0.7,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.4},{"category":"object","firstShare":0.625,"majorityOption":"key","modelId":"rekaai/reka-flash-3","n":8,"optionA":"key","optionAShare":0.875,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.75},{"category":"object","firstShare":1.0,"majorityOption":"key","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"key","optionAShare":0.5,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.0},{"category":"object","firstShare":1.0,"majorityOption":"key","modelId":"tencent/hy3-preview:free","n":20,"optionA":"key","optionAShare":0.5,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.0},{"category":"object","firstShare":1.0,"majorityOption":"key","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"key","optionAShare":0.5,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.0},{"category":"object","firstShare":0.95,"majorityOption":"coin","modelId":"x-ai/grok-4.3","n":20,"optionA":"key","optionAShare":0.45,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.1},{"category":"object","firstShare":0.45,"majorityOption":"key","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"key","optionAShare":0.55,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.1},{"category":"object","firstShare":0.85,"majorityOption":"key","modelId":"z-ai/glm-5","n":20,"optionA":"key","optionAShare":0.65,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.3},{"category":"object","firstShare":0.55,"majorityOption":"key","modelId":"z-ai/glm-5.1","n":20,"optionA":"key","optionAShare":0.85,"optionB":"coin","pairId":"object_key_coin","preferenceStrength":0.7},{"category":"object","firstShare":0.7,"majorityOption":"lamp","modelId":"amazon/nova-pro-v1","n":20,"optionA":"candle","optionAShare":0.2,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.6},{"category":"object","firstShare":0.8,"majorityOption":"lamp","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"candle","optionAShare":0.3,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.4},{"category":"object","firstShare":0.5,"majorityOption":"lamp","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"candle","optionAShare":0.0,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":1.0},{"category":"object","firstShare":1.0,"majorityOption":"candle","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"candle","optionAShare":0.5,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.0},{"category":"object","firstShare":0.6,"majorityOption":"lamp","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"candle","optionAShare":0.1,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.8},{"category":"object","firstShare":0.35,"majorityOption":"lamp","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"candle","optionAShare":0.25,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.5},{"category":"object","firstShare":0.7,"majorityOption":"lamp","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"candle","optionAShare":0.2,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.6},{"category":"object","firstShare":0.9,"majorityOption":"lamp","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"candle","optionAShare":0.4,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.2},{"category":"object","firstShare":0.65,"majorityOption":"lamp","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"candle","optionAShare":0.15,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.7},{"category":"object","firstShare":0.5,"majorityOption":"lamp","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"candle","optionAShare":0.0,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":1.0},{"category":"object","firstShare":0.55,"majorityOption":"lamp","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"candle","optionAShare":0.05,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.9},{"category":"object","firstShare":0.5,"majorityOption":"lamp","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"candle","optionAShare":0.0,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":1.0},{"category":"object","firstShare":1.0,"majorityOption":"candle","modelId":"inception/mercury-2","n":20,"optionA":"candle","optionAShare":0.5,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.0},{"category":"object","firstShare":0.95,"majorityOption":"lamp","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"candle","optionAShare":0.45,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.1},{"category":"object","firstShare":1.0,"majorityOption":"candle","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"candle","optionAShare":0.5,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.0},{"category":"object","firstShare":0.9,"majorityOption":"candle","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"candle","optionAShare":0.5,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.0},{"category":"object","firstShare":0.5,"majorityOption":"lamp","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"candle","optionAShare":0.0,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":1.0},{"category":"object","firstShare":0.5,"majorityOption":"lamp","modelId":"microsoft/phi-4","n":20,"optionA":"candle","optionAShare":0.0,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":1.0},{"category":"object","firstShare":0.9,"majorityOption":"lamp","modelId":"minimax/minimax-m2","n":20,"optionA":"candle","optionAShare":0.4,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.2},{"category":"object","firstShare":0.65,"majorityOption":"lamp","modelId":"minimax/minimax-m2.5","n":20,"optionA":"candle","optionAShare":0.15,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.7},{"category":"object","firstShare":0.55,"majorityOption":"lamp","modelId":"minimax/minimax-m2.7","n":20,"optionA":"candle","optionAShare":0.05,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.9},{"category":"object","firstShare":0.95,"majorityOption":"lamp","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"candle","optionAShare":0.45,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.1},{"category":"object","firstShare":0.65,"majorityOption":"candle","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"candle","optionAShare":0.55,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.1},{"category":"object","firstShare":0.55,"majorityOption":"candle","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"candle","optionAShare":0.65,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.3},{"category":"object","firstShare":0.95,"majorityOption":"lamp","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"candle","optionAShare":0.45,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.1},{"category":"object","firstShare":0.95,"majorityOption":"lamp","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"candle","optionAShare":0.45,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.1},{"category":"object","firstShare":0.6,"majorityOption":"lamp","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"candle","optionAShare":0.1,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.8},{"category":"object","firstShare":0.9,"majorityOption":"lamp","modelId":"openai/gpt-5-nano","n":20,"optionA":"candle","optionAShare":0.4,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.2},{"category":"object","firstShare":0.35,"majorityOption":"lamp","modelId":"openai/gpt-5.4","n":20,"optionA":"candle","optionAShare":0.15,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.7},{"category":"object","firstShare":0.3,"majorityOption":"candle","modelId":"perplexity/sonar","n":20,"optionA":"candle","optionAShare":0.5,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.0},{"category":"object","firstShare":0.35,"majorityOption":"lamp","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"candle","optionAShare":0.25,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.5},{"category":"object","firstShare":0.5,"majorityOption":"lamp","modelId":"qwen/qwen3.6-max-preview","n":20,"optionA":"candle","optionAShare":0.0,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":1.0},{"category":"object","firstShare":0.5,"majorityOption":"lamp","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"candle","optionAShare":0.1,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.8},{"category":"object","firstShare":0.5,"majorityOption":"candle","modelId":"rekaai/reka-flash-3","n":8,"optionA":"candle","optionAShare":0.75,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.5},{"category":"object","firstShare":0.95,"majorityOption":"lamp","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"candle","optionAShare":0.45,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.1},{"category":"object","firstShare":0.5,"majorityOption":"lamp","modelId":"tencent/hy3-preview:free","n":20,"optionA":"candle","optionAShare":0.0,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":1.0},{"category":"object","firstShare":1.0,"majorityOption":"candle","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"candle","optionAShare":0.5,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.0},{"category":"object","firstShare":0.75,"majorityOption":"lamp","modelId":"x-ai/grok-4.3","n":20,"optionA":"candle","optionAShare":0.25,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.5},{"category":"object","firstShare":0.55,"majorityOption":"lamp","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"candle","optionAShare":0.15,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.7},{"category":"object","firstShare":0.75,"majorityOption":"lamp","modelId":"z-ai/glm-5","n":20,"optionA":"candle","optionAShare":0.25,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.5},{"category":"object","firstShare":0.65,"majorityOption":"lamp","modelId":"z-ai/glm-5.1","n":20,"optionA":"candle","optionAShare":0.25,"optionB":"lamp","pairId":"object_candle_lamp","preferenceStrength":0.5},{"category":"motion","firstShare":0.75,"majorityOption":"fast","modelId":"amazon/nova-pro-v1","n":20,"optionA":"fast","optionAShare":0.75,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":0.5},{"category":"motion","firstShare":0.5,"majorityOption":"fast","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"fast","optionAShare":1.0,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":1.0},{"category":"motion","firstShare":0.5,"majorityOption":"fast","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"fast","optionAShare":1.0,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":1.0},{"category":"motion","firstShare":1.0,"majorityOption":"fast","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"fast","optionAShare":0.5,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":0.0},{"category":"motion","firstShare":0.5,"majorityOption":"fast","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"fast","optionAShare":1.0,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":1.0},{"category":"motion","firstShare":1.0,"majorityOption":"fast","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"fast","optionAShare":0.5,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":0.0},{"category":"motion","firstShare":0.55,"majorityOption":"fast","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"fast","optionAShare":0.95,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":0.9},{"category":"motion","firstShare":0.75,"majorityOption":"fast","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"fast","optionAShare":0.75,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":0.5},{"category":"motion","firstShare":0.5,"majorityOption":"fast","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"fast","optionAShare":1.0,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":1.0},{"category":"motion","firstShare":0.5,"majorityOption":"fast","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"fast","optionAShare":1.0,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":1.0},{"category":"motion","firstShare":0.5,"majorityOption":"fast","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"fast","optionAShare":1.0,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":1.0},{"category":"motion","firstShare":0.5,"majorityOption":"fast","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"fast","optionAShare":1.0,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":1.0},{"category":"motion","firstShare":0.5,"majorityOption":"fast","modelId":"inception/mercury-2","n":20,"optionA":"fast","optionAShare":1.0,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":1.0},{"category":"motion","firstShare":1.0,"majorityOption":"fast","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"fast","optionAShare":0.5,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":0.0},{"category":"motion","firstShare":0.5,"majorityOption":"fast","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"fast","optionAShare":1.0,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":1.0},{"category":"motion","firstShare":0.5,"majorityOption":"fast","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"fast","optionAShare":1.0,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":1.0},{"category":"motion","firstShare":0.5,"majorityOption":"fast","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"fast","optionAShare":1.0,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":1.0},{"category":"motion","firstShare":0.45,"majorityOption":"fast","modelId":"microsoft/phi-4","n":20,"optionA":"fast","optionAShare":0.95,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":0.9},{"category":"motion","firstShare":0.5,"majorityOption":"fast","modelId":"minimax/minimax-m2","n":20,"optionA":"fast","optionAShare":1.0,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":1.0},{"category":"motion","firstShare":0.5,"majorityOption":"fast","modelId":"minimax/minimax-m2.5","n":20,"optionA":"fast","optionAShare":1.0,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":1.0},{"category":"motion","firstShare":0.65,"majorityOption":"fast","modelId":"minimax/minimax-m2.7","n":20,"optionA":"fast","optionAShare":0.85,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":0.7},{"category":"motion","firstShare":0.85,"majorityOption":"fast","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"fast","optionAShare":0.65,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":0.3},{"category":"motion","firstShare":0.55,"majorityOption":"fast","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"fast","optionAShare":0.95,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":0.9},{"category":"motion","firstShare":0.65,"majorityOption":"slow","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"fast","optionAShare":0.15,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":0.7},{"category":"motion","firstShare":0.4,"majorityOption":"fast","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"fast","optionAShare":0.9,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":0.8},{"category":"motion","firstShare":0.85,"majorityOption":"fast","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"fast","optionAShare":0.65,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":0.3},{"category":"motion","firstShare":0.55,"majorityOption":"fast","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"fast","optionAShare":0.95,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":0.9},{"category":"motion","firstShare":0.5,"majorityOption":"fast","modelId":"openai/gpt-5-nano","n":20,"optionA":"fast","optionAShare":1.0,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":1.0},{"category":"motion","firstShare":0.4,"majorityOption":"fast","modelId":"openai/gpt-5.4","n":20,"optionA":"fast","optionAShare":0.9,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":0.8},{"category":"motion","firstShare":0.7,"majorityOption":"fast","modelId":"perplexity/sonar","n":20,"optionA":"fast","optionAShare":0.6,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":0.2},{"category":"motion","firstShare":0.55,"majorityOption":"fast","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"fast","optionAShare":0.95,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":0.9},{"category":"motion","firstShare":0.4737,"majorityOption":"fast","modelId":"qwen/qwen3.6-max-preview","n":19,"optionA":"fast","optionAShare":1.0,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":1.0},{"category":"motion","firstShare":0.5,"majorityOption":"fast","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"fast","optionAShare":1.0,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":1.0},{"category":"motion","firstShare":0.5714,"majorityOption":"fast","modelId":"rekaai/reka-flash-3","n":7,"optionA":"fast","optionAShare":0.7143,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":0.4286},{"category":"motion","firstShare":0.9,"majorityOption":"fast","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"fast","optionAShare":0.6,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":0.2},{"category":"motion","firstShare":0.5,"majorityOption":"fast","modelId":"tencent/hy3-preview:free","n":20,"optionA":"fast","optionAShare":1.0,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":1.0},{"category":"motion","firstShare":0.65,"majorityOption":"fast","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"fast","optionAShare":0.85,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":0.7},{"category":"motion","firstShare":0.65,"majorityOption":"fast","modelId":"x-ai/grok-4.3","n":20,"optionA":"fast","optionAShare":0.85,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":0.7},{"category":"motion","firstShare":0.55,"majorityOption":"fast","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"fast","optionAShare":0.95,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":0.9},{"category":"motion","firstShare":0.55,"majorityOption":"fast","modelId":"z-ai/glm-5","n":20,"optionA":"fast","optionAShare":0.95,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":0.9},{"category":"motion","firstShare":0.5,"majorityOption":"fast","modelId":"z-ai/glm-5.1","n":20,"optionA":"fast","optionAShare":1.0,"optionB":"slow","pairId":"motion_fast_slow","preferenceStrength":1.0},{"category":"temperature","firstShare":0.65,"majorityOption":"warm","modelId":"amazon/nova-pro-v1","n":20,"optionA":"warm","optionAShare":0.85,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":0.7},{"category":"temperature","firstShare":0.5,"majorityOption":"warm","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"warm","optionAShare":1.0,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":1.0},{"category":"temperature","firstShare":0.5,"majorityOption":"warm","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"warm","optionAShare":1.0,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":1.0},{"category":"temperature","firstShare":1.0,"majorityOption":"warm","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"warm","optionAShare":0.5,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":0.0},{"category":"temperature","firstShare":0.5,"majorityOption":"warm","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"warm","optionAShare":1.0,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":1.0},{"category":"temperature","firstShare":0.6,"majorityOption":"cold","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"warm","optionAShare":0.1,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":0.8},{"category":"temperature","firstShare":0.65,"majorityOption":"warm","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"warm","optionAShare":0.85,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":0.7},{"category":"temperature","firstShare":0.7,"majorityOption":"warm","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"warm","optionAShare":0.8,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":0.6},{"category":"temperature","firstShare":0.5,"majorityOption":"warm","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"warm","optionAShare":1.0,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":1.0},{"category":"temperature","firstShare":0.5,"majorityOption":"warm","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"warm","optionAShare":1.0,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":1.0},{"category":"temperature","firstShare":0.55,"majorityOption":"warm","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"warm","optionAShare":0.95,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":0.9},{"category":"temperature","firstShare":0.5,"majorityOption":"warm","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"warm","optionAShare":1.0,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":1.0},{"category":"temperature","firstShare":0.7,"majorityOption":"warm","modelId":"inception/mercury-2","n":20,"optionA":"warm","optionAShare":0.8,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":0.6},{"category":"temperature","firstShare":1.0,"majorityOption":"warm","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"warm","optionAShare":0.5,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":0.0},{"category":"temperature","firstShare":0.95,"majorityOption":"warm","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"warm","optionAShare":0.55,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":0.1},{"category":"temperature","firstShare":0.5,"majorityOption":"warm","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"warm","optionAShare":1.0,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":1.0},{"category":"temperature","firstShare":0.85,"majorityOption":"warm","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"warm","optionAShare":0.65,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":0.3},{"category":"temperature","firstShare":0.4,"majorityOption":"warm","modelId":"microsoft/phi-4","n":20,"optionA":"warm","optionAShare":0.8,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":0.6},{"category":"temperature","firstShare":0.75,"majorityOption":"warm","modelId":"minimax/minimax-m2","n":20,"optionA":"warm","optionAShare":0.75,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":0.5},{"category":"temperature","firstShare":0.7895,"majorityOption":"warm","modelId":"minimax/minimax-m2.5","n":19,"optionA":"warm","optionAShare":0.7368,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":0.4737},{"category":"temperature","firstShare":0.75,"majorityOption":"warm","modelId":"minimax/minimax-m2.7","n":20,"optionA":"warm","optionAShare":0.75,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":0.5},{"category":"temperature","firstShare":0.55,"majorityOption":"warm","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"warm","optionAShare":0.95,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":0.9},{"category":"temperature","firstShare":0.85,"majorityOption":"warm","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"warm","optionAShare":0.65,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":0.3},{"category":"temperature","firstShare":0.5,"majorityOption":"warm","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"warm","optionAShare":1.0,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":1.0},{"category":"temperature","firstShare":0.55,"majorityOption":"warm","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"warm","optionAShare":0.65,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":0.3},{"category":"temperature","firstShare":0.6,"majorityOption":"warm","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"warm","optionAShare":0.9,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":0.8},{"category":"temperature","firstShare":0.85,"majorityOption":"warm","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"warm","optionAShare":0.65,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":0.3},{"category":"temperature","firstShare":0.5,"majorityOption":"warm","modelId":"openai/gpt-5-nano","n":20,"optionA":"warm","optionAShare":1.0,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":1.0},{"category":"temperature","firstShare":0.5,"majorityOption":"warm","modelId":"openai/gpt-5.4","n":20,"optionA":"warm","optionAShare":1.0,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":1.0},{"category":"temperature","firstShare":0.65,"majorityOption":"cold","modelId":"perplexity/sonar","n":20,"optionA":"warm","optionAShare":0.25,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":0.5},{"category":"temperature","firstShare":0.85,"majorityOption":"warm","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"warm","optionAShare":0.65,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":0.3},{"category":"temperature","firstShare":0.5,"majorityOption":"warm","modelId":"qwen/qwen3.6-max-preview","n":20,"optionA":"warm","optionAShare":1.0,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":1.0},{"category":"temperature","firstShare":0.5,"majorityOption":"warm","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"warm","optionAShare":1.0,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":1.0},{"category":"temperature","firstShare":0.4545,"majorityOption":"warm","modelId":"rekaai/reka-flash-3","n":11,"optionA":"warm","optionAShare":0.8182,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":0.6364},{"category":"temperature","firstShare":0.95,"majorityOption":"warm","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"warm","optionAShare":0.55,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":0.1},{"category":"temperature","firstShare":0.5,"majorityOption":"warm","modelId":"tencent/hy3-preview:free","n":20,"optionA":"warm","optionAShare":1.0,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":1.0},{"category":"temperature","firstShare":0.5,"majorityOption":"warm","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"warm","optionAShare":1.0,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":1.0},{"category":"temperature","firstShare":0.8947,"majorityOption":"warm","modelId":"x-ai/grok-4.3","n":19,"optionA":"warm","optionAShare":0.6316,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":0.2632},{"category":"temperature","firstShare":0.5,"majorityOption":"warm","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"warm","optionAShare":1.0,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":1.0},{"category":"temperature","firstShare":0.5,"majorityOption":"warm","modelId":"z-ai/glm-5","n":20,"optionA":"warm","optionAShare":1.0,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":1.0},{"category":"temperature","firstShare":0.5,"majorityOption":"warm","modelId":"z-ai/glm-5.1","n":20,"optionA":"warm","optionAShare":1.0,"optionB":"cold","pairId":"temperature_warm_cold","preferenceStrength":1.0},{"category":"size","firstShare":0.95,"majorityOption":"small","modelId":"amazon/nova-pro-v1","n":20,"optionA":"small","optionAShare":0.55,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.1},{"category":"size","firstShare":1.0,"majorityOption":"small","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"small","optionAShare":0.5,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.0},{"category":"size","firstShare":1.0,"majorityOption":"small","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"small","optionAShare":0.5,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.0},{"category":"size","firstShare":1.0,"majorityOption":"small","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"small","optionAShare":0.5,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.0},{"category":"size","firstShare":0.5,"majorityOption":"small","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"small","optionAShare":0.8,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.6},{"category":"size","firstShare":0.75,"majorityOption":"small","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"small","optionAShare":0.75,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.5},{"category":"size","firstShare":0.9,"majorityOption":"small","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"small","optionAShare":0.5,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.0},{"category":"size","firstShare":0.95,"majorityOption":"large","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"small","optionAShare":0.45,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.1},{"category":"size","firstShare":0.65,"majorityOption":"large","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"small","optionAShare":0.25,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.5},{"category":"size","firstShare":0.5,"majorityOption":"large","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"small","optionAShare":0.0,"optionB":"large","pairId":"size_small_large","preferenceStrength":1.0},{"category":"size","firstShare":0.6,"majorityOption":"large","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"small","optionAShare":0.1,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.8},{"category":"size","firstShare":0.7,"majorityOption":"small","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"small","optionAShare":0.8,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.6},{"category":"size","firstShare":0.6,"majorityOption":"large","modelId":"inception/mercury-2","n":20,"optionA":"small","optionAShare":0.1,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.8},{"category":"size","firstShare":1.0,"majorityOption":"small","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"small","optionAShare":0.5,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.0},{"category":"size","firstShare":1.0,"majorityOption":"small","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"small","optionAShare":0.5,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.0},{"category":"size","firstShare":1.0,"majorityOption":"small","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"small","optionAShare":0.5,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.0},{"category":"size","firstShare":1.0,"majorityOption":"small","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"small","optionAShare":0.5,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.0},{"category":"size","firstShare":0.6,"majorityOption":"large","modelId":"microsoft/phi-4","n":20,"optionA":"small","optionAShare":0.1,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.8},{"category":"size","firstShare":0.9,"majorityOption":"large","modelId":"minimax/minimax-m2","n":20,"optionA":"small","optionAShare":0.4,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.2},{"category":"size","firstShare":0.95,"majorityOption":"large","modelId":"minimax/minimax-m2.5","n":20,"optionA":"small","optionAShare":0.45,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.1},{"category":"size","firstShare":0.8,"majorityOption":"large","modelId":"minimax/minimax-m2.7","n":20,"optionA":"small","optionAShare":0.3,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.4},{"category":"size","firstShare":1.0,"majorityOption":"small","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"small","optionAShare":0.5,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.0},{"category":"size","firstShare":0.65,"majorityOption":"small","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"small","optionAShare":0.75,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.5},{"category":"size","firstShare":0.5,"majorityOption":"small","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"small","optionAShare":1.0,"optionB":"large","pairId":"size_small_large","preferenceStrength":1.0},{"category":"size","firstShare":0.7,"majorityOption":"small","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"small","optionAShare":0.6,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.2},{"category":"size","firstShare":0.95,"majorityOption":"large","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"small","optionAShare":0.45,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.1},{"category":"size","firstShare":0.95,"majorityOption":"large","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"small","optionAShare":0.45,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.1},{"category":"size","firstShare":0.95,"majorityOption":"large","modelId":"openai/gpt-5-nano","n":20,"optionA":"small","optionAShare":0.45,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.1},{"category":"size","firstShare":0.1,"majorityOption":"small","modelId":"openai/gpt-5.4","n":20,"optionA":"small","optionAShare":0.6,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.2},{"category":"size","firstShare":0.55,"majorityOption":"large","modelId":"perplexity/sonar","n":20,"optionA":"small","optionAShare":0.05,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.9},{"category":"size","firstShare":0.95,"majorityOption":"small","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"small","optionAShare":0.55,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.1},{"category":"size","firstShare":1.0,"majorityOption":"small","modelId":"qwen/qwen3.6-max-preview","n":19,"optionA":"small","optionAShare":0.5263,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.0526},{"category":"size","firstShare":1.0,"majorityOption":"small","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"small","optionAShare":0.5,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.0},{"category":"size","firstShare":0.25,"majorityOption":"large","modelId":"rekaai/reka-flash-3","n":4,"optionA":"small","optionAShare":0.25,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.5},{"category":"size","firstShare":1.0,"majorityOption":"small","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"small","optionAShare":0.5,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.0},{"category":"size","firstShare":1.0,"majorityOption":"small","modelId":"tencent/hy3-preview:free","n":20,"optionA":"small","optionAShare":0.5,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.0},{"category":"size","firstShare":0.5,"majorityOption":"large","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"small","optionAShare":0.0,"optionB":"large","pairId":"size_small_large","preferenceStrength":1.0},{"category":"size","firstShare":0.9,"majorityOption":"large","modelId":"x-ai/grok-4.3","n":20,"optionA":"small","optionAShare":0.4,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.2},{"category":"size","firstShare":0.6,"majorityOption":"large","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"small","optionAShare":0.4,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.2},{"category":"size","firstShare":1.0,"majorityOption":"small","modelId":"z-ai/glm-5","n":20,"optionA":"small","optionAShare":0.5,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.0},{"category":"size","firstShare":1.0,"majorityOption":"small","modelId":"z-ai/glm-5.1","n":20,"optionA":"small","optionAShare":0.5,"optionB":"large","pairId":"size_small_large","preferenceStrength":0.0},{"category":"density","firstShare":0.65,"majorityOption":"light","modelId":"amazon/nova-pro-v1","n":20,"optionA":"light","optionAShare":0.75,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.5},{"category":"density","firstShare":0.5,"majorityOption":"light","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"light","optionAShare":1.0,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":1.0},{"category":"density","firstShare":0.5,"majorityOption":"light","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"light","optionAShare":1.0,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":1.0},{"category":"density","firstShare":0.95,"majorityOption":"light","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"light","optionAShare":0.55,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.1},{"category":"density","firstShare":0.55,"majorityOption":"light","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"light","optionAShare":0.95,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.9},{"category":"density","firstShare":0.7,"majorityOption":"light","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"light","optionAShare":0.8,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.6},{"category":"density","firstShare":0.9,"majorityOption":"light","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"light","optionAShare":0.6,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.2},{"category":"density","firstShare":0.75,"majorityOption":"light","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"light","optionAShare":0.75,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.5},{"category":"density","firstShare":0.5,"majorityOption":"light","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"light","optionAShare":1.0,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":1.0},{"category":"density","firstShare":1.0,"majorityOption":"light","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"light","optionAShare":0.5,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.0},{"category":"density","firstShare":0.5,"majorityOption":"light","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"light","optionAShare":1.0,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":1.0},{"category":"density","firstShare":0.55,"majorityOption":"light","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"light","optionAShare":0.95,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.9},{"category":"density","firstShare":0.55,"majorityOption":"light","modelId":"inception/mercury-2","n":20,"optionA":"light","optionAShare":0.95,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.9},{"category":"density","firstShare":1.0,"majorityOption":"light","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"light","optionAShare":0.5,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.0},{"category":"density","firstShare":1.0,"majorityOption":"light","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"light","optionAShare":0.5,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.0},{"category":"density","firstShare":0.95,"majorityOption":"heavy","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"light","optionAShare":0.45,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.1},{"category":"density","firstShare":1.0,"majorityOption":"light","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"light","optionAShare":0.5,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.0},{"category":"density","firstShare":0.5,"majorityOption":"light","modelId":"microsoft/phi-4","n":20,"optionA":"light","optionAShare":1.0,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":1.0},{"category":"density","firstShare":0.95,"majorityOption":"light","modelId":"minimax/minimax-m2","n":20,"optionA":"light","optionAShare":0.55,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.1},{"category":"density","firstShare":1.0,"majorityOption":"light","modelId":"minimax/minimax-m2.5","n":20,"optionA":"light","optionAShare":0.5,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.0},{"category":"density","firstShare":1.0,"majorityOption":"light","modelId":"minimax/minimax-m2.7","n":20,"optionA":"light","optionAShare":0.5,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.0},{"category":"density","firstShare":0.75,"majorityOption":"light","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"light","optionAShare":0.75,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.5},{"category":"density","firstShare":0.5,"majorityOption":"light","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"light","optionAShare":1.0,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":1.0},{"category":"density","firstShare":0.45,"majorityOption":"light","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"light","optionAShare":0.95,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.9},{"category":"density","firstShare":0.75,"majorityOption":"light","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"light","optionAShare":0.65,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.3},{"category":"density","firstShare":0.5,"majorityOption":"light","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"light","optionAShare":1.0,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":1.0},{"category":"density","firstShare":0.55,"majorityOption":"light","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"light","optionAShare":0.95,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.9},{"category":"density","firstShare":0.85,"majorityOption":"light","modelId":"openai/gpt-5-nano","n":20,"optionA":"light","optionAShare":0.65,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.3},{"category":"density","firstShare":0.2,"majorityOption":"light","modelId":"openai/gpt-5.4","n":20,"optionA":"light","optionAShare":0.7,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.4},{"category":"density","firstShare":0.2,"majorityOption":"light","modelId":"perplexity/sonar","n":20,"optionA":"light","optionAShare":0.6,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.2},{"category":"density","firstShare":0.85,"majorityOption":"light","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"light","optionAShare":0.65,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.3},{"category":"density","firstShare":0.5,"majorityOption":"light","modelId":"qwen/qwen3.6-max-preview","n":20,"optionA":"light","optionAShare":1.0,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":1.0},{"category":"density","firstShare":1.0,"majorityOption":"light","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"light","optionAShare":0.5,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.0},{"category":"density","firstShare":0.2,"majorityOption":"heavy","modelId":"rekaai/reka-flash-3","n":5,"optionA":"light","optionAShare":0.2,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.6},{"category":"density","firstShare":1.0,"majorityOption":"light","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"light","optionAShare":0.5,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.0},{"category":"density","firstShare":0.75,"majorityOption":"light","modelId":"tencent/hy3-preview:free","n":20,"optionA":"light","optionAShare":0.75,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.5},{"category":"density","firstShare":0.9,"majorityOption":"heavy","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"light","optionAShare":0.4,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.2},{"category":"density","firstShare":0.6842,"majorityOption":"light","modelId":"x-ai/grok-4.3","n":19,"optionA":"light","optionAShare":0.8421,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.6842},{"category":"density","firstShare":0.7,"majorityOption":"light","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"light","optionAShare":0.8,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.6},{"category":"density","firstShare":0.65,"majorityOption":"light","modelId":"z-ai/glm-5","n":20,"optionA":"light","optionAShare":0.85,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.7},{"category":"density","firstShare":0.55,"majorityOption":"light","modelId":"z-ai/glm-5.1","n":20,"optionA":"light","optionAShare":0.95,"optionB":"heavy","pairId":"density_light_heavy","preferenceStrength":0.9},{"category":"terrain","firstShare":0.7,"majorityOption":"mountain","modelId":"amazon/nova-pro-v1","n":20,"optionA":"mountain","optionAShare":0.5,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.0},{"category":"terrain","firstShare":0.5,"majorityOption":"mountain","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"mountain","optionAShare":1.0,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":1.0},{"category":"terrain","firstShare":0.5,"majorityOption":"mountain","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"mountain","optionAShare":1.0,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":1.0},{"category":"terrain","firstShare":1.0,"majorityOption":"mountain","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"mountain","optionAShare":0.5,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.0},{"category":"terrain","firstShare":0.5,"majorityOption":"mountain","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"mountain","optionAShare":1.0,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":1.0},{"category":"terrain","firstShare":0.5,"majorityOption":"mountain","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"mountain","optionAShare":0.7,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.4},{"category":"terrain","firstShare":0.55,"majorityOption":"mountain","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"mountain","optionAShare":0.95,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.9},{"category":"terrain","firstShare":0.65,"majorityOption":"mountain","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"mountain","optionAShare":0.85,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.7},{"category":"terrain","firstShare":0.5,"majorityOption":"mountain","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"mountain","optionAShare":1.0,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":1.0},{"category":"terrain","firstShare":0.5,"majorityOption":"mountain","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"mountain","optionAShare":1.0,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":1.0},{"category":"terrain","firstShare":0.5,"majorityOption":"mountain","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"mountain","optionAShare":1.0,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":1.0},{"category":"terrain","firstShare":1.0,"majorityOption":"mountain","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"mountain","optionAShare":0.5,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.0},{"category":"terrain","firstShare":0.85,"majorityOption":"mountain","modelId":"inception/mercury-2","n":20,"optionA":"mountain","optionAShare":0.65,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.3},{"category":"terrain","firstShare":1.0,"majorityOption":"mountain","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"mountain","optionAShare":0.5,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.0},{"category":"terrain","firstShare":0.95,"majorityOption":"mountain","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"mountain","optionAShare":0.55,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.1},{"category":"terrain","firstShare":0.75,"majorityOption":"mountain","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"mountain","optionAShare":0.75,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.5},{"category":"terrain","firstShare":1.0,"majorityOption":"mountain","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"mountain","optionAShare":0.5,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.0},{"category":"terrain","firstShare":0.55,"majorityOption":"mountain","modelId":"microsoft/phi-4","n":20,"optionA":"mountain","optionAShare":0.75,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.5},{"category":"terrain","firstShare":0.5,"majorityOption":"mountain","modelId":"minimax/minimax-m2","n":20,"optionA":"mountain","optionAShare":1.0,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":1.0},{"category":"terrain","firstShare":0.5,"majorityOption":"mountain","modelId":"minimax/minimax-m2.5","n":20,"optionA":"mountain","optionAShare":1.0,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":1.0},{"category":"terrain","firstShare":0.5,"majorityOption":"mountain","modelId":"minimax/minimax-m2.7","n":20,"optionA":"mountain","optionAShare":1.0,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":1.0},{"category":"terrain","firstShare":0.45,"majorityOption":"mountain","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"mountain","optionAShare":0.95,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.9},{"category":"terrain","firstShare":0.65,"majorityOption":"mountain","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"mountain","optionAShare":0.75,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.5},{"category":"terrain","firstShare":0.4,"majorityOption":"mountain","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"mountain","optionAShare":0.8,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.6},{"category":"terrain","firstShare":0.55,"majorityOption":"mountain","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"mountain","optionAShare":0.95,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.9},{"category":"terrain","firstShare":0.6,"majorityOption":"mountain","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"mountain","optionAShare":0.9,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.8},{"category":"terrain","firstShare":0.6,"majorityOption":"mountain","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"mountain","optionAShare":0.9,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.8},{"category":"terrain","firstShare":0.65,"majorityOption":"valley","modelId":"openai/gpt-5-nano","n":20,"optionA":"mountain","optionAShare":0.15,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.7},{"category":"terrain","firstShare":0.3,"majorityOption":"mountain","modelId":"openai/gpt-5.4","n":20,"optionA":"mountain","optionAShare":0.8,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.6},{"category":"terrain","firstShare":0.45,"majorityOption":"mountain","modelId":"perplexity/sonar","n":20,"optionA":"mountain","optionAShare":0.85,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.7},{"category":"terrain","firstShare":0.45,"majorityOption":"mountain","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"mountain","optionAShare":0.95,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.9},{"category":"terrain","firstShare":0.5,"majorityOption":"mountain","modelId":"qwen/qwen3.6-max-preview","n":20,"optionA":"mountain","optionAShare":1.0,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":1.0},{"category":"terrain","firstShare":0.5,"majorityOption":"mountain","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"mountain","optionAShare":1.0,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":1.0},{"category":"terrain","firstShare":0.8333,"majorityOption":"valley","modelId":"rekaai/reka-flash-3","n":6,"optionA":"mountain","optionAShare":0.1667,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.6667},{"category":"terrain","firstShare":1.0,"majorityOption":"mountain","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"mountain","optionAShare":0.5,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.0},{"category":"terrain","firstShare":0.5,"majorityOption":"mountain","modelId":"tencent/hy3-preview:free","n":20,"optionA":"mountain","optionAShare":1.0,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":1.0},{"category":"terrain","firstShare":0.5,"majorityOption":"mountain","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"mountain","optionAShare":1.0,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":1.0},{"category":"terrain","firstShare":0.5263,"majorityOption":"mountain","modelId":"x-ai/grok-4.3","n":19,"optionA":"mountain","optionAShare":0.9474,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.8947},{"category":"terrain","firstShare":0.7,"majorityOption":"mountain","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"mountain","optionAShare":0.8,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":0.6},{"category":"terrain","firstShare":0.5,"majorityOption":"mountain","modelId":"z-ai/glm-5","n":20,"optionA":"mountain","optionAShare":1.0,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":1.0},{"category":"terrain","firstShare":0.5,"majorityOption":"mountain","modelId":"z-ai/glm-5.1","n":20,"optionA":"mountain","optionAShare":1.0,"optionB":"valley","pairId":"terrain_mountain_valley","preferenceStrength":1.0},{"category":"nature","firstShare":0.6,"majorityOption":"forest","modelId":"amazon/nova-pro-v1","n":20,"optionA":"river","optionAShare":0.1,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.8},{"category":"nature","firstShare":0.5,"majorityOption":"forest","modelId":"anthropic/claude-haiku-4.5","n":20,"optionA":"river","optionAShare":0.0,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":1.0},{"category":"nature","firstShare":0.0,"majorityOption":"river","modelId":"anthropic/claude-opus-4.7","n":20,"optionA":"river","optionAShare":0.5,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.0},{"category":"nature","firstShare":0.5,"majorityOption":"forest","modelId":"anthropic/claude-sonnet-4.6","n":20,"optionA":"river","optionAShare":0.0,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":1.0},{"category":"nature","firstShare":0.75,"majorityOption":"forest","modelId":"baidu/ernie-4.5-300b-a47b","n":20,"optionA":"river","optionAShare":0.45,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.1},{"category":"nature","firstShare":0.5,"majorityOption":"forest","modelId":"deepseek/deepseek-v3.2","n":20,"optionA":"river","optionAShare":0.0,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":1.0},{"category":"nature","firstShare":0.55,"majorityOption":"forest","modelId":"deepseek/deepseek-v4-flash","n":20,"optionA":"river","optionAShare":0.15,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.7},{"category":"nature","firstShare":0.55,"majorityOption":"forest","modelId":"deepseek/deepseek-v4-pro","n":20,"optionA":"river","optionAShare":0.25,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.5},{"category":"nature","firstShare":0.05,"majorityOption":"forest","modelId":"google/gemini-3-flash-preview","n":20,"optionA":"river","optionAShare":0.45,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.1},{"category":"nature","firstShare":0.95,"majorityOption":"forest","modelId":"google/gemini-3.1-flash-lite-preview","n":20,"optionA":"river","optionAShare":0.45,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.1},{"category":"nature","firstShare":0.5,"majorityOption":"forest","modelId":"google/gemini-3.1-pro-preview","n":20,"optionA":"river","optionAShare":0.0,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":1.0},{"category":"nature","firstShare":0.65,"majorityOption":"forest","modelId":"ibm-granite/granite-4.1-8b","n":20,"optionA":"river","optionAShare":0.15,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.7},{"category":"nature","firstShare":0.65,"majorityOption":"forest","modelId":"inception/mercury-2","n":20,"optionA":"river","optionAShare":0.15,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.7},{"category":"nature","firstShare":1.0,"majorityOption":"river","modelId":"liquid/lfm-2-24b-a2b","n":20,"optionA":"river","optionAShare":0.5,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.0},{"category":"nature","firstShare":1.0,"majorityOption":"river","modelId":"meta-llama/llama-3.3-70b-instruct","n":20,"optionA":"river","optionAShare":0.5,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.0},{"category":"nature","firstShare":0.55,"majorityOption":"forest","modelId":"meta-llama/llama-4-maverick","n":20,"optionA":"river","optionAShare":0.05,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.9},{"category":"nature","firstShare":1.0,"majorityOption":"river","modelId":"meta-llama/llama-4-scout","n":20,"optionA":"river","optionAShare":0.5,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.0},{"category":"nature","firstShare":0.4,"majorityOption":"forest","modelId":"microsoft/phi-4","n":20,"optionA":"river","optionAShare":0.1,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.8},{"category":"nature","firstShare":0.6,"majorityOption":"river","modelId":"minimax/minimax-m2","n":20,"optionA":"river","optionAShare":0.7,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.4},{"category":"nature","firstShare":0.55,"majorityOption":"river","modelId":"minimax/minimax-m2.5","n":20,"optionA":"river","optionAShare":0.55,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.1},{"category":"nature","firstShare":0.85,"majorityOption":"river","modelId":"minimax/minimax-m2.7","n":20,"optionA":"river","optionAShare":0.55,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.1},{"category":"nature","firstShare":0.65,"majorityOption":"forest","modelId":"mistralai/mistral-medium-3-5","n":20,"optionA":"river","optionAShare":0.25,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.5},{"category":"nature","firstShare":0.55,"majorityOption":"river","modelId":"mistralai/mistral-small-2603","n":20,"optionA":"river","optionAShare":0.55,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.1},{"category":"nature","firstShare":0.5,"majorityOption":"forest","modelId":"nousresearch/hermes-4-405b","n":20,"optionA":"river","optionAShare":0.0,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":1.0},{"category":"nature","firstShare":0.4,"majorityOption":"river","modelId":"nousresearch/hermes-4-70b","n":20,"optionA":"river","optionAShare":0.5,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.0},{"category":"nature","firstShare":0.85,"majorityOption":"forest","modelId":"nvidia/nemotron-3-nano-30b-a3b","n":20,"optionA":"river","optionAShare":0.35,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.3},{"category":"nature","firstShare":0.85,"majorityOption":"forest","modelId":"nvidia/nemotron-3-super-120b-a12b","n":20,"optionA":"river","optionAShare":0.35,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.3},{"category":"nature","firstShare":0.75,"majorityOption":"forest","modelId":"openai/gpt-5-nano","n":20,"optionA":"river","optionAShare":0.25,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.5},{"category":"nature","firstShare":0.0,"majorityOption":"river","modelId":"openai/gpt-5.4","n":20,"optionA":"river","optionAShare":0.5,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.0},{"category":"nature","firstShare":0.5,"majorityOption":"forest","modelId":"perplexity/sonar","n":20,"optionA":"river","optionAShare":0.2,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.6},{"category":"nature","firstShare":0.6,"majorityOption":"forest","modelId":"qwen/qwen3.6-flash","n":20,"optionA":"river","optionAShare":0.1,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.8},{"category":"nature","firstShare":0.5,"majorityOption":"forest","modelId":"qwen/qwen3.6-max-preview","n":20,"optionA":"river","optionAShare":0.0,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":1.0},{"category":"nature","firstShare":0.75,"majorityOption":"forest","modelId":"qwen/qwen3.6-plus","n":20,"optionA":"river","optionAShare":0.25,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.5},{"category":"nature","firstShare":0.4286,"majorityOption":"river","modelId":"rekaai/reka-flash-3","n":7,"optionA":"river","optionAShare":0.8571,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.7143},{"category":"nature","firstShare":0.65,"majorityOption":"forest","modelId":"tencent/hunyuan-a13b-instruct","n":20,"optionA":"river","optionAShare":0.15,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.7},{"category":"nature","firstShare":0.95,"majorityOption":"forest","modelId":"tencent/hy3-preview:free","n":20,"optionA":"river","optionAShare":0.45,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.1},{"category":"nature","firstShare":0.9,"majorityOption":"river","modelId":"x-ai/grok-4.1-fast","n":20,"optionA":"river","optionAShare":0.5,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.0},{"category":"nature","firstShare":0.85,"majorityOption":"forest","modelId":"x-ai/grok-4.3","n":20,"optionA":"river","optionAShare":0.45,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.1},{"category":"nature","firstShare":0.55,"majorityOption":"forest","modelId":"z-ai/glm-4.7-flash","n":20,"optionA":"river","optionAShare":0.45,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.1},{"category":"nature","firstShare":0.65,"majorityOption":"forest","modelId":"z-ai/glm-5","n":20,"optionA":"river","optionAShare":0.15,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":0.7},{"category":"nature","firstShare":0.5,"majorityOption":"forest","modelId":"z-ai/glm-5.1","n":20,"optionA":"river","optionAShare":0.0,"optionB":"forest","pairId":"nature_river_forest","preferenceStrength":1.0}],"models":[{"attemptCostUsd":0.746067,"bareFirstShare":0.665,"completionTokens":490097,"contextSensitivity":0.5009,"family":"Qwen","firstShare":0.6008,"label":"Qwen3.6 Flash","modelId":"qwen/qwen3.6-flash","okRate":1.0,"okTrials":1200,"origin":"China","positionBiasStrength":0.2017,"promptTokens":43688,"provider":"Alibaba/Qwen","reasoningTokens":483097,"researchClass":"small or fast tier","semanticPreferenceStrength":0.5567,"status":{"ok":1200},"tier":"small","totalTrials":1200,"usageRows":1200},{"attemptCostUsd":2.602129,"bareFirstShare":0.5685,"completionTokens":409850,"contextSensitivity":0.4993,"family":"Qwen","firstShare":0.5483,"label":"Qwen3.6 Max Preview","modelId":"qwen/qwen3.6-max-preview","okRate":0.9833,"okTrials":1180,"origin":"China","positionBiasStrength":0.0966,"promptTokens":42947,"provider":"Alibaba/Qwen","reasoningTokens":402966,"researchClass":"flagship / frontier-class","semanticPreferenceStrength":0.8149,"status":{"error":18,"ok":1180,"rate_limited":2},"tier":"flagship","totalTrials":1200,"usageRows":1180},{"attemptCostUsd":0.837976,"bareFirstShare":0.6633,"completionTokens":422450,"contextSensitivity":0.5238,"family":"Qwen","firstShare":0.5883,"label":"Qwen3.6 Plus","modelId":"qwen/qwen3.6-plus","okRate":1.0,"okTrials":1200,"origin":"China","positionBiasStrength":0.1767,"promptTokens":43688,"provider":"Alibaba/Qwen","reasoningTokens":415536,"researchClass":"current mid-tier","semanticPreferenceStrength":0.64,"status":{"ok":1200},"tier":"mid","totalTrials":1200,"usageRows":1200},{"attemptCostUsd":0.035566,"bareFirstShare":0.6217,"completionTokens":3273,"contextSensitivity":0.5044,"family":"Nova","firstShare":0.5708,"label":"Nova Pro 1.0","modelId":"amazon/nova-pro-v1","okRate":1.0,"okTrials":1200,"origin":"US","positionBiasStrength":0.1417,"promptTokens":31366,"provider":"Amazon","reasoningTokens":0,"researchClass":"flagship / frontier-class","semanticPreferenceStrength":0.4767,"status":{"ok":1200},"tier":"flagship","totalTrials":1200,"usageRows":1200},{"attemptCostUsd":0.065052,"bareFirstShare":0.6633,"completionTokens":4947,"contextSensitivity":0.4798,"family":"Claude","firstShare":0.5958,"label":"Claude Haiku 4.5","modelId":"anthropic/claude-haiku-4.5","okRate":1.0,"okTrials":1200,"origin":"US","positionBiasStrength":0.1917,"promptTokens":40317,"provider":"Anthropic","reasoningTokens":0,"researchClass":"small or fast tier","semanticPreferenceStrength":0.6533,"status":{"ok":1200},"tier":"small","totalTrials":1200,"usageRows":1201},{"attemptCostUsd":0.47724,"bareFirstShare":0.6367,"completionTokens":7182,"contextSensitivity":0.5114,"family":"Claude","firstShare":0.5875,"label":"Claude Opus 4.7","modelId":"anthropic/claude-opus-4.7","okRate":1.0,"okTrials":1200,"origin":"US","positionBiasStrength":0.175,"promptTokens":59538,"provider":"Anthropic","reasoningTokens":0,"researchClass":"flagship / frontier-class","semanticPreferenceStrength":0.64,"status":{"ok":1200},"tier":"flagship","totalTrials":1200,"usageRows":1200},{"attemptCostUsd":0.194478,"bareFirstShare":0.835,"completionTokens":4910,"contextSensitivity":0.4709,"family":"Claude","firstShare":0.6708,"label":"Claude Sonnet 4.6","modelId":"anthropic/claude-sonnet-4.6","okRate":1.0,"okTrials":1200,"origin":"US","positionBiasStrength":0.3417,"promptTokens":40276,"provider":"Anthropic","reasoningTokens":0,"researchClass":"current mid-tier","semanticPreferenceStrength":0.33,"status":{"ok":1200},"tier":"mid","totalTrials":1200,"usageRows":1200},{"attemptCostUsd":0.0,"bareFirstShare":null,"completionTokens":0,"contextSensitivity":null,"family":"ERNIE","firstShare":null,"label":"ERNIE 4.5 21B A3B","modelId":"baidu/ernie-4.5-21b-a3b","okRate":0.0,"okTrials":0,"origin":"China","positionBiasStrength":null,"promptTokens":0,"provider":"Baidu","reasoningTokens":0,"researchClass":"small or fast tier","semanticPreferenceStrength":null,"status":{"error":34,"model_removed":444,"rate_limited":722},"tier":"small","totalTrials":1200,"usageRows":0},{"attemptCostUsd":0.011546,"bareFirstShare":0.5317,"completionTokens":2414,"contextSensitivity":0.5206,"family":"ERNIE","firstShare":0.5208,"label":"ERNIE 4.5 300B A47B","modelId":"baidu/ernie-4.5-300b-a47b","okRate":1.0,"okTrials":1200,"origin":"China","positionBiasStrength":0.0417,"promptTokens":31752,"provider":"Baidu","reasoningTokens":0,"researchClass":"small or fast tier","semanticPreferenceStrength":0.6433,"status":{"ok":1200},"tier":"small","totalTrials":1200,"usageRows":1209},{"attemptCostUsd":0.010162,"bareFirstShare":0.5517,"completionTokens":2423,"contextSensitivity":0.4249,"family":"DeepSeek","firstShare":0.54,"label":"DeepSeek V3.2","modelId":"deepseek/deepseek-v3.2","okRate":1.0,"okTrials":1200,"origin":"China","positionBiasStrength":0.08,"promptTokens":41008,"provider":"DeepSeek","reasoningTokens":0,"researchClass":"current mid-tier","semanticPreferenceStrength":0.5167,"status":{"ok":1200},"tier":"mid","totalTrials":1200,"usageRows":1200},{"attemptCostUsd":0.03274,"bareFirstShare":0.78,"completionTokens":94709,"contextSensitivity":0.5074,"family":"DeepSeek","firstShare":0.6639,"label":"DeepSeek V4 Flash","modelId":"deepseek/deepseek-v4-flash","okRate":0.9992,"okTrials":1199,"origin":"China","positionBiasStrength":0.3278,"promptTokens":38250,"provider":"DeepSeek","reasoningTokens":93930,"researchClass":"small or fast tier","semanticPreferenceStrength":0.4067,"status":{"error":1,"ok":1199},"tier":"small","totalTrials":1200,"usageRows":1247},{"attemptCostUsd":0.471404,"bareFirstShare":0.725,"completionTokens":119102,"contextSensitivity":0.4842,"family":"DeepSeek","firstShare":0.6442,"label":"DeepSeek V4 Pro","modelId":"deepseek/deepseek-v4-pro","okRate":1.0,"okTrials":1200,"origin":"China","positionBiasStrength":0.2883,"promptTokens":37966,"provider":"DeepSeek","reasoningTokens":117389,"researchClass":"flagship / frontier-class","semanticPreferenceStrength":0.5167,"status":{"ok":1200},"tier":"flagship","totalTrials":1200,"usageRows":1217},{"attemptCostUsd":0.019545,"bareFirstShare":0.4617,"completionTokens":1285,"contextSensitivity":0.5236,"family":"Gemini","firstShare":0.4775,"label":"Gemini 3 Flash Preview","modelId":"google/gemini-3-flash-preview","okRate":1.0,"okTrials":1200,"origin":"US","positionBiasStrength":0.045,"promptTokens":31380,"provider":"Google","reasoningTokens":0,"researchClass":"small or fast tier","semanticPreferenceStrength":0.7967,"status":{"ok":1200},"tier":"small","totalTrials":1200,"usageRows":1200},{"attemptCostUsd":0.009962,"bareFirstShare":0.675,"completionTokens":1309,"contextSensitivity":0.5187,"family":"Gemini","firstShare":0.605,"label":"Gemini 3.1 Flash Lite Preview","modelId":"google/gemini-3.1-flash-lite-preview","okRate":1.0,"okTrials":1200,"origin":"US","positionBiasStrength":0.21,"promptTokens":31995,"provider":"Google","reasoningTokens":0,"researchClass":"small or fast tier","semanticPreferenceStrength":0.6433,"status":{"ok":1200},"tier":"small","totalTrials":1200,"usageRows":1200},{"attemptCostUsd":3.0195,"bareFirstShare":0.5242,"completionTokens":246319,"contextSensitivity":0.5007,"family":"Gemini","firstShare":0.5263,"label":"Gemini 3.1 Pro Preview","modelId":"google/gemini-3.1-pro-preview","okRate":0.9992,"okTrials":1199,"origin":"US","positionBiasStrength":0.0525,"promptTokens":31836,"provider":"Google","reasoningTokens":244888,"researchClass":"flagship / frontier-class","semanticPreferenceStrength":0.8667,"status":{"error":1,"ok":1199},"tier":"flagship","totalTrials":1200,"usageRows":1204},{"attemptCostUsd":0.002336,"bareFirstShare":0.7417,"completionTokens":2691,"contextSensitivity":0.4545,"family":"Granite","firstShare":0.6583,"label":"Granite 4.1 8B","modelId":"ibm-granite/granite-4.1-8b","okRate":1.0,"okTrials":1200,"origin":"US","positionBiasStrength":0.3167,"promptTokens":41328,"provider":"IBM Granite","reasoningTokens":0,"researchClass":"small or fast tier","semanticPreferenceStrength":0.4833,"status":{"ok":1200},"tier":"small","totalTrials":1200,"usageRows":1200},{"attemptCostUsd":0.093941,"bareFirstShare":0.7483,"completionTokens":117939,"contextSensitivity":0.4029,"family":"Mercury","firstShare":0.675,"label":"Mercury 2","modelId":"inception/mercury-2","okRate":1.0,"okTrials":1200,"origin":"US","positionBiasStrength":0.35,"promptTokens":31410,"provider":"Inception Labs","reasoningTokens":112867,"researchClass":"current mid-tier","semanticPreferenceStrength":0.5033,"status":{"ok":1200},"tier":"mid","totalTrials":1200,"usageRows":1201},{"attemptCostUsd":0.00169,"bareFirstShare":0.9733,"completionTokens":2960,"contextSensitivity":0.3486,"family":"LFM","firstShare":0.8239,"label":"LFM2-24B-A2B","modelId":"liquid/lfm-2-24b-a2b","okRate":0.9983,"okTrials":1198,"origin":"Other","positionBiasStrength":0.6477,"promptTokens":44509,"provider":"Liquid AI","reasoningTokens":0,"researchClass":"small or fast tier","semanticPreferenceStrength":0.0551,"status":{"error":2,"ok":1198},"tier":"small","totalTrials":1200,"usageRows":1198},{"attemptCostUsd":0.010423,"bareFirstShare":0.9233,"completionTokens":2773,"contextSensitivity":0.5173,"family":"Llama","firstShare":0.7183,"label":"Llama 3.3 70B Instruct","modelId":"meta-llama/llama-3.3-70b-instruct","okRate":1.0,"okTrials":1200,"origin":"US","positionBiasStrength":0.4367,"promptTokens":54025,"provider":"Meta","reasoningTokens":0,"researchClass":"open-weight or open-route","semanticPreferenceStrength":0.1533,"status":{"ok":1200},"tier":"open","totalTrials":1200,"usageRows":1200},{"attemptCostUsd":0.019093,"bareFirstShare":0.7,"completionTokens":2634,"contextSensitivity":0.491,"family":"Llama","firstShare":0.5993,"label":"Llama 4 Maverick","modelId":"meta-llama/llama-4-maverick","okRate":0.9983,"okTrials":1198,"origin":"US","positionBiasStrength":0.1987,"promptTokens":84591,"provider":"Meta","reasoningTokens":0,"researchClass":"open-weight or open-route","semanticPreferenceStrength":0.5067,"status":{"error":2,"ok":1198},"tier":"open","totalTrials":1200,"usageRows":1198},{"attemptCostUsd":0.006853,"bareFirstShare":0.7683,"completionTokens":3988,"contextSensitivity":0.4992,"family":"Llama","firstShare":0.64,"label":"Llama 4 Scout","modelId":"meta-llama/llama-4-scout","okRate":1.0,"okTrials":1200,"origin":"US","positionBiasStrength":0.28,"promptTokens":45877,"provider":"Meta","reasoningTokens":0,"researchClass":"open-weight or open-route","semanticPreferenceStrength":0.4367,"status":{"ok":1200},"tier":"open","totalTrials":1200,"usageRows":1282},{"attemptCostUsd":0.003091,"bareFirstShare":0.4608,"completionTokens":2763,"contextSensitivity":0.4716,"family":"Phi","firstShare":0.4858,"label":"Phi 4","modelId":"microsoft/phi-4","okRate":0.9983,"okTrials":1198,"origin":"US","positionBiasStrength":0.0284,"promptTokens":40128,"provider":"Microsoft","reasoningTokens":0,"researchClass":"small or fast tier","semanticPreferenceStrength":0.6023,"status":{"error":2,"ok":1198},"tier":"small","totalTrials":1200,"usageRows":1200},{"attemptCostUsd":0.470927,"bareFirstShare":0.7667,"completionTokens":407466,"contextSensitivity":0.486,"family":"MiniMax","firstShare":0.6533,"label":"MiniMax M2","modelId":"minimax/minimax-m2","okRate":1.0,"okTrials":1200,"origin":"China","positionBiasStrength":0.3067,"promptTokens":79713,"provider":"MiniMax","reasoningTokens":430056,"researchClass":"flagship / frontier-class","semanticPreferenceStrength":0.4133,"status":{"ok":1200},"tier":"flagship","totalTrials":1200,"usageRows":1271},{"attemptCostUsd":0.908455,"bareFirstShare":0.7863,"completionTokens":751454,"contextSensitivity":0.4551,"family":"MiniMax","firstShare":0.6603,"label":"MiniMax M2.5","modelId":"minimax/minimax-m2.5","okRate":0.9983,"okTrials":1198,"origin":"China","positionBiasStrength":0.3205,"promptTokens":83329,"provider":"MiniMax","reasoningTokens":777608,"researchClass":"flagship / frontier-class","semanticPreferenceStrength":0.3891,"status":{"error":2,"ok":1198},"tier":"flagship","totalTrials":1200,"usageRows":1280},{"attemptCostUsd":0.566958,"bareFirstShare":0.8117,"completionTokens":392058,"contextSensitivity":0.4625,"family":"MiniMax","firstShare":0.6942,"label":"MiniMax M2.7","modelId":"minimax/minimax-m2.7","okRate":1.0,"okTrials":1200,"origin":"China","positionBiasStrength":0.3883,"promptTokens":80133,"provider":"MiniMax","reasoningTokens":426757,"researchClass":"flagship / frontier-class","semanticPreferenceStrength":0.3567,"status":{"ok":1200},"tier":"flagship","totalTrials":1200,"usageRows":1268},{"attemptCostUsd":0.096465,"bareFirstShare":0.7717,"completionTokens":2806,"contextSensitivity":0.4255,"family":"Mistral","firstShare":0.6725,"label":"Mistral Medium 3.5","modelId":"mistralai/mistral-medium-3-5","okRate":1.0,"okTrials":1200,"origin":"EU","positionBiasStrength":0.345,"promptTokens":50280,"provider":"Mistral AI","reasoningTokens":0,"researchClass":"current mid-tier","semanticPreferenceStrength":0.3567,"status":{"ok":1200},"tier":"mid","totalTrials":1200,"usageRows":1200},{"attemptCostUsd":0.009765,"bareFirstShare":0.69,"completionTokens":2810,"contextSensitivity":0.4437,"family":"Mistral","firstShare":0.6183,"label":"Mistral Small 4","modelId":"mistralai/mistral-small-2603","okRate":1.0,"okTrials":1200,"origin":"EU","positionBiasStrength":0.2367,"promptTokens":50280,"provider":"Mistral AI","reasoningTokens":0,"researchClass":"small or fast tier","semanticPreferenceStrength":0.42,"status":{"ok":1200},"tier":"small","totalTrials":1200,"usageRows":1200},{"attemptCostUsd":0.038528,"bareFirstShare":0.7933,"completionTokens":179528,"contextSensitivity":0.4496,"family":"Nemotron","firstShare":0.6725,"label":"Nemotron 3 Nano 30B A3B","modelId":"nvidia/nemotron-3-nano-30b-a3b","okRate":1.0,"okTrials":1200,"origin":"US","positionBiasStrength":0.345,"promptTokens":52442,"provider":"NVIDIA","reasoningTokens":171557,"researchClass":"small or fast tier","semanticPreferenceStrength":0.4133,"status":{"ok":1200},"tier":"small","totalTrials":1200,"usageRows":1220},{"attemptCostUsd":0.037965,"bareFirstShare":0.7267,"completionTokens":60560,"contextSensitivity":0.5121,"family":"Nemotron","firstShare":0.6308,"label":"Nemotron 3 Super","modelId":"nvidia/nemotron-3-super-120b-a12b","okRate":1.0,"okTrials":1200,"origin":"US","positionBiasStrength":0.2617,"promptTokens":46905,"provider":"NVIDIA","reasoningTokens":83939,"researchClass":"open-weight or open-route","semanticPreferenceStrength":0.5267,"status":{"ok":1200},"tier":"open","totalTrials":1200,"usageRows":1228},{"attemptCostUsd":0.078991,"bareFirstShare":0.5017,"completionTokens":5987,"contextSensitivity":0.4589,"family":"Hermes","firstShare":0.4883,"label":"Hermes 4 405B","modelId":"nousresearch/hermes-4-405b","okRate":1.0,"okTrials":1200,"origin":"US","positionBiasStrength":0.0233,"promptTokens":61030,"provider":"Nous Research","reasoningTokens":3356,"researchClass":"flagship / frontier-class","semanticPreferenceStrength":0.79,"status":{"ok":1200},"tier":"flagship","totalTrials":1200,"usageRows":1210},{"attemptCostUsd":0.009086,"bareFirstShare":0.545,"completionTokens":3012,"contextSensitivity":0.3971,"family":"Hermes","firstShare":0.5225,"label":"Hermes 4 70B","modelId":"nousresearch/hermes-4-70b","okRate":1.0,"okTrials":1200,"origin":"US","positionBiasStrength":0.045,"promptTokens":60627,"provider":"Nous Research","reasoningTokens":402,"researchClass":"open-weight or open-route","semanticPreferenceStrength":0.43,"status":{"ok":1200},"tier":"open","totalTrials":1200,"usageRows":1202},{"attemptCostUsd":0.121186,"bareFirstShare":0.7117,"completionTokens":297894,"contextSensitivity":0.4944,"family":"GPT / OpenAI","firstShare":0.6125,"label":"GPT-5 Nano","modelId":"openai/gpt-5-nano","okRate":1.0,"okTrials":1200,"origin":"US","positionBiasStrength":0.225,"promptTokens":40564,"provider":"OpenAI","reasoningTokens":251225,"researchClass":"small or fast tier","semanticPreferenceStrength":0.5233,"status":{"ok":1200},"tier":"small","totalTrials":1200,"usageRows":1244},{"attemptCostUsd":0.192665,"bareFirstShare":0.21,"completionTokens":6366,"contextSensitivity":0.4741,"family":"GPT / OpenAI","firstShare":0.3475,"label":"GPT-5.4","modelId":"openai/gpt-5.4","okRate":1.0,"okTrials":1200,"origin":"US","positionBiasStrength":0.305,"promptTokens":38889,"provider":"OpenAI","reasoningTokens":0,"researchClass":"current mid-tier","semanticPreferenceStrength":0.3867,"status":{"ok":1200},"tier":"mid","totalTrials":1200,"usageRows":1201},{"attemptCostUsd":6.08951,"bareFirstShare":0.4858,"completionTokens":2465,"contextSensitivity":0.4622,"family":"Sonar","firstShare":0.4912,"label":"Sonar","modelId":"perplexity/sonar","okRate":0.9992,"okTrials":1199,"origin":"US","positionBiasStrength":0.0175,"promptTokens":33264,"provider":"Perplexity","reasoningTokens":0,"researchClass":"current mid-tier","semanticPreferenceStrength":0.5028,"status":{"error":1,"ok":1199},"tier":"mid","totalTrials":1200,"usageRows":1211},{"attemptCostUsd":0.797788,"bareFirstShare":0.4641,"completionTokens":3949282,"contextSensitivity":0.4344,"family":"Reka","firstShare":0.5105,"label":"Reka Flash 3","modelId":"rekaai/reka-flash-3","okRate":0.3183,"okTrials":382,"origin":"Other","positionBiasStrength":0.0209,"promptTokens":79317,"provider":"Reka AI","reasoningTokens":4118657,"researchClass":"small or fast tier","semanticPreferenceStrength":0.394,"status":{"invalid":126,"model_removed":692,"ok":382},"tier":"small","totalTrials":1200,"usageRows":2380},{"attemptCostUsd":0.007266,"bareFirstShare":0.8861,"completionTokens":2616,"contextSensitivity":0.4004,"family":"Hunyuan","firstShare":0.7458,"label":"Hunyuan A13B Instruct","modelId":"tencent/hunyuan-a13b-instruct","okRate":0.9967,"okTrials":1196,"origin":"China","positionBiasStrength":0.4916,"promptTokens":41248,"provider":"Tencent","reasoningTokens":0,"researchClass":"small or fast tier","semanticPreferenceStrength":0.23,"status":{"error":4,"ok":1196},"tier":"small","totalTrials":1200,"usageRows":1197},{"attemptCostUsd":0.301142,"bareFirstShare":0.5983,"completionTokens":709053,"contextSensitivity":0.4917,"family":"GLM","firstShare":0.5538,"label":"GLM 4.7 Flash","modelId":"z-ai/glm-4.7-flash","okRate":0.9992,"okTrials":1199,"origin":"China","positionBiasStrength":0.1076,"promptTokens":45587,"provider":"Z.ai","reasoningTokens":735477,"researchClass":"small or fast tier","semanticPreferenceStrength":0.5833,"status":{"error":1,"ok":1199},"tier":"small","totalTrials":1200,"usageRows":1421},{"attemptCostUsd":0.880795,"bareFirstShare":0.6783,"completionTokens":323261,"contextSensitivity":0.5118,"family":"GLM","firstShare":0.6025,"label":"GLM 5","modelId":"z-ai/glm-5","okRate":1.0,"okTrials":1200,"origin":"China","positionBiasStrength":0.205,"promptTokens":41224,"provider":"Z.ai","reasoningTokens":329092,"researchClass":"current mid-tier","semanticPreferenceStrength":0.6233,"status":{"ok":1200},"tier":"mid","totalTrials":1200,"usageRows":1297},{"attemptCostUsd":1.376068,"bareFirstShare":0.5683,"completionTokens":321150,"contextSensitivity":0.5308,"family":"GLM","firstShare":0.5467,"label":"GLM 5.1","modelId":"z-ai/glm-5.1","okRate":1.0,"okTrials":1200,"origin":"China","positionBiasStrength":0.0933,"promptTokens":39312,"provider":"Z.ai","reasoningTokens":320565,"researchClass":"current mid-tier","semanticPreferenceStrength":0.75,"status":{"ok":1200},"tier":"mid","totalTrials":1200,"usageRows":1243},{"attemptCostUsd":0.0,"bareFirstShare":0.755,"completionTokens":589738,"contextSensitivity":0.5384,"family":"Hunyuan","firstShare":0.633,"label":"tencent/hy3-preview:free","modelId":"tencent/hy3-preview:free","okRate":0.9992,"okTrials":1199,"origin":"Unknown","positionBiasStrength":0.2661,"promptTokens":56870,"provider":"tencent","reasoningTokens":396,"researchClass":"uncategorized","semanticPreferenceStrength":0.49,"status":{"error":1,"ok":1199},"tier":"unknown","totalTrials":1200,"usageRows":1458},{"attemptCostUsd":0.24833,"bareFirstShare":0.7883,"completionTokens":464655,"contextSensitivity":0.47,"family":"Grok","firstShare":0.65,"label":"Grok 4.1 Fast","modelId":"x-ai/grok-4.1-fast","okRate":1.0,"okTrials":1200,"origin":"US","positionBiasStrength":0.3,"promptTokens":218690,"provider":"xAI","reasoningTokens":463323,"researchClass":"current mid-tier","semanticPreferenceStrength":0.3767,"status":{"ok":1200},"tier":"mid","totalTrials":1200,"usageRows":1200},{"attemptCostUsd":1.307365,"bareFirstShare":0.7861,"completionTokens":490027,"contextSensitivity":0.4712,"family":"Grok","firstShare":0.6652,"label":"Grok 4.3","modelId":"x-ai/grok-4.3","okRate":0.9758,"okTrials":1171,"origin":"US","positionBiasStrength":0.3305,"promptTokens":182927,"provider":"xAI","reasoningTokens":488726,"researchClass":"flagship / frontier-class","semanticPreferenceStrength":0.4052,"status":{"error":29,"ok":1171},"tier":"flagship","totalTrials":1200,"usageRows":1172}],"pairBias":[{"category":"taste","majorityOption":"sweet","n":802,"optionA":"sweet","optionACount":727,"optionAShare":0.9065,"optionB":"bitter","optionBShare":0.0935,"pairId":"taste_sweet_bitter","preferenceStrength":0.813},{"category":"texture","majorityOption":"smooth","n":804,"optionA":"smooth","optionACount":710,"optionAShare":0.8831,"optionB":"rough","optionBShare":0.1169,"pairId":"texture_smooth_rough","preferenceStrength":0.7662},{"category":"sound","majorityOption":"quiet","n":804,"optionA":"loud","optionACount":104,"optionAShare":0.1294,"optionB":"quiet","optionBShare":0.8706,"pairId":"sound_loud_quiet","preferenceStrength":0.7413},{"category":"motion","majorityOption":"fast","n":806,"optionA":"fast","optionACount":697,"optionAShare":0.8648,"optionB":"slow","optionBShare":0.1352,"pairId":"motion_fast_slow","preferenceStrength":0.7295},{"category":"direction","majorityOption":"up","n":805,"optionA":"up","optionACount":664,"optionAShare":0.8248,"optionB":"down","optionBShare":0.1752,"pairId":"direction_up_down","preferenceStrength":0.6497},{"category":"terrain","majorityOption":"mountain","n":805,"optionA":"mountain","optionACount":659,"optionAShare":0.8186,"optionB":"valley","optionBShare":0.1814,"pairId":"terrain_mountain_valley","preferenceStrength":0.6373},{"category":"time","majorityOption":"early","n":806,"optionA":"early","optionACount":657,"optionAShare":0.8151,"optionB":"late","optionBShare":0.1849,"pairId":"time_early_late","preferenceStrength":0.6303},{"category":"temperature","majorityOption":"warm","n":809,"optionA":"warm","optionACount":657,"optionAShare":0.8121,"optionB":"cold","optionBShare":0.1879,"pairId":"temperature_warm_cold","preferenceStrength":0.6242},{"category":"abstract","majorityOption":"simple","n":811,"optionA":"simple","optionACount":637,"optionAShare":0.7855,"optionB":"complex","optionBShare":0.2145,"pairId":"abstract_simple_complex","preferenceStrength":0.5709},{"category":"color","majorityOption":"blue","n":809,"optionA":"blue","optionACount":602,"optionAShare":0.7441,"optionB":"red","optionBShare":0.2559,"pairId":"color_blue_red","preferenceStrength":0.4883},{"category":"density","majorityOption":"light","n":804,"optionA":"light","optionACount":596,"optionAShare":0.7413,"optionB":"heavy","optionBShare":0.2587,"pairId":"density_light_heavy","preferenceStrength":0.4826},{"category":"time","majorityOption":"morning","n":805,"optionA":"morning","optionACount":590,"optionAShare":0.7329,"optionB":"evening","optionBShare":0.2671,"pairId":"time_morning_evening","preferenceStrength":0.4658},{"category":"object","majorityOption":"lamp","n":808,"optionA":"candle","optionACount":218,"optionAShare":0.2698,"optionB":"lamp","optionBShare":0.7302,"pairId":"object_candle_lamp","preferenceStrength":0.4604},{"category":"abstract","majorityOption":"wide","n":801,"optionA":"narrow","optionACount":217,"optionAShare":0.2709,"optionB":"wide","optionBShare":0.7291,"pairId":"abstract_narrow_wide","preferenceStrength":0.4582},{"category":"shape","majorityOption":"circle","n":807,"optionA":"circle","optionACount":574,"optionAShare":0.7113,"optionB":"square","optionBShare":0.2887,"pairId":"shape_circle_square","preferenceStrength":0.4226},{"category":"nature","majorityOption":"forest","n":807,"optionA":"river","optionACount":237,"optionAShare":0.2937,"optionB":"forest","optionBShare":0.7063,"pairId":"nature_river_forest","preferenceStrength":0.4126},{"category":"sound","majorityOption":"mellow","n":801,"optionA":"sharp","optionACount":238,"optionAShare":0.2971,"optionB":"mellow","optionBShare":0.7029,"pairId":"sound_sharp_mellow","preferenceStrength":0.4057},{"category":"object","majorityOption":"cup","n":804,"optionA":"cup","optionACount":521,"optionAShare":0.648,"optionB":"plate","optionBShare":0.352,"pairId":"object_cup_plate","preferenceStrength":0.296},{"category":"texture","majorityOption":"soft","n":804,"optionA":"soft","optionACount":518,"optionAShare":0.6443,"optionB":"hard","optionBShare":0.3557,"pairId":"texture_soft_hard","preferenceStrength":0.2886},{"category":"weather","majorityOption":"dry","n":806,"optionA":"humid","optionACount":300,"optionAShare":0.3722,"optionB":"dry","optionBShare":0.6278,"pairId":"weather_humid_dry","preferenceStrength":0.2556},{"category":"weather","majorityOption":"still","n":800,"optionA":"windy","optionACount":301,"optionAShare":0.3762,"optionB":"still","optionBShare":0.6238,"pairId":"weather_windy_still","preferenceStrength":0.2475},{"category":"material","majorityOption":"stone","n":807,"optionA":"glass","optionACount":336,"optionAShare":0.4164,"optionB":"stone","optionBShare":0.5836,"pairId":"material_glass_stone","preferenceStrength":0.1673},{"category":"direction","majorityOption":"right","n":807,"optionA":"left","optionACount":340,"optionAShare":0.4213,"optionB":"right","optionBShare":0.5787,"pairId":"direction_left_right","preferenceStrength":0.1574},{"category":"material","majorityOption":"wood","n":805,"optionA":"wood","optionACount":465,"optionAShare":0.5776,"optionB":"metal","optionBShare":0.4224,"pairId":"material_wood_metal","preferenceStrength":0.1553},{"category":"object","majorityOption":"key","n":807,"optionA":"key","optionACount":442,"optionAShare":0.5477,"optionB":"coin","optionBShare":0.4523,"pairId":"object_key_coin","preferenceStrength":0.0954},{"category":"size","majorityOption":"large","n":803,"optionA":"small","optionACount":366,"optionAShare":0.4558,"optionB":"large","optionBShare":0.5442,"pairId":"size_small_large","preferenceStrength":0.0884},{"category":"taste","majorityOption":"salty","n":803,"optionA":"salty","optionACount":435,"optionAShare":0.5417,"optionB":"sour","optionBShare":0.4583,"pairId":"taste_salty_sour","preferenceStrength":0.0834},{"category":"color","majorityOption":"yellow","n":801,"optionA":"yellow","optionACount":433,"optionAShare":0.5406,"optionB":"gray","optionBShare":0.4594,"pairId":"color_yellow_gray","preferenceStrength":0.0811},{"category":"color","majorityOption":"green","n":804,"optionA":"green","optionACount":417,"optionAShare":0.5187,"optionB":"purple","optionBShare":0.4813,"pairId":"color_green_purple","preferenceStrength":0.0373},{"category":"shape","majorityOption":"triangle","n":808,"optionA":"triangle","optionACount":404,"optionAShare":0.5,"optionB":"oval","optionBShare":0.5,"pairId":"shape_triangle_oval","preferenceStrength":0.0}],"parseStatusCounts":[{"count":48091,"parseStatus":"exact"},{"count":1266,"parseStatus":"none"},{"count":818,"parseStatus":"invalid"},{"count":118,"parseStatus":"single_token_in_text"},{"count":106,"parseStatus":"repeated_single_option"},{"count":1,"parseStatus":"manual_override"}],"providerSummary":[{"attemptCostUsd":4.186172,"counts":{"error":18,"ok":3580,"rate_limited":2},"meanFirstShare":0.5791,"meanSemanticPreferenceStrength":0.6705,"models":3,"okRate":0.9944,"provider":"Alibaba/Qwen","totalTrials":3600},{"attemptCostUsd":0.035566,"counts":{"ok":1200},"meanFirstShare":0.5708,"meanSemanticPreferenceStrength":0.4767,"models":1,"okRate":1.0,"provider":"Amazon","totalTrials":1200},{"attemptCostUsd":0.73677,"counts":{"ok":3600},"meanFirstShare":0.618,"meanSemanticPreferenceStrength":0.5411,"models":3,"okRate":1.0,"provider":"Anthropic","totalTrials":3600},{"attemptCostUsd":0.011546,"counts":{"error":34,"model_removed":444,"ok":1200,"rate_limited":722},"meanFirstShare":0.5208,"meanSemanticPreferenceStrength":0.6433,"models":2,"okRate":0.5,"provider":"Baidu","totalTrials":2400},{"attemptCostUsd":0.514306,"counts":{"error":1,"ok":3599},"meanFirstShare":0.616,"meanSemanticPreferenceStrength":0.48,"models":3,"okRate":0.9997,"provider":"DeepSeek","totalTrials":3600},{"attemptCostUsd":3.049007,"counts":{"error":1,"ok":3599},"meanFirstShare":0.5363,"meanSemanticPreferenceStrength":0.7689,"models":3,"okRate":0.9997,"provider":"Google","totalTrials":3600},{"attemptCostUsd":0.002336,"counts":{"ok":1200},"meanFirstShare":0.6583,"meanSemanticPreferenceStrength":0.4833,"models":1,"okRate":1.0,"provider":"IBM Granite","totalTrials":1200},{"attemptCostUsd":0.093941,"counts":{"ok":1200},"meanFirstShare":0.675,"meanSemanticPreferenceStrength":0.5033,"models":1,"okRate":1.0,"provider":"Inception Labs","totalTrials":1200},{"attemptCostUsd":0.00169,"counts":{"error":2,"ok":1198},"meanFirstShare":0.8239,"meanSemanticPreferenceStrength":0.0551,"models":1,"okRate":0.9983,"provider":"Liquid AI","totalTrials":1200},{"attemptCostUsd":0.036369,"counts":{"error":2,"ok":3598},"meanFirstShare":0.6525,"meanSemanticPreferenceStrength":0.3656,"models":3,"okRate":0.9994,"provider":"Meta","totalTrials":3600},{"attemptCostUsd":0.003091,"counts":{"error":2,"ok":1198},"meanFirstShare":0.4858,"meanSemanticPreferenceStrength":0.6023,"models":1,"okRate":0.9983,"provider":"Microsoft","totalTrials":1200},{"attemptCostUsd":1.94634,"counts":{"error":2,"ok":3598},"meanFirstShare":0.6693,"meanSemanticPreferenceStrength":0.3864,"models":3,"okRate":0.9994,"provider":"MiniMax","totalTrials":3600},{"attemptCostUsd":0.10623,"counts":{"ok":2400},"meanFirstShare":0.6454,"meanSemanticPreferenceStrength":0.3883,"models":2,"okRate":1.0,"provider":"Mistral AI","totalTrials":2400},{"attemptCostUsd":0.076493,"counts":{"ok":2400},"meanFirstShare":0.6517,"meanSemanticPreferenceStrength":0.47,"models":2,"okRate":1.0,"provider":"NVIDIA","totalTrials":2400},{"attemptCostUsd":0.088077,"counts":{"ok":2400},"meanFirstShare":0.5054,"meanSemanticPreferenceStrength":0.61,"models":2,"okRate":1.0,"provider":"Nous Research","totalTrials":2400},{"attemptCostUsd":0.313851,"counts":{"ok":2400},"meanFirstShare":0.48,"meanSemanticPreferenceStrength":0.455,"models":2,"okRate":1.0,"provider":"OpenAI","totalTrials":2400},{"attemptCostUsd":6.08951,"counts":{"error":1,"ok":1199},"meanFirstShare":0.4912,"meanSemanticPreferenceStrength":0.5028,"models":1,"okRate":0.9992,"provider":"Perplexity","totalTrials":1200},{"attemptCostUsd":0.797788,"counts":{"invalid":126,"model_removed":692,"ok":382},"meanFirstShare":0.5105,"meanSemanticPreferenceStrength":0.394,"models":1,"okRate":0.3183,"provider":"Reka AI","totalTrials":1200},{"attemptCostUsd":0.007266,"counts":{"error":4,"ok":1196},"meanFirstShare":0.7458,"meanSemanticPreferenceStrength":0.23,"models":1,"okRate":0.9967,"provider":"Tencent","totalTrials":1200},{"attemptCostUsd":2.558005,"counts":{"error":1,"ok":3599},"meanFirstShare":0.5677,"meanSemanticPreferenceStrength":0.6522,"models":3,"okRate":0.9997,"provider":"Z.ai","totalTrials":3600},{"attemptCostUsd":0.0,"counts":{"error":1,"ok":1199},"meanFirstShare":0.633,"meanSemanticPreferenceStrength":0.49,"models":1,"okRate":0.9992,"provider":"tencent","totalTrials":1200},{"attemptCostUsd":1.555695,"counts":{"error":29,"ok":2371},"meanFirstShare":0.6576,"meanSemanticPreferenceStrength":0.391,"models":2,"okRate":0.9879,"provider":"xAI","totalTrials":2400}],"statusCounts":[{"count":48316,"status":"ok"},{"count":1136,"status":"model_removed"},{"count":724,"status":"rate_limited"},{"count":126,"status":"invalid"},{"count":98,"status":"error"}],"study":{"articleDate":"2026-05-08","attemptsUpdatedAt":"2026-05-08 10:06:11","author":"Daniel Alonso","conditions":["bare","bare_swapped","context","context_swapped"],"contexts":60,"dashboardSpendUsd":28.6,"inferredContextTargets":55,"models":42,"pairs":30,"plannedTrials":50400,"repetitions":10,"slug":"llm-arbitrary-choice-study","sourceDatabase":"source SQLite run log; public release is study-summary.json and generated artifacts","sourceUpdatedAt":"2026-05-08 10:06:11","subtitle":"A forced-choice audit of 42 LLMs across 50,400 planned trials.","taxonomyNote":"Provider, family, and tier labels come from the local study config and model route names. They are an approximate descriptive taxonomy, not a benchmark ranking.","temperature":0.7,"title":"Arbitrary Choices Are Not Random"}}