{"standard_bench":{"window_days":30,"measured_at":"2026-08-17T05:13:30.720Z","method":"An identical prompt is sent to every model at temperature 0; cost is computed from the token usage each provider actually reported. Requests that arrived on a channel serving a large cached preamble (>=1000 cached prompt tokens) are excluded from the comparison and reported separately, because that preamble is routing behaviour, not a property of the model.","tasks":[{"task":"short_answer","models":[{"model":"deepseek-v4-flash","runs":13,"avg_usd":0.000104,"avg_tokens_in":26,"avg_tokens_out":133,"avg_latency_ms":3072},{"model":"gemini-3.5-flash","runs":9,"avg_usd":0.000625,"avg_tokens_in":97,"avg_tokens_out":71,"avg_latency_ms":6931},{"model":"GLM5.2","runs":12,"avg_usd":0.000743,"avg_tokens_in":34,"avg_tokens_out":200,"avg_latency_ms":6265},{"model":"gpt-5.6-luna","runs":6,"avg_usd":0.000921,"avg_tokens_in":93,"avg_tokens_out":176,"avg_latency_ms":4586},{"model":"claude-sonnet-5","runs":13,"avg_usd":0.001003,"avg_tokens_in":26,"avg_tokens_out":116,"avg_latency_ms":14127},{"model":"claude-opus-4-8","runs":13,"avg_usd":0.002319,"avg_tokens_in":27,"avg_tokens_out":111,"avg_latency_ms":17257},{"model":"Kimi-K3","runs":12,"avg_usd":0.00256,"avg_tokens_in":80,"avg_tokens_out":197,"avg_latency_ms":4322},{"model":"gpt-5.5","runs":3,"avg_usd":0.003168,"avg_tokens_in":54,"avg_tokens_out":123,"avg_latency_ms":8967},{"model":"claude-fable-5","runs":12,"avg_usd":0.0041,"avg_tokens_in":25,"avg_tokens_out":98,"avg_latency_ms":12168}],"cheapest":"deepseek-v4-flash","spread":39.4},{"task":"summarize","models":[{"model":"deepseek-v4-flash","runs":13,"avg_usd":0.000197,"avg_tokens_in":178,"avg_tokens_out":189,"avg_latency_ms":3893},{"model":"gemini-3.5-flash","runs":3,"avg_usd":0.001092,"avg_tokens_in":176,"avg_tokens_out":122,"avg_latency_ms":6575},{"model":"GLM5.2","runs":13,"avg_usd":0.001612,"avg_tokens_in":182,"avg_tokens_out":400,"avg_latency_ms":7999},{"model":"claude-sonnet-5","runs":12,"avg_usd":0.001754,"avg_tokens_in":231,"avg_tokens_out":167,"avg_latency_ms":19078},{"model":"gpt-5.6-luna","runs":6,"avg_usd":0.001894,"avg_tokens_in":242,"avg_tokens_out":354,"avg_latency_ms":7323},{"model":"claude-opus-4-8","runs":13,"avg_usd":0.004432,"avg_tokens_in":233,"avg_tokens_out":175,"avg_latency_ms":22452},{"model":"Kimi-K3","runs":12,"avg_usd":0.004843,"avg_tokens_in":229,"avg_tokens_out":358,"avg_latency_ms":6396},{"model":"gpt-5.5","runs":3,"avg_usd":0.005964,"avg_tokens_in":203,"avg_tokens_out":215,"avg_latency_ms":10169},{"model":"claude-fable-5","runs":10,"avg_usd":0.008622,"avg_tokens_in":230,"avg_tokens_out":170,"avg_latency_ms":9442}],"cheapest":"deepseek-v4-flash","spread":43.8},{"task":"structured_json","models":[{"model":"deepseek-v4-flash","runs":13,"avg_usd":0.000047,"avg_tokens_in":55,"avg_tokens_out":39,"avg_latency_ms":2270},{"model":"gemini-3.5-flash","runs":2,"avg_usd":0.000302,"avg_tokens_in":54,"avg_tokens_out":33,"avg_latency_ms":5496},{"model":"claude-sonnet-5","runs":12,"avg_usd":0.000346,"avg_tokens_in":68,"avg_tokens_out":29,"avg_latency_ms":13828},{"model":"gpt-5.6-luna","runs":6,"avg_usd":0.000588,"avg_tokens_in":122,"avg_tokens_out":102,"avg_latency_ms":3883},{"model":"claude-opus-4-8","runs":12,"avg_usd":0.000821,"avg_tokens_in":71,"avg_tokens_out":27,"avg_latency_ms":14098},{"model":"GLM5.2","runs":13,"avg_usd":0.001089,"avg_tokens_in":62,"avg_tokens_out":290,"avg_latency_ms":5389},{"model":"claude-fable-5","runs":12,"avg_usd":0.00155,"avg_tokens_in":67,"avg_tokens_out":25,"avg_latency_ms":9138},{"model":"Kimi-K3","runs":12,"avg_usd":0.00159,"avg_tokens_in":109,"avg_tokens_out":111,"avg_latency_ms":3075},{"model":"gpt-5.5","runs":2,"avg_usd":0.002024,"avg_tokens_in":56,"avg_tokens_out":75,"avg_latency_ms":7042}],"cheapest":"deepseek-v4-flash","spread":43.1}],"total_runs":262,"excluded_preamble_runs":44,"median_spread":43.1,"preamble_channels":[{"model":"gemini-3.5-flash","hit_rate":0.53,"runs":30,"avg_usd_when_hit":0.005985,"avg_usd_when_clean":0.000679,"extra_usd_per_hit":0.005307},{"model":"gpt-5.5","hit_rate":0.72,"runs":29,"avg_usd_when_hit":0.01967,"avg_usd_when_clean":0.00393,"extra_usd_per_hit":0.015739},{"model":"gpt-5.6-luna","hit_rate":0.28,"runs":25,"avg_usd_when_hit":0.004142,"avg_usd_when_clean":0.001134,"extra_usd_per_hit":0.003007}]},"production_mixed":{"window_days":30,"measured_at":"2026-08-17T05:13:30.725Z","method":"Derived from actual account billing on real production traffic — not vendor list prices.","caveat":"MIXED WORKLOAD. Each model ran different prompts, so these averages are NOT directly comparable across models — the difference includes task difficulty, not just the model. Use this to see what a call really costs in practice; use the same-prompt benchmark at /costs (standard_bench) when choosing a model. Samples under 10 calls are indicative only.","models":[{"model":"deepseek-v4-flash","calls":615,"total_usd":0.4227,"avg_usd":0.000687,"avg_tokens_in":658,"avg_tokens_out":520,"sample_confidence":"good"},{"model":"gpt-5.4-mini","calls":1,"total_usd":0.0028,"avg_usd":0.002752,"avg_tokens_in":4490,"avg_tokens_out":16,"sample_confidence":"low"},{"model":"claude-sonnet-5","calls":4,"total_usd":0.0156,"avg_usd":0.003901,"avg_tokens_in":775,"avg_tokens_out":323,"sample_confidence":"low"},{"model":"gemini-3.5-flash","calls":20,"total_usd":0.0942,"avg_usd":0.004712,"avg_tokens_in":2222,"avg_tokens_out":284,"sample_confidence":"fair"},{"model":"GLM5.2","calls":91,"total_usd":0.4545,"avg_usd":0.004995,"avg_tokens_in":1090,"avg_tokens_out":1154,"sample_confidence":"good"},{"model":"Kimi-K3-codex","calls":2,"total_usd":0.0184,"avg_usd":0.009177,"avg_tokens_in":151,"avg_tokens_out":637,"sample_confidence":"low"},{"model":"gpt-5.6-luna","calls":35,"total_usd":0.3238,"avg_usd":0.00925,"avg_tokens_in":3735,"avg_tokens_out":1305,"sample_confidence":"good"},{"model":"Kimi-K3","calls":2,"total_usd":0.0281,"avg_usd":0.01405,"avg_tokens_in":151,"avg_tokens_out":1049,"sample_confidence":"low"},{"model":"toptok-image","calls":8,"total_usd":0.8,"avg_usd":0.1,"avg_tokens_in":0,"avg_tokens_out":0,"sample_confidence":"low"}],"total_calls":778,"cheapest_model":{"id":"deepseek-v4-flash","avg_usd_per_call":0.000687},"spread_mixed_workload":145.6},"license":"CC BY 4.0","cite_as":"AI NetCafe real model cost dataset, https://ainetcafe.com/costs","powered_by":"AI NetCafé (ainetcafe.com) — open-source AI apps hosted ready to run, routed through AllRouter","your_own_key":"https://allrouter.ai/register?aff=qjpC&utm_source=tryplatform&utm_campaign=aiwangba&utm_medium=mcp&utm_content=attrib&lng=en","workspace":{"token":"ws_94bd5e8527395ed2","keep_this":"把 MCP 地址换成 https://ainetcafe.com/mcp?w=ws_94bd5e8527395ed2(或每次带请求头 X-Workspace: ws_94bd5e8527395ed2)。","why":"带着它回来,你记下的东西和造出的应用就跨会话保留;不带则每次都是新的匿名身份。","url":"https://ainetcafe.com/w/ws_94bd5e8527395ed2"},"free_quota_remaining":{"calls":6,"usd":0.02},"next_step":{"hint":"Worth keeping: remember() stores this conclusion against your key or workspace, and recall() brings it back in any later session or on another machine — so the next agent does not redo this work.","tool":"remember"},"related_tool":"Same question, every model, measured side by side: /t/compare_models?prompt=..."}