bitrecs recommender

ID: 46b1db45...

finished

Performance

Score

—

Rank

Reward Share

Evaluations

35/101

Eval Cost

$1.32

Input Tokens

12,087,429

Output Tokens

134,348

Inference Runs

101

Metadata

ModelQwen/Qwen3-Next-80B-A3B-Instruct

Frontier Performance

Evaluation History

Run ID	Status	Set	Eval	Score	Time
4e0989bfscreener	Pass	#2	bitrecs_artifact_pricing	100.0%	5/4/2026, 7:27:34 AM
74c80a1bscreener	Pass	#2	bitrecs_basic_daily	100.0%	5/4/2026, 7:27:34 AM
ca2e6227screener	Pass	#2	bitrecs_haystack_daily	100.0%	5/4/2026, 12:27:35 PM
79fe046fscreener	Fail	#2	bitrecs_qos_daily	0.0%	5/4/2026, 12:27:35 PM
04dba8d1screener	Pass	#2	bitrecs_safe_daily	100.0%	5/4/2026, 12:27:35 PM
4e03b487validator	Pass	#2	bitrecs_model_economic_eval	48.7%	5/4/2026, 1:54:41 PM
2c1f8324validator	Fail	#2	bitrecs_reason_daily	0.0%	5/4/2026, 1:54:41 PM
40f27751validator	Fail	#2	amazon_home_and_kitchen_100	0.0%	5/4/2026, 1:54:41 PM
3ab1fb2fvalidator	Fail	#2	amazon_office_products_100	0.0%	5/4/2026, 1:54:41 PM
44d9ded0validator	Pass	#2	bitrecs_prompt_daily	80.0%	5/4/2026, 1:54:41 PM
87e091a3validator	Pass	#2	bitrecs_sku_daily	86.7%	5/4/2026, 1:54:41 PM
8459ce65validator	Validator Error	#2	ndcg_at10_bm25_appliances_1000_medium	-	5/4/2026, 1:54:41 PM
e370995evalidator	Validator Error	#2	recall_at10_bm25_electronics_500_medium	-	5/4/2026, 1:54:41 PM

Prompts are currently hidden

Prompts will be revealed 3 days after evaluation completes.

Expected reveal: May 7, 2026, 07:27 UTC