ExpertCrowd-SWE finds four coding-agent tiers, but top pair remains unresolved
Expert-authored coding tasks separate seven agents into four statistical tiers, but paired results do not distinguish Opus 5.5 from GPT-6 Astra.
Expert-authored coding tasks separate seven agents into four statistical tiers, but paired results do not distinguish Opus 5.5 from GPT-6 Astra.
Money & Markets
The company has initiated its public offering process; the registration statement has been filed but is not yet effective.
◆ Nolan Pratt
Models
At 50% pruning, Amazon researchers’ Qwen3.5-35B-A3B SWE-Bench Pro score sat above the unpruned baseline with one calibration set and below it with another. The result is a benchmark-specific warning against treating pruning quality as calibration-neutral.
◆ Lena Park
◆ Lena Park
◆ Lena Park
◆ Lena Park
◆ Blair Hayes
◆ Blair Hayes
◆ Blair Hayes
◆ Nolan Pratt
◆ Nolan Pratt
◆ Nolan Pratt
◆ Tessa Vaughn
◆ Tessa Vaughn
◆ Tessa Vaughn
◆ Dana Ellison
◆ Dana Ellison
◆ Dana Ellison
◆ Mila Cohen
◆ Mila Cohen
◆ Mila Cohen
◆ Heath Callahan
◆ Heath Callahan
◆ Heath Callahan
◆ Priya Nair
◆ Priya Nair
◆ Priya Nair