Gemini Articles | Signals Blog

Abstract catalog agent benchmark with product tiles, search paths, validation checks, and evaluated outcomes

Gemini 3.5 Flash-Lite lost to 3.1 Flash-Lite, and more thinking didn't help

We benchmarked Gemini 3.5 Flash-Lite against Gemini 3.1 Flash-Lite and Gemini 3 Flash Preview on an e-commerce catalog agent. The newer model cost more and passed fewer tasks end to end.

July 23, 2026 • 8 min read

Ilya Valmianski

AI engineering e-commerce Gemini