Preventing Slow E-Commerce Search When LLM Query Rewrites Move Into the Request Path
Design an e-commerce search flow that uses LLMs for query understanding without making every request wait on them. Build offline enrichment, hybrid retrieval, tiered caching, fallback routing, ranking, and quality gates for relevance and latency.