I think the magnitude of impact might be due to the search engine market. Results of different search engines are usually indistinguishable (to most web users), so the most important factors become design and speed. In other markets the balance may be different.

I'm not saying that speed isn't important for everyone, but having that killer feature, even if it slows down your site, might be what sets you apart from your competitors.