Share what you know with millions of people
Focus is the best place to turn what you know into remarkable content
0
Why does Quora block smaller / startup search engines?
Events
- Lead Nurturing 202: The Next Generation May 31 @ 11 am PT
- The Tricks to Paid Media June 6 @ 11 am PT
- Display Advertising for Brand Awareness June 20 @ 11 am PT






3 Answers
They used to block everything but Google. My guess is that they are stretched pretty thin on technical resources and they don't need the site bogged down by every crawler in the world (not that most crawlers even acknowledge robots.txt, but tha'ts another story).
How do you know that Quora does this? Pardon my ignorance, but it's really surprising, although I'm sure there are reasons for their decision.
I guess I jumped on it pretty quickly. RRW just did a piece on it and didn't give any real reason Quora would want to block smaller search engines.
http://www.readwriteweb.com/hack/2011/01/quora-blocks-startup-search-en.php
If you want to check out the robots.txt file you can see who they have granted access to.
http://www.quora.com/robots.txt
Answer This Question