Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
arbuge
on March 17, 2014
|
parent
|
context
|
favorite
| on:
Trolling the search engines
You need to update those crawlers to enforce some hard limits on crawl depth, methinks, especially for low pagerank domains (if there's some easy way to estimate pagerank, i.e.).
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: