stackoverflow.com
robots.txt
Robots Exclusion Standard data for stackoverflow.com
Resource Scan
Scan Details
| Site Domain | stackoverflow.com |
| Base Domain | stackoverflow.com |
| Scan Status | Ok |
| Last Scan | 2024-05-28T18:53:25+00:00 |
| Next Scan | 2024-06-04T18:53:25+00:00 |
Last Scan
| Scanned | 2024-05-28T18:53:25+00:00 |
| URL | https://stackoverflow.com/robots.txt |
| Domain IPs | 104.18.32.7, 172.64.155.249 |
| Response IP | 104.18.32.7 |
| Found | Yes |
| Hash | f4bdbd964a60344895d9d26edc6aa3a1fdd2972b09704c51245bfc64d6985130 |
| SimHash | 1c82c1978afd |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /posts/ |
| Disallow | /posts? |
| Disallow | /amzn/click/ |
| Disallow | /questions/ask/ |
| Disallow | /questions/ask? |
| Disallow | /search/ |
| Disallow | /search? |
| Disallow | /feeds/ |
| Disallow | /feeds? |
| Disallow | /users/login/ |
| Disallow | /users/login? |
| Disallow | /users/logout/ |
| Disallow | /users/logout? |
| Disallow | /users/filter/ |
| Disallow | /users/filter? |
| Disallow | /users/signup |
| Disallow | /users/signup/ |
| Disallow | /users/signup? |
| Disallow | /users/authenticate/ |
| Disallow | /users/authenticate? |
| Disallow | /users/oauth/* |
| Disallow | /users/flag-summary/ |
| Disallow | /users/flair/ |
| Disallow | /users/flair? |
| Disallow | /users/activity/ |
| Disallow | /users/activity/? |
| Disallow | /users/stats/ |
| Disallow | /users/*?tab=accounts |
| Disallow | /users/*?tab=activity |
| Disallow | /users/rep/show |
| Disallow | /users/rep/show? |
| Disallow | /unanswered/ |
| Disallow | /unanswered? |
| Disallow | /u/ |
| Disallow | /messages/ |
| Disallow | /api/* |
| Disallow | /review/* |
| Disallow | /*/ivc/* |
| Disallow | /*?lastactivity |
| Disallow | /users/login/global/request/ |
| Disallow | /users/login/global/request? |
| Disallow | /questions/*answertab%3D* |
| Disallow | /questions/tagged/*%2B* |
| Disallow | /questions/tagged/*%20* |
| Disallow | /questions/*/answer/submit |
| Disallow | /tags/*%2B* |
| Disallow | /tags/*%20* |
| Disallow | /suggested-edits/ |
| Disallow | /suggested-edits? |
| Disallow | /ajax/ |
| Disallow | /plugins/ |
| Disallow | /error |
| Disallow | /gps/* |
| Disallow | /10m |
| Disallow | /jobs/cv/sign-up-and-create |
| Disallow | /jobs/n/* |
| Disallow | /jobs/a/* |
| Disallow | /jobs/apply/* |
| Disallow | /jobs/companies/n/* |
| Disallow | /jobs/companies/a/* |
| Disallow | /jobs/*/more-jobs-count |
| Disallow | /jobs/email-job |
| Disallow | /emails/* |
| Disallow | /_/* |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://stackoverflow.com/sitemap.xml |
Warnings
- 2 invalid lines.