datascience.meta.stackexchange.com
robots.txt
Robots Exclusion Standard data for datascience.meta.stackexchange.com
Resource Scan
Scan Details
| Site Domain | datascience.meta.stackexchange.com |
| Base Domain | stackexchange.com |
| Scan Status | Ok |
| Last Scan | 2024-10-25T18:35:18+00:00 |
| Next Scan | 2024-11-24T18:35:18+00:00 |
Last Scan
| Scanned | 2024-10-25T18:35:18+00:00 |
| URL | https://datascience.meta.stackexchange.com/robots.txt |
| Domain IPs | 104.18.43.226, 172.64.144.30 |
| Response IP | 104.18.43.226 |
| Found | Yes |
| Hash | ae40b9bc1e5e5db12e87c75494b3a6cd584538776f60484ce88d463c5d9040f3 |
| SimHash | 5c82c995aeec |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /posts/ |
| Disallow | /posts? |
| Disallow | /amzn/click/ |
| Disallow | /questions/ask/ |
| Disallow | /questions/ask? |
| Disallow | /search/ |
| Disallow | /search? |
| Disallow | /feeds/ |
| Disallow | /feeds? |
| Disallow | /users/login/ |
| Disallow | /users/login? |
| Disallow | /users/logout/ |
| Disallow | /users/logout? |
| Disallow | /users/filter/ |
| Disallow | /users/filter? |
| Disallow | /users/signup |
| Disallow | /users/signup/ |
| Disallow | /users/signup? |
| Disallow | /users/authenticate/ |
| Disallow | /users/authenticate? |
| Disallow | /users/oauth/* |
| Disallow | /users/flag-summary/ |
| Disallow | /users/flair/ |
| Disallow | /users/flair? |
| Disallow | /users/activity/ |
| Disallow | /users/activity/? |
| Disallow | /users/stats/ |
| Disallow | /users/*?tab=accounts |
| Disallow | /users/*?tab=activity |
| Disallow | /users/rep/show |
| Disallow | /users/rep/show? |
| Disallow | /unanswered/ |
| Disallow | /unanswered? |
| Disallow | /u/ |
| Disallow | /messages/ |
| Disallow | /api/* |
| Disallow | /review/* |
| Disallow | /*/ivc/* |
| Disallow | /*?lastactivity |
| Disallow | /users/login/global/request/ |
| Disallow | /users/login/global/request? |
| Disallow | /questions/*answertab%3D* |
| Disallow | /questions/tagged/*%2B* |
| Disallow | /questions/tagged/*%20* |
| Disallow | /questions/*/answer/submit |
| Disallow | /tags/*%2B* |
| Disallow | /tags/*%20* |
| Disallow | /suggested-edits/ |
| Disallow | /suggested-edits? |
| Disallow | /ajax/ |
| Disallow | /plugins/ |
| Disallow | /error |
| Disallow | /gps/* |
| Disallow | /10m |
| Disallow | /jobs/cv/sign-up-and-create |
| Disallow | /jobs/n/* |
| Disallow | /jobs/a/* |
| Disallow | /jobs/apply/* |
| Disallow | /jobs/companies/n/* |
| Disallow | /jobs/companies/a/* |
| Disallow | /jobs/*/more-jobs-count |
| Disallow | /jobs/email-job |
| Disallow | /emails/* |
| Disallow | /_/* |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://datascience.meta.stackexchange.com/sitemap.xml |
Warnings
- 2 invalid lines.