meta.superuser.com
robots.txt
Robots Exclusion Standard data for meta.superuser.com
Resource Scan
Scan Details
| Site Domain | meta.superuser.com |
| Base Domain | superuser.com |
| Scan Status | Ok |
| Last Scan | 2024-10-21T12:22:06+00:00 |
| Next Scan | 2024-11-20T12:22:06+00:00 |
Last Scan
| Scanned | 2024-10-21T12:22:06+00:00 |
| URL | https://meta.superuser.com/robots.txt |
| Domain IPs | 104.18.43.79, 172.64.144.177 |
| Response IP | 104.18.43.79 |
| Found | Yes |
| Hash | 67af83bbaf4a7e4ed741ad0a4b02e559feca6c6028a49cb6abe7dd3855f4cbe7 |
| SimHash | 5c82c995aeec |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /posts/ |
| Disallow | /posts? |
| Disallow | /amzn/click/ |
| Disallow | /questions/ask/ |
| Disallow | /questions/ask? |
| Disallow | /search/ |
| Disallow | /search? |
| Disallow | /feeds/ |
| Disallow | /feeds? |
| Disallow | /users/login/ |
| Disallow | /users/login? |
| Disallow | /users/logout/ |
| Disallow | /users/logout? |
| Disallow | /users/filter/ |
| Disallow | /users/filter? |
| Disallow | /users/signup |
| Disallow | /users/signup/ |
| Disallow | /users/signup? |
| Disallow | /users/authenticate/ |
| Disallow | /users/authenticate? |
| Disallow | /users/oauth/* |
| Disallow | /users/flag-summary/ |
| Disallow | /users/flair/ |
| Disallow | /users/flair? |
| Disallow | /users/activity/ |
| Disallow | /users/activity/? |
| Disallow | /users/stats/ |
| Disallow | /users/*?tab=accounts |
| Disallow | /users/*?tab=activity |
| Disallow | /users/rep/show |
| Disallow | /users/rep/show? |
| Disallow | /unanswered/ |
| Disallow | /unanswered? |
| Disallow | /u/ |
| Disallow | /messages/ |
| Disallow | /api/* |
| Disallow | /review/* |
| Disallow | /*/ivc/* |
| Disallow | /*?lastactivity |
| Disallow | /users/login/global/request/ |
| Disallow | /users/login/global/request? |
| Disallow | /questions/*answertab%3D* |
| Disallow | /questions/tagged/*%2B* |
| Disallow | /questions/tagged/*%20* |
| Disallow | /questions/*/answer/submit |
| Disallow | /tags/*%2B* |
| Disallow | /tags/*%20* |
| Disallow | /suggested-edits/ |
| Disallow | /suggested-edits? |
| Disallow | /ajax/ |
| Disallow | /plugins/ |
| Disallow | /error |
| Disallow | /gps/* |
| Disallow | /10m |
| Disallow | /jobs/cv/sign-up-and-create |
| Disallow | /jobs/n/* |
| Disallow | /jobs/a/* |
| Disallow | /jobs/apply/* |
| Disallow | /jobs/companies/n/* |
| Disallow | /jobs/companies/a/* |
| Disallow | /jobs/*/more-jobs-count |
| Disallow | /jobs/email-job |
| Disallow | /emails/* |
| Disallow | /_/* |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://meta.superuser.com/sitemap.xml |
Warnings
- 2 invalid lines.