hardwarerecs.stackexchange.com
robots.txt
Robots Exclusion Standard data for hardwarerecs.stackexchange.com
Resource Scan
Scan Details
Site Domain | hardwarerecs.stackexchange.com |
Base Domain | stackexchange.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-08-20T09:29:10+00:00 |
Next Scan | 2024-10-19T09:29:10+00:00 |
Last Successful Scan
Scanned | 2024-06-15T09:28:22+00:00 |
URL | https://hardwarerecs.stackexchange.com/robots.txt |
Domain IPs | 104.18.43.226, 172.64.144.30 |
Response IP | 172.64.144.30 |
Found | Yes |
Hash | e199b1481bcd081b18e35b57b90554818b153caef8d84dc525628f88d6e1da17 |
SimHash | 1c82c1879aff |
Groups
*
Rule | Path |
---|---|
Disallow | /posts/ |
Disallow | /posts? |
Disallow | /amzn/click/ |
Disallow | /questions/ask/ |
Disallow | /questions/ask? |
Disallow | /search/ |
Disallow | /search? |
Disallow | /feeds/ |
Disallow | /feeds? |
Disallow | /users/login/ |
Disallow | /users/login? |
Disallow | /users/logout/ |
Disallow | /users/logout? |
Disallow | /users/filter/ |
Disallow | /users/filter? |
Disallow | /users/signup |
Disallow | /users/signup/ |
Disallow | /users/signup? |
Disallow | /users/authenticate/ |
Disallow | /users/authenticate? |
Disallow | /users/oauth/* |
Disallow | /users/flag-summary/ |
Disallow | /users/flair/ |
Disallow | /users/flair? |
Disallow | /users/activity/ |
Disallow | /users/activity/? |
Disallow | /users/stats/ |
Disallow | /users/*?tab=accounts |
Disallow | /users/*?tab=activity |
Disallow | /users/rep/show |
Disallow | /users/rep/show? |
Disallow | /unanswered/ |
Disallow | /unanswered? |
Disallow | /u/ |
Disallow | /messages/ |
Disallow | /api/* |
Disallow | /review/* |
Disallow | /*/ivc/* |
Disallow | /*?lastactivity |
Disallow | /users/login/global/request/ |
Disallow | /users/login/global/request? |
Disallow | /questions/*answertab%3D* |
Disallow | /questions/tagged/*%2B* |
Disallow | /questions/tagged/*%20* |
Disallow | /questions/*/answer/submit |
Disallow | /tags/*%2B* |
Disallow | /tags/*%20* |
Disallow | /suggested-edits/ |
Disallow | /suggested-edits? |
Disallow | /ajax/ |
Disallow | /plugins/ |
Disallow | /error |
Disallow | /gps/* |
Disallow | /10m |
Disallow | /jobs/cv/sign-up-and-create |
Disallow | /jobs/n/* |
Disallow | /jobs/a/* |
Disallow | /jobs/apply/* |
Disallow | /jobs/companies/n/* |
Disallow | /jobs/companies/a/* |
Disallow | /jobs/*/more-jobs-count |
Disallow | /jobs/email-job |
Disallow | /emails/* |
Disallow | /_/* |
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://hardwarerecs.stackexchange.com/sitemap.xml |
Warnings
- 2 invalid lines.