bikerhound.com
robots.txt
Robots Exclusion Standard data for bikerhound.com
Resource Scan
Scan Details
Site Domain | bikerhound.com |
Base Domain | bikerhound.com |
Scan Status | Ok |
Last Scan | 2024-10-20T22:48:14+00:00 |
Next Scan | 2024-10-27T22:48:14+00:00 |
Last Scan
Scanned | 2024-10-20T22:48:14+00:00 |
URL | https://bikerhound.com/robots.txt |
Domain IPs | 104.152.168.40 |
Response IP | 104.152.168.40 |
Found | Yes |
Hash | 2922ff1db0a6662ec4f93e3fb64c209f5ba165e7268bf0b5fc0e5d7680fd9475 |
SimHash | 6d06c4569381 |
Groups
*
Rule | Path |
---|---|
Disallow | /*PHPSESSID |
Allow | /$ |
Allow | /*board |
Allow | /*topic |
Allow | /*forum$ |
Allow | /*page%3Dpage* |
Allow | /*forum$ |
Allow | /*page%3D* |
Allow | /*.xml |
Allow | /*.css$ |
Allow | /*.js$ |
Allow | /*.png$ |
Allow | /*.jpg$ |
Allow | /*.gif$ |
Allow | /*sitemap |
Other Records
Field | Value |
---|---|
sitemap | https://bikerhound.com/sitemap.xml |