fatboysoffroad.com
robots.txt
Robots Exclusion Standard data for fatboysoffroad.com
Resource Scan
Scan Details
Site Domain | fatboysoffroad.com |
Base Domain | fatboysoffroad.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a server error. |
Last Scan | 2024-10-13T10:43:23+00:00 |
Next Scan | 2025-01-11T10:43:23+00:00 |
Last Successful Scan
Scanned | 2024-04-03T10:07:20+00:00 |
URL | https://fatboysoffroad.com/robots.txt |
Domain IPs | 13.250.129.152, 2406:da18:9d0:143e:8e74:1b1a:98b9:2813, 2406:da18:9d0:143f:29e7:ae24:cfea:e9bb, 54.151.156.30 |
Response IP | 13.250.129.152 |
Found | Yes |
Hash | 9251052407f0b2e0d24c3451cbf8378874fe606fbc8dc27741c1c0a8aea792c6 |
SimHash | 41000c22cb92 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /*/feed/ |
Disallow | /*?amp= |
Disallow | /*?utm_source= |
Allow | /wp-admin/admin-ajax.php |
Other Records
Field | Value |
---|---|
sitemap | https://fatboysoffroad.com/sitemap_index.xml |