rockanddirt.com
robots.txt

Robots Exclusion Standard data for rockanddirt.com

Resource Scan

Scan Details

Site Domain rockanddirt.com
Base Domain rockanddirt.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-10T01:45:31+00:00
Next Scan 2025-01-08T01:45:31+00:00

Last Successful Scan

Scanned2023-06-18T09:18:13+00:00
URL https://rockanddirt.com/robots.txt
Redirect https://www.rockanddirt.com/robots.txt
Redirect Domain www.rockanddirt.com
Redirect Base rockanddirt.com
Domain IPs 3.140.231.235, 3.143.155.166
Redirect IPs 3.140.231.235, 3.143.155.166
Response IP 3.143.155.166
Found Yes
Hash 661fdc219783bfd6be0449f50664ef730b1133d40e608ace73bd365a26659776
SimHash 6b090a1c2b92

Groups

*

Rule Path
Disallow /search/*%2525

Other Records

Field Value
sitemap https://www.rockanddirt.com/sitemaps/sitemap_index.xml
sitemap https://espanol.rockanddirt.com/sitemaps/espanol_sitemap_index.xml
sitemap https://www.rockanddirt.com/sitemaps/newESP-sitemapindex.xml
sitemap https://www.rockanddirt.com/sitemaps/new-sitemapindex.xml