premierwanderlust.com
robots.txt

Robots Exclusion Standard data for premierwanderlust.com

Resource Scan

Scan Details

Site Domain premierwanderlust.com
Base Domain premierwanderlust.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2026-01-10T17:51:21+00:00
Next Scan 2026-04-10T17:51:21+00:00

Last Successful Scan

Scanned2024-12-17T12:38:50+00:00
URL https://premierwanderlust.com/robots.txt
Domain IPs 162.241.62.33
Response IP 162.241.62.33
Found Yes
Hash 52648c0270933136c04ac1fa9aa4add00bc0192fb81a4824f17b60d8887afa41
SimHash 6f1cdf90c6b3

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://premierwanderlust.com/sitemap.xml
sitemap https://premierwanderlust.com/sitemapindex.xml
sitemap https://premierwanderlust.com/sitemapmobileindex.xml
sitemap https://premierwanderlust.com/sitemap-hot-2996997.xml
sitemap https://premierwanderlust.com/sitemap-hot-2994997.xml
sitemap https://premierwanderlust.com/sitemap-hot-2992997.xml
sitemap https://premierwanderlust.com/sitemap-hot-2990997.xml
sitemap https://premierwanderlust.com/sitemap-hot-2988997.xml
sitemap https://premierwanderlust.com/sitemap-hot-2986997.xml
sitemap https://premierwanderlust.com/sitemap-hot-2984997.xml
sitemap https://premierwanderlust.com/sitemap-hot-2982997.xml
sitemap https://premierwanderlust.com/sitemap-hot-2980997.xml
sitemap https://premierwanderlust.com/sitemap-hot-2978997.xml
sitemap https://premierwanderlust.com/sitemap-hot-2976997.xml
sitemap https://premierwanderlust.com/sitemap-hot-2974997.xml
sitemap https://premierwanderlust.com/sitemap-hot-2972997.xml
sitemap https://premierwanderlust.com/sitemap-hot-2970997.xml
sitemap https://premierwanderlust.com/sitemap-hot-2968997.xml
sitemap https://premierwanderlust.com/sitemap-hot-2966997.xml