infinitedungeoncrawler.com
robots.txt

Robots Exclusion Standard data for infinitedungeoncrawler.com

Resource Scan

Scan Details

Site Domain infinitedungeoncrawler.com
Base Domain infinitedungeoncrawler.com
Scan Status Ok
Last Scan2025-05-24T15:56:27+00:00
Next Scan 2025-06-23T15:56:27+00:00

Last Scan

Scanned2025-05-24T15:56:27+00:00
URL https://infinitedungeoncrawler.com/robots.txt
Redirect https://www.infinitedungeoncrawler.com/robots.txt
Redirect Domain www.infinitedungeoncrawler.com
Redirect Base infinitedungeoncrawler.com
Domain IPs 66.33.201.140
Redirect IPs 66.33.201.140
Response IP 66.33.201.140
Found Yes
Hash 6179d915b1fa0e4896afab58d3972c0bc1c263b32d724360cf9906cacdf07f23
SimHash 6901dc00cd92

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.infinitedungeoncrawler.com/wp-sitemap.xml