thedalweb.com
robots.txt

Robots Exclusion Standard data for thedalweb.com

Resource Scan

Scan Details

Site Domain thedalweb.com
Base Domain thedalweb.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-11-18T12:53:32+00:00
Next Scan 2025-12-02T12:53:32+00:00

Last Successful Scan

Scanned2025-11-02T21:55:32+00:00
URL https://thedalweb.com/robots.txt
Domain IPs 195.179.238.68, 2a02:4780:1:1162:0:15d2:7244:3
Response IP 195.179.238.68
Found Yes
Hash 236018bbcd391803ff1d49d2ad841cdd884dc522ad6d047258853f4c1233bb6e
SimHash 6100d8624bb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.thedalweb.com/sitemap_index.xml
sitemap https://www.thedalweb.com/page-sitemap.xml