dlweb.co.za
robots.txt

Robots Exclusion Standard data for dlweb.co.za

Resource Scan

Scan Details

Site Domain dlweb.co.za
Base Domain dlweb.co.za
Scan Status Ok
Last Scan2025-10-20T08:53:22+00:00
Next Scan 2025-11-19T08:53:22+00:00

Last Scan

Scanned2025-10-20T08:53:22+00:00
URL https://dlweb.co.za/robots.txt
Redirect https://www.dlweb.co.za/robots.txt
Redirect Domain www.dlweb.co.za
Redirect Base dlweb.co.za
Domain IPs 169.239.217.23
Redirect IPs 169.239.217.23
Response IP 169.239.217.23
Found Yes
Hash 05fcb62aac15455ca6f1b86c7a428a50be11c46184dffb8ffca11e3d7e5f6e2b
SimHash 61010840cf92

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.dlweb.co.za/wp-sitemap.xml