twpc.co.za
robots.txt

Robots Exclusion Standard data for twpc.co.za

Resource Scan

Scan Details

Site Domain twpc.co.za
Base Domain twpc.co.za
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-08-31T13:01:21+00:00
Next Scan 2025-11-29T13:01:21+00:00

Last Successful Scan

Scanned2025-02-03T10:23:07+00:00
URL https://twpc.co.za/robots.txt
Redirect https://www.muhtwa.com/robots.txt
Redirect Domain www.muhtwa.com
Redirect Base muhtwa.com
Domain IPs 104.21.32.168, 172.67.153.19, 2606:4700:3033::6815:20a8, 2606:4700:3033::ac43:9913
Redirect IPs 138.201.127.177
Response IP 138.201.127.177
Found Yes
Hash 682a4a2ef860f86e1be28a0f3cc3768c0a53658d0cbe0e46cf343e1daeb41f85
SimHash 6101dc4009b3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.muhtwa.com/wp-sitemap.xml