thecuriousonlooker.com
robots.txt

Robots Exclusion Standard data for thecuriousonlooker.com

Resource Scan

Scan Details

Site Domain thecuriousonlooker.com
Base Domain thecuriousonlooker.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer redirected incorrectly.
Last Scan2025-09-01T14:09:18+00:00
Next Scan 2025-09-08T14:09:18+00:00

Last Successful Scan

Scanned2025-08-17T11:16:53+00:00
URL https://thecuriousonlooker.com/robots.txt
Redirect https://www.thecuriousonlooker.com/robots.txt
Redirect Domain www.thecuriousonlooker.com
Redirect Base thecuriousonlooker.com
Domain IPs 2406:da18:9d0:143f:2124:4e9c:36a9:d9de, 52.221.42.138
Redirect IPs 104.21.34.197, 172.67.164.119, 2606:4700:3031::6815:22c5, 2606:4700:3033::ac43:a477
Response IP 172.67.164.119
Found Yes
Hash a6ecac95fb6e94a4d59c9e9856d03edc4ab5194c3c0365cd97c1753583e64751
SimHash 490188000db2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.thecuriousonlooker.com/wp-sitemap.xml