pagearrow.com
robots.txt

Robots Exclusion Standard data for pagearrow.com

Resource Scan

Scan Details

Site Domain pagearrow.com
Base Domain pagearrow.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-16T15:55:24+00:00
Next Scan 2025-09-23T15:55:24+00:00

Last Successful Scan

Scanned2025-08-16T14:04:16+00:00
URL https://pagearrow.com/robots.txt
Domain IPs 104.21.75.90, 172.67.217.161, 2606:4700:3034::6815:4b5a, 2606:4700:3034::ac43:d9a1
Response IP 104.21.75.90
Found Yes
Hash 3f800a9c44bab53b4b77a84014c4b3f90648da16cdb78b074129923e93b01aa9
SimHash 4101cc4089b3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://pagearrow.com/wp-sitemap.xml