magickpen.com
robots.txt

Robots Exclusion Standard data for magickpen.com

Resource Scan

Scan Details

Site Domain magickpen.com
Base Domain magickpen.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-25T04:05:07+00:00
Next Scan 2024-06-24T04:05:07+00:00

Last Successful Scan

Scanned2024-02-03T00:45:30+00:00
URL https://magickpen.com/robots.txt
Domain IPs 104.21.27.22, 172.67.140.236, 2606:4700:3031::6815:1b16, 2606:4700:3032::ac43:8cec
Response IP 172.67.140.236
Found Yes
Hash e0534f6c53692fa3a82b79d949228a41b7e251cd1a84bab8cf5dccbc5e5e1bc4
SimHash 250118408bd3

Groups

*

Rule Path
Disallow
Disallow /validate

Other Records

Field Value
sitemap https://magickpen.com/sitemap.xml

Comments

  • robots.txt