newyorkfolk.com
robots.txt

Robots Exclusion Standard data for newyorkfolk.com

Resource Scan

Scan Details

Site Domain newyorkfolk.com
Base Domain newyorkfolk.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-01-20T07:24:44+00:00
Next Scan 2025-04-20T07:24:44+00:00

Last Successful Scan

Scanned2024-06-25T07:22:36+00:00
URL https://newyorkfolk.com/robots.txt
Domain IPs 104.21.86.93, 172.67.217.104, 2606:4700:3035::6815:565d, 2606:4700:3037::ac43:d968
Response IP 172.67.217.104
Found Yes
Hash beda7c77db072aa7a2334bdf076d530461f7bb4521201bbd304e0b6518d09d54
SimHash 410058400db3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://newyorkfolk.com/sitemap_index.xml