nycmytown.com
robots.txt

Robots Exclusion Standard data for nycmytown.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	nycmytown.com
Base Domain	nycmytown.com
Scan Status	Ok
Last Scan	2025-12-21T22:36:34+00:00
Next Scan	2026-01-20T22:36:34+00:00

Last Scan

Scanned	2025-12-21T22:36:34+00:00
URL	https://nycmytown.com/robots.txt
Domain IPs	104.21.82.213, 172.67.164.1, 2606:4700:3030::ac43:a401, 2606:4700:3032::6815:52d5
Response IP	172.67.164.1
Found	Yes
Hash	6af8649fc52e40022886854289a61c9c11d0fe50851e8d33f6433309ab77fb2c
SimHash	6a149d14c912

Groups

*

Rule	Path
Disallow	/wp-admin/
Allow	/wp-admin/admin-ajax.php
Disallow	/xmlrpc.php

Rule

Path

Disallow

/wp-admin/

Allow

/wp-admin/admin-ajax.php

Disallow

/xmlrpc.php

semrush

Rule	Path
Disallow	/pages/
Disallow	/page/
Disallow	/author/
Disallow	/tag/
Disallow	/2018/
Disallow	/2019/
Disallow	/2020/
Disallow	/2021/
Disallow	/2022/
Disallow	/2023/
Disallow	/2024/
Disallow	/2025/
Disallow	/2026/
Disallow	/2027/
Disallow	/2028/
Disallow	/2029/
Disallow	/2030/
Disallow	/2031/
Disallow	/2032/
Disallow	/2033/
Disallow	/2034/
Disallow	/2035/
Disallow	/2036/
Disallow	/2037/
Disallow	/2038/
Disallow	/2039/
Disallow	/2040/
Disallow	/date/

Rule

Path

Disallow

/pages/

Disallow

/page/

Disallow

/author/

Disallow

/tag/

Disallow

/2018/

Disallow

/2019/

Disallow

/2020/

Disallow

/2021/

Disallow

/2022/

Disallow

/2023/

Disallow

/2024/

Disallow

/2025/

Disallow

/2026/

Disallow

/2027/

Disallow

/2028/

Disallow

/2029/

Disallow

/2030/

Disallow

/2031/

Disallow

/2032/

Disallow

/2033/

Disallow

/2034/

Disallow

/2035/

Disallow

/2036/

Disallow

/2037/

Disallow

/2038/

Disallow

/2039/

Disallow

/2040/

Disallow

/date/

siteauditbot

Rule	Path
Disallow	/pages/
Disallow	/page/
Disallow	/author/
Disallow	/tag/
Disallow	/2018/
Disallow	/2019/
Disallow	/2020/
Disallow	/2021/
Disallow	/2022/
Disallow	/2023/
Disallow	/2024/
Disallow	/2025/
Disallow	/2026/
Disallow	/2027/
Disallow	/2028/
Disallow	/2029/
Disallow	/2030/
Disallow	/2031/
Disallow	/2032/
Disallow	/2033/
Disallow	/2034/
Disallow	/2035/
Disallow	/2036/
Disallow	/2037/
Disallow	/2038/
Disallow	/2039/
Disallow	/2040/
Disallow	/date/

Rule

Path

Disallow

/pages/

Disallow

/page/

Disallow

/author/

Disallow

/tag/

Disallow

/2018/

Disallow

/2019/

Disallow

/2020/

Disallow

/2021/

Disallow

/2022/

Disallow

/2023/

Disallow

/2024/

Disallow

/2025/

Disallow

/2026/

Disallow

/2027/

Disallow

/2028/

Disallow

/2029/

Disallow

/2030/

Disallow

/2031/

Disallow

/2032/

Disallow

/2033/

Disallow

/2034/

Disallow

/2035/

Disallow

/2036/

Disallow

/2037/

Disallow

/2038/

Disallow

/2039/

Disallow

/2040/

Disallow

/date/

semrushbot-ba

Rule	Path
Disallow	/pages/
Disallow	/page/
Disallow	/author/
Disallow	/tag/
Disallow	/2018/
Disallow	/2019/
Disallow	/2020/
Disallow	/2021/
Disallow	/2022/
Disallow	/2023/
Disallow	/2024/
Disallow	/2025/
Disallow	/2026/
Disallow	/2027/
Disallow	/2028/
Disallow	/2029/
Disallow	/2030/
Disallow	/2031/
Disallow	/2032/
Disallow	/2033/
Disallow	/2034/
Disallow	/2035/
Disallow	/2036/
Disallow	/2037/
Disallow	/2038/
Disallow	/2039/
Disallow	/2040/
Disallow	/date/

Rule

Path

Disallow

/pages/

Disallow

/page/

Disallow

/author/

Disallow

/tag/

Disallow

/2018/

Disallow

/2019/

Disallow

/2020/

Disallow

/2021/

Disallow

/2022/

Disallow

/2023/

Disallow

/2024/

Disallow

/2025/

Disallow

/2026/

Disallow

/2027/

Disallow

/2028/

Disallow

/2029/

Disallow

/2030/

Disallow

/2031/

Disallow

/2032/

Disallow

/2033/

Disallow

/2034/

Disallow

/2035/

Disallow

/2036/

Disallow

/2037/

Disallow

/2038/

Disallow

/2039/

Disallow

/2040/

Disallow

/date/

semrushbot-si

Rule	Path
Disallow	/pages/
Disallow	/page/
Disallow	/author/
Disallow	/tag/
Disallow	/2018/
Disallow	/2019/
Disallow	/2020/
Disallow	/2021/
Disallow	/2022/
Disallow	/2023/
Disallow	/2024/
Disallow	/2025/
Disallow	/2026/
Disallow	/2027/
Disallow	/2028/
Disallow	/2029/
Disallow	/2030/
Disallow	/2031/
Disallow	/2032/
Disallow	/2033/
Disallow	/2034/
Disallow	/2035/
Disallow	/2036/
Disallow	/2037/
Disallow	/2038/
Disallow	/2039/
Disallow	/2040/
Disallow	/date/

Rule

Path

Disallow

/pages/

Disallow

/page/

Disallow

/author/

Disallow

/tag/

Disallow

/2018/

Disallow

/2019/

Disallow

/2020/

Disallow

/2021/

Disallow

/2022/

Disallow

/2023/

Disallow

/2024/

Disallow

/2025/

Disallow

/2026/

Disallow

/2027/

Disallow

/2028/

Disallow

/2029/

Disallow

/2030/

Disallow

/2031/

Disallow

/2032/

Disallow

/2033/

Disallow

/2034/

Disallow

/2035/

Disallow

/2036/

Disallow

/2037/

Disallow

/2038/

Disallow

/2039/

Disallow

/2040/

Disallow

/date/

semrushbot-swa

Rule	Path
Disallow	/pages/
Disallow	/page/
Disallow	/author/
Disallow	/tag/
Disallow	/2018/
Disallow	/2019/
Disallow	/2020/
Disallow	/2021/
Disallow	/2022/
Disallow	/2023/
Disallow	/2024/
Disallow	/2025/
Disallow	/2026/
Disallow	/2027/
Disallow	/2028/
Disallow	/2029/
Disallow	/2030/
Disallow	/2031/
Disallow	/2032/
Disallow	/2033/
Disallow	/2034/
Disallow	/2035/
Disallow	/2036/
Disallow	/2037/
Disallow	/2038/
Disallow	/2039/
Disallow	/2040/
Disallow	/date/

Rule

Path

Disallow

/pages/

Disallow

/page/

Disallow

/author/

Disallow

/tag/

Disallow

/2018/

Disallow

/2019/

Disallow

/2020/

Disallow

/2021/

Disallow

/2022/

Disallow

/2023/

Disallow

/2024/

Disallow

/2025/

Disallow

/2026/

Disallow

/2027/

Disallow

/2028/

Disallow

/2029/

Disallow

/2030/

Disallow

/2031/

Disallow

/2032/

Disallow

/2033/

Disallow

/2034/

Disallow

/2035/

Disallow

/2036/

Disallow

/2037/

Disallow

/2038/

Disallow

/2039/

Disallow

/2040/

Disallow

/date/

semrushbot-ct

Rule	Path
Disallow	/pages/
Disallow	/page/
Disallow	/author/
Disallow	/tag/
Disallow	/2018/
Disallow	/2019/
Disallow	/2020/
Disallow	/2021/
Disallow	/2022/
Disallow	/2023/
Disallow	/2024/
Disallow	/2025/
Disallow	/2026/
Disallow	/2027/
Disallow	/2028/
Disallow	/2029/
Disallow	/2030/
Disallow	/2031/
Disallow	/2032/
Disallow	/2033/
Disallow	/2034/
Disallow	/2035/
Disallow	/2036/
Disallow	/2037/
Disallow	/2038/
Disallow	/2039/
Disallow	/2040/
Disallow	/date/

Rule

Path

Disallow

/pages/

Disallow

/page/

Disallow

/author/

Disallow

/tag/

Disallow

/2018/

Disallow

/2019/

Disallow

/2020/

Disallow

/2021/

Disallow

/2022/

Disallow

/2023/

Disallow

/2024/

Disallow

/2025/

Disallow

/2026/

Disallow

/2027/

Disallow

/2028/

Disallow

/2029/

Disallow

/2030/

Disallow

/2031/

Disallow

/2032/

Disallow

/2033/

Disallow

/2034/

Disallow

/2035/

Disallow

/2036/

Disallow

/2037/

Disallow

/2038/

Disallow

/2039/

Disallow

/2040/

Disallow

/date/

semrushbot-bm

Rule	Path
Disallow	/pages/
Disallow	/page/
Disallow	/author/
Disallow	/tag/
Disallow	/2018/
Disallow	/2019/
Disallow	/2020/
Disallow	/2021/
Disallow	/2022/
Disallow	/2023/
Disallow	/2024/
Disallow	/2025/
Disallow	/2026/
Disallow	/2027/
Disallow	/2028/
Disallow	/2029/
Disallow	/2030/
Disallow	/2031/
Disallow	/2032/
Disallow	/2033/
Disallow	/2034/
Disallow	/2035/
Disallow	/2036/
Disallow	/2037/
Disallow	/2038/
Disallow	/2039/
Disallow	/2040/
Disallow	/date/

Rule

Path

Disallow

/pages/

Disallow

/page/

Disallow

/author/

Disallow

/tag/

Disallow

/2018/

Disallow

/2019/

Disallow

/2020/

Disallow

/2021/

Disallow

/2022/

Disallow

/2023/

Disallow

/2024/

Disallow

/2025/

Disallow

/2026/

Disallow

/2027/

Disallow

/2028/

Disallow

/2029/

Disallow

/2030/

Disallow

/2031/

Disallow

/2032/

Disallow

/2033/

Disallow

/2034/

Disallow

/2035/

Disallow

/2036/

Disallow

/2037/

Disallow

/2038/

Disallow

/2039/

Disallow

/2040/

Disallow

/date/

splitsignalbot

Rule	Path
Disallow	/pages/
Disallow	/page/
Disallow	/author/
Disallow	/tag/
Disallow	/2018/
Disallow	/2019/
Disallow	/2020/
Disallow	/2021/
Disallow	/2022/
Disallow	/2023/
Disallow	/2024/
Disallow	/2025/
Disallow	/2026/
Disallow	/2027/
Disallow	/2028/
Disallow	/2029/
Disallow	/2030/
Disallow	/2031/
Disallow	/2032/
Disallow	/2033/
Disallow	/2034/
Disallow	/2035/
Disallow	/2036/
Disallow	/2037/
Disallow	/2038/
Disallow	/2039/
Disallow	/2040/
Disallow	/date/

Rule

Path

Disallow

/pages/

Disallow

/page/

Disallow

/author/

Disallow

/tag/

Disallow

/2018/

Disallow

/2019/

Disallow

/2020/

Disallow

/2021/

Disallow

/2022/

Disallow

/2023/

Disallow

/2024/

Disallow

/2025/

Disallow

/2026/

Disallow

/2027/

Disallow

/2028/

Disallow

/2029/

Disallow

/2030/

Disallow

/2031/

Disallow

/2032/

Disallow

/2033/

Disallow

/2034/

Disallow

/2035/

Disallow

/2036/

Disallow

/2037/

Disallow

/2038/

Disallow

/2039/

Disallow

/2040/

Disallow

/date/

semrushbot-coub

Rule	Path
Disallow	/pages/
Disallow	/page/
Disallow	/author/
Disallow	/tag/
Disallow	/2018/
Disallow	/2019/
Disallow	/2020/
Disallow	/2021/
Disallow	/2022/
Disallow	/2023/
Disallow	/2024/
Disallow	/2025/
Disallow	/2026/
Disallow	/2027/
Disallow	/2028/
Disallow	/2029/
Disallow	/2030/
Disallow	/2031/
Disallow	/2032/
Disallow	/2033/
Disallow	/2034/
Disallow	/2035/
Disallow	/2036/
Disallow	/2037/
Disallow	/2038/
Disallow	/2039/
Disallow	/2040/
Disallow	/date/

Rule

Path

Disallow

/pages/

Disallow

/page/

Disallow

/author/

Disallow

/tag/

Disallow

/2018/

Disallow

/2019/

Disallow

/2020/

Disallow

/2021/

Disallow

/2022/

Disallow

/2023/

Disallow

/2024/

Disallow

/2025/

Disallow

/2026/

Disallow

/2027/

Disallow

/2028/

Disallow

/2029/

Disallow

/2030/

Disallow

/2031/

Disallow

/2032/

Disallow

/2033/

Disallow

/2034/

Disallow

/2035/

Disallow

/2036/

Disallow

/2037/

Disallow

/2038/

Disallow

/2039/

Disallow

/2040/

Disallow

/date/

ahrefs

Rule	Path
Disallow	/pages/
Disallow	/page/
Disallow	/author/
Disallow	/tag/
Disallow	/2018/
Disallow	/2019/
Disallow	/2020/
Disallow	/2021/
Disallow	/2022/
Disallow	/2023/
Disallow	/2024/
Disallow	/2025/
Disallow	/2026/
Disallow	/2027/
Disallow	/2028/
Disallow	/2029/
Disallow	/2030/
Disallow	/2031/
Disallow	/2032/
Disallow	/2033/
Disallow	/2034/
Disallow	/2035/
Disallow	/2036/
Disallow	/2037/
Disallow	/2038/
Disallow	/2039/
Disallow	/2040/
Disallow	/date/

Rule

Path

Disallow

/pages/

Disallow

/page/

Disallow

/author/

Disallow

/tag/

Disallow

/2018/

Disallow

/2019/

Disallow

/2020/

Disallow

/2021/

Disallow

/2022/

Disallow

/2023/

Disallow

/2024/

Disallow

/2025/

Disallow

/2026/

Disallow

/2027/

Disallow

/2028/

Disallow

/2029/

Disallow

/2030/

Disallow

/2031/

Disallow

/2032/

Disallow

/2033/

Disallow

/2034/

Disallow

/2035/

Disallow

/2036/

Disallow

/2037/

Disallow

/2038/

Disallow

/2039/

Disallow

/2040/

Disallow

/date/

semrushbot

Rule	Path
Disallow	/pages/
Disallow	/page/
Disallow	/author/
Disallow	/tag/
Disallow	/2018/
Disallow	/2019/
Disallow	/2020/
Disallow	/2021/
Disallow	/2022/
Disallow	/2023/
Disallow	/2024/
Disallow	/2025/
Disallow	/2026/
Disallow	/2027/
Disallow	/2028/
Disallow	/2029/
Disallow	/2030/
Disallow	/2031/
Disallow	/2032/
Disallow	/2033/
Disallow	/2034/
Disallow	/2035/
Disallow	/2036/
Disallow	/2037/
Disallow	/2038/
Disallow	/2039/
Disallow	/2040/
Disallow	/date/

Rule

Path

Disallow

/pages/

Disallow

/page/

Disallow

/author/

Disallow

/tag/

Disallow

/2018/

Disallow

/2019/

Disallow

/2020/

Disallow

/2021/

Disallow

/2022/

Disallow

/2023/

Disallow

/2024/

Disallow

/2025/

Disallow

/2026/

Disallow

/2027/

Disallow

/2028/

Disallow

/2029/

Disallow

/2030/

Disallow

/2031/

Disallow

/2032/

Disallow

/2033/

Disallow

/2034/

Disallow

/2035/

Disallow

/2036/

Disallow

/2037/

Disallow

/2038/

Disallow

/2039/

Disallow

/2040/

Disallow

/date/

ahrefsbot

Rule	Path
Disallow	/pages/
Disallow	/page/
Disallow	/author/
Disallow	/tag/
Disallow	/2018/
Disallow	/2019/
Disallow	/2020/
Disallow	/2021/
Disallow	/2022/
Disallow	/2023/
Disallow	/2024/
Disallow	/2025/
Disallow	/2026/
Disallow	/2027/
Disallow	/2028/
Disallow	/2029/
Disallow	/2030/
Disallow	/2031/
Disallow	/2032/
Disallow	/2033/
Disallow	/2034/
Disallow	/2035/
Disallow	/2036/
Disallow	/2037/
Disallow	/2038/
Disallow	/2039/
Disallow	/2040/
Disallow	/date/

Rule

Path

Disallow

/pages/

Disallow

/page/

Disallow

/author/

Disallow

/tag/

Disallow

/2018/

Disallow

/2019/

Disallow

/2020/

Disallow

/2021/

Disallow

/2022/

Disallow

/2023/

Disallow

/2024/

Disallow

/2025/

Disallow

/2026/

Disallow

/2027/

Disallow

/2028/

Disallow

/2029/

Disallow

/2030/

Disallow

/2031/

Disallow

/2032/

Disallow

/2033/

Disallow

/2034/

Disallow

/2035/

Disallow

/2036/

Disallow

/2037/

Disallow

/2038/

Disallow

/2039/

Disallow

/2040/

Disallow

/date/

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrush

Rule	Path
Disallow	/

Rule

Path

Disallow

siteauditbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-ba

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-si

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-swa

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-ct

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-bm

Rule	Path
Disallow	/

Rule

Path

Disallow

splitsignalbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-coub

Rule	Path
Disallow	/

Rule

Path

Disallow

Other Records

Field	Value
sitemap	https://nycmytown.com/sitemap_index.xml

Field

Value

sitemap

https://nycmytown.com/sitemap_index.xml

nycmytown.comrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

*

semrush

siteauditbot

semrushbot-ba

semrushbot-si

semrushbot-swa

semrushbot-ct

semrushbot-bm

splitsignalbot

semrushbot-coub

ahrefs

semrushbot

ahrefsbot

semrushbot

semrush

siteauditbot

semrushbot-ba

semrushbot-si

semrushbot-swa

semrushbot-ct

semrushbot-bm

splitsignalbot

semrushbot-coub

Other Records

nycmytown.com
robots.txt