nywire.com
robots.txt

Robots Exclusion Standard data for nywire.com

Resource Scan

Scan Details

Site Domain nywire.com
Base Domain nywire.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-14T23:12:27+00:00
Next Scan 2025-10-21T23:12:27+00:00

Last Successful Scan

Scanned2025-10-06T21:52:48+00:00
URL https://nywire.com/robots.txt
Domain IPs 179.61.189.143, 2a02:4780:84:6506:7e58:6e50:57d5:cc8f, 2a02:4780:84:fd06:9bae:384d:8d19:6e19, 93.127.201.73
Response IP 93.127.201.202
Found Yes
Hash e0331b1071e7519871e30e937848525f79fd2ebe0a9d6f32c894f23b89997060
SimHash 08795c56dfbb

Groups

*

Rule Path
Disallow /wp-login.php
Disallow /wp-admin/
Disallow /tag/
Disallow /category/
Disallow /2020/
Disallow /2021/
Disallow /2022/
Disallow /2023/
Disallow /2024/
Disallow /wp-content/uploads/2020/
Disallow /wp-content/uploads/2021/
Disallow /wp-content/uploads/2022/
Disallow /wp-content/uploads/elementor/thumbs/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 600

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

Other Records

Field Value
sitemap https://nywire.com/sitemap.xml
sitemap https://nywire.com/sitemap.rss

Comments

  • Block archive.org bots