nytimescrossword.org
robots.txt

Robots Exclusion Standard data for nytimescrossword.org

Resource Scan

Scan Details

Site Domain nytimescrossword.org
Base Domain nytimescrossword.org
Scan Status Ok
Last Scan2024-04-29T09:31:23+00:00
Next Scan 2024-05-06T09:31:23+00:00

Last Scan

Scanned2024-04-29T09:31:23+00:00
URL https://nytimescrossword.org/robots.txt
Domain IPs 103.224.182.251
Response IP 103.224.182.251
Found Yes
Hash 5286d9afb82f2037d221d2241c5595ae30e6c3385533a02859558daa9700f4d0
SimHash 6d50502561b3

Groups

*

Rule Path
Disallow /cpx.php
Disallow /medios1.php
Disallow /toolbar.php
Disallow /check_image.php
Disallow /check_popunder.php