static.wired.com
robots.txt

Robots Exclusion Standard data for static.wired.com

Resource Scan

Scan Details

Site Domain static.wired.com
Base Domain wired.com
Scan Status Ok
Last Scan2024-04-22T04:56:47+00:00
Next Scan 2024-05-22T04:56:47+00:00

Last Scan

Scanned2024-04-22T04:56:47+00:00
URL https://static.wired.com/robots.txt
Domain IPs 151.101.0.239, 151.101.128.239, 151.101.192.239, 151.101.64.239
Response IP 199.232.44.239
Found Yes
Hash 946a278175d5baa2df37624658bfb6bc98fe66886f5a67298a13ff5ec76c5950
SimHash a815d802e518

Groups

*

Rule Path
Disallow /

Comments

  • Prevent search spiders from indexing origin and staging sites