cdn.design-system.economist.com
robots.txt

Robots Exclusion Standard data for cdn.design-system.economist.com

Resource Scan

Scan Details

Site Domain cdn.design-system.economist.com
Base Domain economist.com
Scan Status Ok
Last Scan2024-04-20T12:41:04+00:00
Next Scan 2024-05-20T12:41:04+00:00

Last Scan

Scanned2024-04-20T12:41:04+00:00
URL https://cdn.design-system.economist.com/robots.txt
Domain IPs 108.157.254.106, 108.157.254.120, 108.157.254.79, 108.157.254.9, 2600:9000:2753:2400:6:f78b:59c0:93a1, 2600:9000:2753:3600:6:f78b:59c0:93a1, 2600:9000:2753:4000:6:f78b:59c0:93a1, 2600:9000:2753:4400:6:f78b:59c0:93a1, 2600:9000:2753:5c00:6:f78b:59c0:93a1, 2600:9000:2753:6a00:6:f78b:59c0:93a1, 2600:9000:2753:be00:6:f78b:59c0:93a1, 2600:9000:2753:ce00:6:f78b:59c0:93a1
Response IP 108.157.254.79
Found Yes
Hash 9e004d60128e20059a005dc1fc16343c1bfa023dac58b34f0908531d61aa23f4
SimHash 7414d040e993

Groups

*

Rule Path
Disallow /playground

Comments

  • www.robotstxt.org/
  • http://code.google.com/web/controlcrawlindex/