dsm-ny.com
robots.txt

Robots Exclusion Standard data for dsm-ny.com

Resource Scan

Scan Details

Site Domain dsm-ny.com
Base Domain dsm-ny.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-25T10:17:14+00:00
Next Scan 2024-12-24T10:17:14+00:00

Last Successful Scan

Scanned2023-05-07T01:59:26+00:00
URL https://dsm-ny.com/robots.txt
Redirect https://newyork.doverstreetmarket.com/robots.txt
Redirect Domain newyork.doverstreetmarket.com
Redirect Base doverstreetmarket.com
Domain IPs 205.186.183.189
Redirect IPs 18.155.68.31, 18.155.68.55, 18.155.68.96, 18.155.68.98, 2600:9000:213e:5400:d:66f9:4640:93a1, 2600:9000:213e:5e00:d:66f9:4640:93a1, 2600:9000:213e:6e00:d:66f9:4640:93a1, 2600:9000:213e:8400:d:66f9:4640:93a1, 2600:9000:213e:9400:d:66f9:4640:93a1, 2600:9000:213e:b200:d:66f9:4640:93a1, 2600:9000:213e:be00:d:66f9:4640:93a1, 2600:9000:213e:c800:d:66f9:4640:93a1
Response IP 18.155.68.31
Found Yes
Hash 7c55f46de40de31de6cd1ddebe7663ace5183933647b3600c2a328c135299b13
SimHash 7114e5466713

Groups

*

No rules defined. All paths allowed.

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449