dyoung.co.uk
robots.txt

Robots Exclusion Standard data for dyoung.co.uk

Resource Scan

Scan Details

Site Domain dyoung.co.uk
Base Domain dyoung.co.uk
Scan Status Ok
Last Scan2026-01-25T16:34:20+00:00
Next Scan 2026-02-01T16:34:20+00:00

Last Scan

Scanned2026-01-25T16:34:20+00:00
URL https://dyoung.co.uk/robots.txt
Redirect https://www.dyoung.com/robots.txt
Redirect Domain www.dyoung.com
Redirect Base dyoung.com
Domain IPs 209.97.188.7
Redirect IPs 209.97.188.7
Response IP 209.97.188.7
Found Yes
Hash 4ae9e346d18dd4d62f9193ce50b90ca961bc794df3956141e0faa0799d109ad7
SimHash 036a1256379b

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env

Other Records

Field Value
sitemap https://www.dyoung.com/en/sitemaps-1-sitemap.xml
sitemap https://www.dyoung.com/de/sitemaps-1-sitemap.xml
sitemap https://www.dyoung.com/cn/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.dyoung.com/en/
  • live - don't allow web crawlers to index cpresources/ or vendor/