welovediy.com
robots.txt

Robots Exclusion Standard data for welovediy.com

Resource Scan

Scan Details

Site Domain welovediy.com
Base Domain welovediy.com
Scan Status Ok
Last Scan2025-10-26T01:35:15+00:00
Next Scan 2025-11-02T01:35:15+00:00

Last Scan

Scanned2025-10-26T01:35:15+00:00
URL https://welovediy.com/robots.txt
Domain IPs 104.21.66.78, 172.67.157.130, 2606:4700:3032::6815:424e, 2606:4700:3033::ac43:9d82
Response IP 104.21.66.78
Found Yes
Hash 3e4557301edcb0e54cabf90c3b6e32572eb41508fc55795d3a33bd566aaa0411
SimHash 0c75d1805583

Groups

*

Rule Path
Disallow /canary_wld/
Disallow /canary_waw/
Disallow /whatanniewears.com/

googlebot

Rule Path
Disallow /sitemap_baidu.xml

yahoo-slurp

Rule Path
Disallow /sitemap_baidu.xml

msnbot

Rule Path
Disallow /sitemap_baidu.xml

teoma

Rule Path
Disallow /sitemap_baidu.xml

baiduspider

Rule Path
Disallow /sitemap.xml