dyethin.com
robots.txt

Robots Exclusion Standard data for dyethin.com

Resource Scan

Scan Details

Site Domain dyethin.com
Base Domain dyethin.com
Scan Status Ok
Last Scan2025-10-23T00:50:10+00:00
Next Scan 2025-11-22T00:50:10+00:00

Last Scan

Scanned2025-10-23T00:50:10+00:00
URL https://dyethin.com/robots.txt
Redirect https://www.dyethin.com/robots.txt
Redirect Domain www.dyethin.com
Redirect Base dyethin.com
Domain IPs 104.21.34.183, 172.67.163.184, 2606:4700:3032::6815:22b7, 2606:4700:3035::ac43:a3b8
Redirect IPs 104.21.34.183, 172.67.163.184, 2606:4700:3032::6815:22b7, 2606:4700:3035::ac43:a3b8
Response IP 172.67.163.184
Found Yes
Hash 6922ffbdda0f746beee3eca955973ef4cbdcf748778dc508a50bf1baf492a656
SimHash 1b52d000a0b3

Groups

*

Rule Path
Disallow /inquiry*
Disallow /product/search*
Disallow /user/
Disallow /*brandid%3D*
Disallow /*spec%3D*

bubing

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

linespider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 200

facebookexternalhit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 200

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.dyethin.com/sitemap.xml