Log In Sign Up

dressafford.com
robots.txt

Robots Exclusion Standard data for dressafford.com

Resource Scan

Scan Details

Site Domain dressafford.com
Base Domain dressafford.com
Scan Status Ok
Last Scan2024-06-12T12:16:13+00:00
Next Scan 2024-07-12T12:16:13+00:00

Last Scan

Scanned2024-06-12T12:16:13+00:00
URL https://dressafford.com/robots.txt
Redirect https://www.dressafford.com/robots.txt
Redirect Domain www.dressafford.com
Redirect Base dressafford.com
Domain IPs 104.21.37.114, 172.67.207.211, 2606:4700:3031::6815:2572, 2606:4700:3035::ac43:cfd3
Redirect IPs 13.33.88.118, 13.33.88.122, 13.33.88.54, 13.33.88.98, 2600:9000:223b:400:11:152e:ec0:93a1, 2600:9000:223b:4a00:11:152e:ec0:93a1, 2600:9000:223b:8a00:11:152e:ec0:93a1, 2600:9000:223b:8c00:11:152e:ec0:93a1, 2600:9000:223b:9200:11:152e:ec0:93a1, 2600:9000:223b:b400:11:152e:ec0:93a1, 2600:9000:223b:c00:11:152e:ec0:93a1, 2600:9000:223b:dc00:11:152e:ec0:93a1
Response IP 13.33.88.54
Found Yes
Hash 0565e0d155a9db650153e2a5f3bbc41465d502dff14ca41094fbe4c144024ded
SimHash 7014cc7ac600

Groups

smtbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

amazonbot

Product Comment
amazonbot Amazon's user agent
Rule Path Comment
Disallow / disallow this directory

mj12bot

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

seekportbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

*

Rule Path
Allow /
Disallow /articletype/
Disallow /comment/list/*
Allow /comment/list/$
Back to top