dairyindustries.com
robots.txt

Robots Exclusion Standard data for dairyindustries.com

Resource Scan

Scan Details

Site Domain dairyindustries.com
Base Domain dairyindustries.com
Scan Status Ok
Last Scan2025-10-22T19:10:28+00:00
Next Scan 2025-11-21T19:10:28+00:00

Last Scan

Scanned2025-10-22T19:10:28+00:00
URL https://dairyindustries.com/robots.txt
Domain IPs 104.21.20.126, 172.67.192.228, 2606:4700:3032::ac43:c0e4, 2606:4700:3035::6815:147e
Response IP 104.21.20.126
Found Yes
Hash abaacdd9e9a63ac4492777399142ef4c1ad52971c8dfe87c2b506a01ed8ce832
SimHash 091c0ca15110

Groups

*

Rule Path
Disallow /?blackhole

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

nbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

slackbot

Rule Path
Disallow /