dairyforall.com
robots.txt

Robots Exclusion Standard data for dairyforall.com

Resource Scan

Scan Details

Site Domain dairyforall.com
Base Domain dairyforall.com
Scan Status Ok
Last Scan2025-09-01T20:11:35+00:00
Next Scan 2025-09-08T20:11:35+00:00

Last Scan

Scanned2025-09-01T20:11:35+00:00
URL https://dairyforall.com/robots.txt
Redirect http://www.dairyforall.com/robots.txt
Redirect Domain www.dairyforall.com
Redirect Base dairyforall.com
Domain IPs 67.20.112.229
Redirect IPs 67.20.112.229
Response IP 67.20.112.229
Found Yes
Hash c110aa8614a0624996889a27fa36cc30da480fbd9d83e48cb56cb73166137669
SimHash 39548b424f55

Groups

*

Rule Path
Allow /ads.txt
Disallow /ads

Comments

  • For domain: http://www.dairyforall.com
  • All robots will spider the domain