Log In Sign Up

deerfieldtreefarm.com
robots.txt

Robots Exclusion Standard data for deerfieldtreefarm.com

Resource Scan

Scan Details

Site Domain deerfieldtreefarm.com
Base Domain deerfieldtreefarm.com
Scan Status Ok
Last Scan2025-04-19T21:11:08+00:00
Next Scan 2025-05-19T21:11:08+00:00

Last Scan

Scanned2025-04-19T21:11:08+00:00
URL https://deerfieldtreefarm.com/robots.txt
Redirect http://www.deerfieldtreefarm.com/robots.txt
Redirect Domain www.deerfieldtreefarm.com
Redirect Base deerfieldtreefarm.com
Domain IPs 104.21.84.239, 172.67.198.228, 2606:4700:3034::6815:54ef, 2606:4700:3036::ac43:c6e4
Redirect IPs 104.21.84.239, 172.67.198.228, 2606:4700:3034::6815:54ef, 2606:4700:3036::ac43:c6e4
Response IP 172.67.198.228
Found Yes
Hash 12d453a1c1ef09240ed07ff91e86741aac038f4b1295b43133231086db9ae746
SimHash 0c78dd33e85b

Groups

omniexplorer_bot

Rule Path
Disallow /

projectplaylist-directlink

Rule Path
Disallow /

*

Rule Path
Disallow /~site/Scripts_ElementMailer
Disallow /~site/Scripts_ExternalRedirect
Disallow /~site/Scripts_ForSale
Disallow /~site/Scripts_HitCounter
Disallow /~site/Scripts_NewGuest
Disallow /~site/Scripts_RealTracker
Disallow /~site/Scripts_Track
Disallow /~site/Scripts_WebPoll
Disallow /~site/siteapps/showmap.action
Back to top

Comments

  • Block a bot that was causing issues by ignoring Disallow lines below
  • Block hotlinking of music files by projectplaylist.com due to perceived user bandwidth theft
  • Block all bots from the core Homestead site
Back to top