farmmedia.com
robots.txt

Robots Exclusion Standard data for farmmedia.com

Resource Scan

Scan Details

Site Domain farmmedia.com
Base Domain farmmedia.com
Scan Status Ok
Last Scan2024-05-26T14:10:37+00:00
Next Scan 2024-06-25T14:10:37+00:00

Last Scan

Scanned2024-05-26T14:10:37+00:00
URL https://www.farmmedia.com/robots.txt
Domain IPs 104.26.4.102, 104.26.5.102, 172.67.74.105, 2606:4700:20::681a:466, 2606:4700:20::681a:566, 2606:4700:20::ac43:4a69
Response IP 104.26.5.102
Found Yes
Hash a543dd90e3487e5a75d5c944549d5817649b5c00c6a4ace7ba379d1780f2133f
SimHash 0014dc500653

Groups

baiduspider

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10