farmbuy.com
robots.txt

Robots Exclusion Standard data for farmbuy.com

Resource Scan

Scan Details

Site Domain farmbuy.com
Base Domain farmbuy.com
Scan Status Ok
Last Scan2024-06-28T15:55:49+00:00
Next Scan 2024-07-05T15:55:49+00:00

Last Scan

Scanned2024-06-28T15:55:49+00:00
URL https://farmbuy.com/robots.txt
Domain IPs 172.105.188.134
Response IP 172.105.188.134
Found Yes
Hash 7d5f6701484f374bb5391fc7d66ce78a40b9cbcfa8eafab82f5e38548a9c02b9
SimHash 69159072cfb3

Groups

*

Rule Path
Disallow /__admin/
Disallow /dyn/refunctions/

Other Records

Field Value
crawl-delay 1

ia_archiver
archive.org_bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://farmbuy.com/sitemap.xml