weatherfarm.com
robots.txt

Robots Exclusion Standard data for weatherfarm.com

Resource Scan

Scan Details

Site Domain weatherfarm.com
Base Domain weatherfarm.com
Scan Status Ok
Last Scan2026-01-31T07:49:10+00:00
Next Scan 2026-02-07T07:49:10+00:00

Last Scan

Scanned2026-01-31T07:49:10+00:00
URL https://weatherfarm.com/robots.txt
Domain IPs 104.26.4.171, 104.26.5.171, 172.67.70.244, 2606:4700:20::681a:4ab, 2606:4700:20::681a:5ab, 2606:4700:20::ac43:46f4
Response IP 104.26.4.171
Found Yes
Hash b7cfb2a9c8c357cb6bec5a9d4afa6daac1e965604d544dba8a1051319a0c0624
SimHash 4814dc508653

Groups

baiduspider

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://weatherfarm.com/sitemap_index.xml