courses.farm
robots.txt

Robots Exclusion Standard data for courses.farm

Resource Scan

Scan Details

Site Domain courses.farm
Base Domain courses.farm
Scan Status Ok
Last Scan2025-12-03T02:29:51+00:00
Next Scan 2026-01-02T02:29:51+00:00

Last Scan

Scanned2025-12-03T02:29:51+00:00
URL https://courses.farm/robots.txt
Redirect https://course-farm.com/robots.txt
Redirect Domain course-farm.com
Redirect Base course-farm.com
Domain IPs 104.21.51.221, 172.67.188.253, 2606:4700:3030::ac43:bcfd, 2606:4700:3034::6815:33dd
Redirect IPs 104.21.33.10, 172.67.139.160, 2606:4700:3031::ac43:8ba0, 2606:4700:3033::6815:210a
Response IP 172.67.139.160
Found Yes
Hash 62fa689d721a7904812f71c39151ae8acb042c59d86f31065cabb9cb82bd545d
SimHash 6918cc52c333

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://course-farm.com/sitemap.xml