cfte.education
robots.txt

Robots Exclusion Standard data for cfte.education

Resource Scan

Scan Details

Site Domain cfte.education
Base Domain cfte.education
Scan Status Ok
Last Scan2025-07-27T17:15:11+00:00
Next Scan 2025-08-26T17:15:11+00:00

Last Scan

Scanned2025-07-27T17:15:11+00:00
URL https://cfte.education/robots.txt
Redirect https://courses.cfte.education/robots.txt
Redirect Domain courses.cfte.education
Redirect Base cfte.education
Domain IPs 194.1.147.30, 194.1.147.79
Redirect IPs 194.1.147.30, 194.1.147.79
Response IP 194.1.147.30
Found Yes
Hash c964bde922f9353c3cbe2ce8912346653c2f5a8590cae4f12897e0d8151565f3
SimHash 6949d872a113

Groups

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

chatgpt-searchbot

Rule Path
Allow /

*

Rule Path
Allow /

Warnings

  • 2 invalid lines.
  • `https` is not a known field.