Log In Sign Up

myisl.lu
robots.txt

Robots Exclusion Standard data for myisl.lu

Resource Scan

Scan Details

Site Domain myisl.lu
Base Domain myisl.lu
Scan Status Ok
Last Scan2025-10-19T17:44:09+00:00
Next Scan 2025-11-02T17:44:09+00:00

Last Scan

Scanned2025-10-19T17:44:09+00:00
URL https://www.myisl.lu/robots.txt
Domain IPs 104.17.162.123, 104.17.163.123, 104.17.164.123, 104.17.165.123, 104.17.166.123, 2606:4700::6811:a27b, 2606:4700::6811:a37b, 2606:4700::6811:a47b, 2606:4700::6811:a57b, 2606:4700::6811:a67b
Response IP 104.17.165.123
Found Yes
Hash 8fcae63ecf92a9a251fb444207ac9c1288750b440bbb87bdfa495bb7a7d84e5d
SimHash 7144ca418b71

Groups

twiceler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

*

Rule Path
Disallow /page.cfm
Disallow /cf_calendar/printpdf.cfm
Disallow /fs/
Allow /fs/login$
Allow /fs/pages/1
Allow /fs/pages/2
Allow /fs/pages/3
Allow /fs/pages/4
Allow /fs/pages/5
Allow /fs/pages/6
Allow /fs/pages/7
Allow /fs/pages/8
Allow /fs/pages/9
Allow /fs/pages/athletics
Allow /fs/pages/calendar
Allow /fs/pages/news
Allow /fs/pages/search
Allow /fs/pages/search-results-item/post
Allow /fs/pages/sitemap
Allow /fs/form-manager/view/
Allow /fs/resource-manager/view/

Other Records

Field Value
crawl-delay 5

*

No rules defined. All paths allowed.

Back to top

Comments

  • System Records
  • Custom Records
  • Page Exclusions
Back to top

Warnings

  • 2 invalid lines.
Back to top