biltonschool.co.uk
robots.txt

Robots Exclusion Standard data for biltonschool.co.uk

Resource Scan

Scan Details

Site Domain biltonschool.co.uk
Base Domain biltonschool.co.uk
Scan Status Ok
Last Scan2025-09-25T09:36:51+00:00
Next Scan 2025-10-25T09:36:51+00:00

Last Scan

Scanned2025-09-25T09:36:51+00:00
URL https://biltonschool.co.uk/robots.txt
Redirect https://www.biltonschool.co.uk/robots.txt
Redirect Domain www.biltonschool.co.uk
Redirect Base biltonschool.co.uk
Domain IPs 104.17.71.73
Redirect IPs 104.17.162.123, 104.17.163.123, 104.17.164.123, 104.17.165.123, 104.17.166.123, 2606:4700::6811:a27b, 2606:4700::6811:a37b, 2606:4700::6811:a47b, 2606:4700::6811:a57b, 2606:4700::6811:a67b
Response IP 104.17.166.123
Found Yes
Hash 5a0cd106b43da8417eb9552e58e83a222b84d5bc864a5988efd110f591b1f3de
SimHash 7b06da430f34

Groups

twiceler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

*

Rule Path
Disallow /page.cfm
Disallow /cf_calendar/printpdf.cfm
Disallow /fs/
Allow /fs/login$
Allow /fs/pages/1
Allow /fs/pages/2
Allow /fs/pages/3
Allow /fs/pages/4
Allow /fs/pages/5
Allow /fs/pages/6
Allow /fs/pages/7
Allow /fs/pages/8
Allow /fs/pages/9
Allow /fs/pages/athletics
Allow /fs/pages/calendar
Allow /fs/pages/news
Allow /fs/pages/search
Allow /fs/pages/search-results-item/post
Allow /fs/pages/sitemap
Allow /fs/form-manager/view/
Allow /fs/resource-manager/view/

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /news-to-posts-comparison$
Disallow /news-to-posts-comparison?
Disallow /news-to-posts-comparison/~
Disallow /parents/inclusive-attendance$
Disallow /parents/inclusive-attendance?
Disallow /parents/inclusive-attendance/~
Disallow /news-clone$
Disallow /news-clone?
Disallow /news-clone/~
Disallow /houses-clone$
Disallow /houses-clone?
Disallow /houses-clone/~
Disallow /newsletters-clone$
Disallow /newsletters-clone?
Disallow /newsletters-clone/~
Disallow /ptsa-clone$
Disallow /ptsa-clone?
Disallow /ptsa-clone/~
Disallow /year-5-virtual-open-evening-clone$
Disallow /year-5-virtual-open-evening-clone?
Disallow /year-5-virtual-open-evening-clone/~
Disallow /home-clone$
Disallow /home-clone?
Disallow /home-clone/~
Disallow /home-clone-21sep2017$
Disallow /home-clone-21sep2017?
Disallow /home-clone-21sep2017/~
Disallow /production-clone$
Disallow /production-clone?
Disallow /production-clone/~
Disallow /search-results$
Disallow /search-results?
Disallow /search-results/~

Comments

  • System Records
  • Custom Records
  • Page Exclusions

Warnings

  • 2 invalid lines.