bictonschool.org.uk
robots.txt

Robots Exclusion Standard data for bictonschool.org.uk

Resource Scan

Scan Details

Site Domain bictonschool.org.uk
Base Domain bictonschool.org.uk
Scan Status Ok
Last Scan2025-12-09T20:08:01+00:00
Next Scan 2026-01-08T20:08:01+00:00

Last Scan

Scanned2025-12-09T20:08:01+00:00
URL https://bictonschool.org.uk/robots.txt
Domain IPs 149.255.58.162
Response IP 149.255.58.162
Found Yes
Hash dd0c6d1b8be570cc17f0bc62b0935f3cddd278ec4d4aea52d0e165537f1f17ab
SimHash 45158232cb73

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /test_area/
Disallow /parents/
Disallow /terms.php
Disallow /home/parents-area/calendar/action~posterboard/
Disallow /home/parents-area/calendar/action~agenda/
Disallow /home/parents-area/calendar/action~oneday/
Disallow /home/parents-area/calendar/action~month/
Disallow /home/parents-area/calendar/action~week/
Disallow /home/parents-area/calendar/action~stream/
Disallow /home/parents-area/calendar/action~undefined/
Disallow /home/parents-area/calendar/action~http%3A/
Disallow /home/parents-area/calendar/action~default/
Disallow /home/parents-area/calendar/action~poster/
Disallow /home/parents-area/calendar/action~*/
Disallow /*controller%3Dai1ec_exporter_controller*
Disallow /*/action~*/