writebase.co.uk
robots.txt

Robots Exclusion Standard data for writebase.co.uk

Resource Scan

Scan Details

Site Domain writebase.co.uk
Base Domain writebase.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-29T13:12:23+00:00
Next Scan 2025-09-05T13:12:23+00:00

Last Successful Scan

Scanned2025-08-21T12:21:14+00:00
URL https://writebase.co.uk/robots.txt
Domain IPs 185.151.30.212
Response IP 185.151.30.212
Found Yes
Hash c6137a56d0f14f101fc948a79907f402f1d5b75f5a547ff4a854add4ef213043
SimHash d5028e32ef23

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /calendar/action~posterboard/
Disallow /calendar/action~agenda/
Disallow /calendar/action~oneday/
Disallow /calendar/action~month/
Disallow /calendar/action~week/
Disallow /calendar/action~stream/
Disallow /calendar/action~undefined/
Disallow /calendar/action~http%3A/
Disallow /calendar/action~default/
Disallow /calendar/action~poster/
Disallow /calendar/action~*/
Disallow /*controller%3Dai1ec_exporter_controller*
Disallow /*/action~*/
Disallow /calendar-2/action~posterboard/
Disallow /calendar-2/action~agenda/
Disallow /calendar-2/action~oneday/
Disallow /calendar-2/action~month/
Disallow /calendar-2/action~week/
Disallow /calendar-2/action~stream/
Disallow /calendar-2/action~undefined/
Disallow /calendar-2/action~http%3A/
Disallow /calendar-2/action~default/
Disallow /calendar-2/action~poster/
Disallow /calendar-2/action~*/

*

Rule Path
Disallow /wp-content/uploads/wp-import-export-lite/

Comments

  • WP Import Export Rule