railadvent.co.uk
robots.txt

Robots Exclusion Standard data for railadvent.co.uk

Resource Scan

Scan Details

Site Domain railadvent.co.uk
Base Domain railadvent.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-23T16:48:45+00:00
Next Scan 2026-01-21T16:48:45+00:00

Last Successful Scan

Scanned2025-06-25T16:30:29+00:00
URL https://railadvent.co.uk/robots.txt
Redirect https://www.railadvent.co.uk/robots.txt
Redirect Domain www.railadvent.co.uk
Redirect Base railadvent.co.uk
Domain IPs 104.21.5.102, 172.67.154.118, 2606:4700:3033::6815:566, 2606:4700:3037::ac43:9a76
Redirect IPs 104.21.5.102, 172.67.154.118, 2606:4700:3033::6815:566, 2606:4700:3037::ac43:9a76
Response IP 104.21.5.102
Found Yes
Hash c48d3346273ebeb65bfd8852b5166f12a5e50938c140cdbba762801cdcfabbe7
SimHash e02adcb2ea12

Groups

*

Rule Path
Disallow /*add-to-cart%3D*
Disallow /calendar/action~posterboard/
Disallow /calendar/action~agenda/
Disallow /calendar/action~oneday/
Disallow /calendar/action~month/
Disallow /calendar/action~week/
Disallow /calendar/action~stream/
Disallow /calendar/action~undefined/
Disallow /calendar/action~http%3A/
Disallow /calendar/action~default/
Disallow /calendar/action~poster/
Disallow /calendar/action~*/
Disallow /*controller%3Dai1ec_exporter_controller*
Disallow /*/action~*/
Disallow /cart/
Disallow /checkout/
Disallow /my-account/
Disallow /wp-content/plugins/
Disallow /wp-admin/
Disallow /readme.html
Disallow /refer/

mj12bot

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

bspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /?s=
Disallow /page/*/?s=
Disallow /search/

Comments

  • Block Search Results