derails.co.uk
robots.txt

Robots Exclusion Standard data for derails.co.uk

Resource Scan

Scan Details

Site Domain derails.co.uk
Base Domain derails.co.uk
Scan Status Ok
Last Scan2025-11-30T15:30:42+00:00
Next Scan 2025-12-30T15:30:42+00:00

Last Scan

Scanned2025-11-30T15:30:42+00:00
URL https://derails.co.uk/robots.txt
Domain IPs 80.64.217.115
Response IP 80.64.217.115
Found Yes
Hash 538398c9f0881dfeb281d9ed335970d97d249aa4dc362ec23f8a26bfdcde8ab0
SimHash 4809da45c191

Groups

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 60

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 60

yandex

Rule Path
Allow /

Other Records

Field Value
crawl-delay 60

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 60

adsbot-google

Rule Path
Allow /

Other Records

Field Value
crawl-delay 60

googlebot-image

Rule Path
Allow /

Other Records

Field Value
crawl-delay 60

*

Rule Path
Disallow /
Disallow /*?page=$
Disallow /*%26page%3D$
Disallow /*?sort=
Disallow /*%26sort%3D
Disallow /*?order=
Disallow /*%26order%3D
Disallow /*?limit=
Disallow /*%26limit%3D
Disallow /*?filter_name=
Disallow /*%26filter_name%3D
Disallow /*?filter_sub_category=
Disallow /*%26filter_sub_category%3D
Disallow /*?filter_description=
Disallow /*%26filter_description%3D

Other Records

Field Value
sitemap https://derails.co.uk/index.php?route=extension/feed/google_sitemap