hotel-finder.co.uk
robots.txt

Robots Exclusion Standard data for hotel-finder.co.uk

Resource Scan

Scan Details

Site Domain hotel-finder.co.uk
Base Domain hotel-finder.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-05T14:17:56+00:00
Next Scan 2025-07-04T14:17:56+00:00

Last Successful Scan

Scanned2022-10-04T13:36:00+00:00
URL https://hotel-finder.co.uk/robots.txt
Redirect https://www.hotel-finder.co.uk/robots.txt
Redirect Domain www.hotel-finder.co.uk
Redirect Base hotel-finder.co.uk
Response IP 104.26.9.183, 104.26.8.183, 172.67.72.223
Found Yes
Hash 3da972e72d1ae2fb5e385cb0d618e9e24c127ac2254f4a3b9530c39b6e240edb
SimHash 486edc40d558

Groups

*

Rule Path
Disallow /utilities/*

semrush

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

blexbot

No rules defined. All paths allowed.

seokicks-robot

No rules defined. All paths allowed.

Comments

  • Block SEOkicks

Warnings

  • 1 invalid line.