cheaperbookings.com
robots.txt

Robots Exclusion Standard data for cheaperbookings.com

Resource Scan

Scan Details

Site Domain cheaperbookings.com
Base Domain cheaperbookings.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-02-01T23:03:10+00:00
Next Scan 2026-04-02T23:03:10+00:00

Last Successful Scan

Scanned2025-11-10T00:04:56+00:00
URL https://cheaperbookings.com/robots.txt
Redirect https://www.cheaperbookings.com/robots.txt
Redirect Domain www.cheaperbookings.com
Redirect Base cheaperbookings.com
Domain IPs 104.21.86.136, 172.67.220.89, 2606:4700:3033::6815:5688, 2606:4700:3034::ac43:dc59
Redirect IPs 104.21.86.136, 172.67.220.89, 2606:4700:3033::6815:5688, 2606:4700:3034::ac43:dc59
Response IP 172.67.220.89
Found Yes
Hash a07ad58306d7e1257d9aa8243daf5818ea5d4401ba6255c6654e180b0a3977e1
SimHash b607d4536b17

Groups

*

Rule Path Comment
Disallow /portal/* -
Disallow /includes/* -
Disallow /crons/* -
Disallow /menu_bar_content/* -
Disallow /heartbeat -
Disallow /header -
Disallow /head -
Disallow /404 -
Disallow /footer -
Disallow /language -
Disallow /under_maintenance -
Disallow /cgi-bin/* -
Allow *?v=* allow this query string
Allow /resources/img/* -
Allow /build/* -
Allow /build/js/jquery.js* -
Allow /build/js/script.min.js?* -
Allow /build/css/styles.min.css?* -
Allow /build/css/f.min.css?* -
Allow /build/css/pf.min.css?* -
Allow *.js* -
Allow *.css* -
Allow *.jpg* -
Allow *.gif* -
Allow *.png* -
Allow *.svg* -

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

petalbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://www.cheaperbookings.com/sitemaps.xml