rentalcars24h.fr
robots.txt

Robots Exclusion Standard data for rentalcars24h.fr

Resource Scan

Scan Details

Site Domain rentalcars24h.fr
Base Domain rentalcars24h.fr
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-06T14:14:06+00:00
Next Scan 2024-10-20T14:14:06+00:00

Last Successful Scan

Scanned2024-09-21T14:12:02+00:00
URL https://rentalcars24h.fr/robots.txt
Domain IPs 104.21.61.117, 172.67.209.159, 2606:4700:3031::6815:3d75, 2606:4700:3033::ac43:d19f
Response IP 104.21.61.117
Found Yes
Hash 5fae8edb207e93e56207d8cc5d5e332a178c0b945c13f223fc3ab478906ca338
SimHash 8a5b1c348d93

Groups

*

Rule Path
Disallow /extra-car/update
Disallow /booking
Disallow /de/booking
Disallow /es/booking
Disallow /fr/booking
Disallow /it/booking
Disallow /ru/booking
Disallow /booking/latest
Disallow /otaproxygeo.php
Disallow /airports
Disallow /airports.html
Disallow /distances
Disallow /distance
Disallow /0-0/1-1
Disallow /faq.html
Disallow /contact-us.html
Disallow /our-cars.html
Disallow /about-us.html
Disallow /backend.php
Disallow /*_dev.php
Disallow /ajax

baiduspider

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://rentalcars24h.fr/sitemapindex.xml