petitfute.co.uk
robots.txt

Robots Exclusion Standard data for petitfute.co.uk

Resource Scan

Scan Details

Site Domain petitfute.co.uk
Base Domain petitfute.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-07-26T15:20:54+00:00
Next Scan 2025-10-24T15:20:54+00:00

Last Successful Scan

Scanned2024-09-30T11:04:11+00:00
URL https://petitfute.co.uk/robots.txt
Redirect https://www.petitfute.co.uk/robots.txt
Redirect Domain www.petitfute.co.uk
Redirect Base petitfute.co.uk
Domain IPs 104.21.47.87, 172.67.145.252, 2606:4700:3033::ac43:91fc, 2606:4700:3035::6815:2f57
Redirect IPs 104.21.47.87, 172.67.145.252, 2606:4700:3033::ac43:91fc, 2606:4700:3035::6815:2f57
Response IP 172.67.145.252
Found Yes
Hash d5573a8d933ab60dfc1355b986a6685b37869ef3330368587247d8fb873e3101
SimHash a144db24c375

Groups

*

Rule Path
Disallow /adresse/recherche/
Disallow /professionnel/responsable/
Disallow /professionnel/preview/
Disallow /communaute/
Disallow /reservation/*
Disallow /media/createcss/
Disallow /media/createcss.html
Disallow /logparser/
Disallow /edition/extrait.html
Disallow /*/lieug_id%3A
Disallow /*/pdflight.*
Disallow /*/guide-touristique/videos.html
Disallow /*filterlisting%3Don
Disallow /mag/lienparution/
Disallow /forum/*
Disallow /*/forum/*
Disallow /*/c0-tous-les-bons-plans/
Disallow /hubgeo/meteo.json
Disallow /hubgeo/legendetrad*
Disallow /hubgeo/getvillebyiata.json
Disallow /tracking/booster/*
Disallow /?pfpart=*
Disallow /*/actualite/?order_article=*
Disallow /*?order*
Disallow /*/?distance=
Disallow /?f=*
Disallow /medias/newsletter/*

googlebot-image

Rule Path
Disallow /booster/originale/