turfoo.fr
robots.txt

Robots Exclusion Standard data for turfoo.fr

Resource Scan

Scan Details

Site Domain turfoo.fr
Base Domain turfoo.fr
Scan Status Ok
Last Scan2024-11-10T22:19:37+00:00
Next Scan 2024-11-17T22:19:37+00:00

Last Scan

Scanned2024-11-10T22:19:37+00:00
URL https://turfoo.fr/robots.txt
Domain IPs 104.18.2.105, 104.18.3.105, 2606:4700::6812:269, 2606:4700::6812:369
Response IP 104.18.2.105
Found Yes
Hash 9eae84f3e91c39f45e83616679b0d8fca8cf8c757cf75b1a434b976046fdf7e1
SimHash 5905d011e1f2

Groups

*

Rule Path
Allow /fiches/chevaux/*/performances/
Disallow /css/
Disallow /js/
Disallow /img/
Disallow /openx/
Disallow /membres/
Disallow /go/
Disallow /newslett/
Disallow /?_gwt_pg=0
Disallow /forum/*/faq.php
Disallow /forum/faq.php
Disallow /recherche/
Disallow /voircourses/
Disallow /fiches/entraineurs/*/*/
Disallow /fiches/jockeys/*/*/
Disallow /fiches/chevaux/*/*/

ia_archiver
mj12bot
textbulkerbot

Rule Path
Disallow /