recomedicales.fr
robots.txt

Robots Exclusion Standard data for recomedicales.fr

Resource Scan

Scan Details

Site Domain recomedicales.fr
Base Domain recomedicales.fr
Scan Status Ok
Last Scan2024-08-27T23:21:58+00:00
Next Scan 2024-09-26T23:21:58+00:00

Last Scan

Scanned2024-08-27T23:21:58+00:00
URL https://recomedicales.fr/robots.txt
Domain IPs 13.228.199.255, 13.251.96.10, 2406:da18:b3d:e200::64, 2406:da18:b3d:e201::64
Response IP 13.251.96.10
Found Yes
Hash db5f7be3a893b9505500ec64667e9707e638b9cc8d12d792b20e1381fce22019
SimHash 70144941c4b1

Groups

amazonbot
anthropic-ai
applebot
awariorssbot
awariosmartbot
bytespider
ccbot
chatgpt
chatgpt-user
claude-web
claudebot
cohere-ai
dataforseobot
diffbot
facebookbot
google-extended
gptbot
imagesiftbot
magpie-crawler
omgili
omgilibot
peer39_crawler
perplexitybot
the knowledge ai
youbot

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /index.json
Disallow /recommandations/index.json
Disallow /404/
Disallow /offline/

Other Records

Field Value
sitemap https://recomedicales.fr/sitemap.xml