recomedicales.fr
robots.txt
Robots Exclusion Standard data for recomedicales.fr
Resource Scan
Scan Details
Site Domain | recomedicales.fr |
Base Domain | recomedicales.fr |
Scan Status | Ok |
Last Scan | 2024-08-27T23:21:58+00:00 |
Next Scan | 2024-09-26T23:21:58+00:00 |
Last Scan
Scanned | 2024-08-27T23:21:58+00:00 |
URL | https://recomedicales.fr/robots.txt |
Domain IPs | 13.228.199.255, 13.251.96.10, 2406:da18:b3d:e200::64, 2406:da18:b3d:e201::64 |
Response IP | 13.251.96.10 |
Found | Yes |
Hash | db5f7be3a893b9505500ec64667e9707e638b9cc8d12d792b20e1381fce22019 |
SimHash | 70144941c4b1 |
Groups
amazonbot
anthropic-ai
applebot
awariorssbot
awariosmartbot
bytespider
ccbot
chatgpt
chatgpt-user
claude-web
claudebot
cohere-ai
dataforseobot
diffbot
facebookbot
google-extended
gptbot
imagesiftbot
magpie-crawler
omgili
omgilibot
peer39_crawler
perplexitybot
the knowledge ai
youbot
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Allow | / |
Disallow | /index.json |
Disallow | /recommandations/index.json |
Disallow | /404/ |
Disallow | /offline/ |
Other Records
Field | Value |
---|---|
sitemap | https://recomedicales.fr/sitemap.xml |