med.de
robots.txt

Robots Exclusion Standard data for med.de

Resource Scan

Scan Details

Site Domain med.de
Base Domain med.de
Scan Status Ok
Last Scan2024-06-04T23:27:42+00:00
Next Scan 2024-06-11T23:27:42+00:00

Last Scan

Scanned2024-06-04T23:27:42+00:00
URL https://med.de/robots.txt
Domain IPs 104.21.87.198, 172.67.145.202
Response IP 172.67.145.202
Found Yes
Hash 814745b8733d3c746a098cff87f4320be52adaf86e3278df59a6b3ac748bb2e3
SimHash 057fd9dca162

Groups

boardreader

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

*

Rule Path
Disallow /news/20*/*
Disallow /news/2009/*
Disallow /news/2010/*
Disallow /news/2011/*
Disallow /news/tag/*
Disallow /news/author/*
Disallow /news/feed/*
Disallow /news/comments/feed/*
Disallow /news/*/feed
Disallow /news/*/comments
Disallow /index.php?*
Disallow /forum/adventcaneldar.php

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /