medpertise.de
robots.txt

Robots Exclusion Standard data for medpertise.de

Resource Scan

Scan Details

Site Domain medpertise.de
Base Domain medpertise.de
Scan Status Ok
Last Scan2024-06-30T13:56:04+00:00
Next Scan 2024-07-07T13:56:04+00:00

Last Scan

Scanned2024-06-30T13:56:04+00:00
URL https://medpertise.de/robots.txt
Redirect https://www.medpertise.de/robots.txt
Redirect Domain www.medpertise.de
Redirect Base medpertise.de
Domain IPs 2001:8d8:1800:663::1, 82.165.30.209
Redirect IPs 2001:8d8:1800:663::1, 82.165.30.209
Response IP 82.165.30.209
Found Yes
Hash fbfc81efce53e524a166ce667cfa8c2ee1b6713eca97f1fbae414d4f1b55a78b
SimHash 6513dd104314

Groups

*

Rule Path
Disallow /medikamente/toapo.html
Disallow /forum/ft_track/*

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2