textblog.de
robots.txt

Robots Exclusion Standard data for textblog.de

Resource Scan

Scan Details

Site Domain textblog.de
Base Domain textblog.de
Scan Status Ok
Last Scan2025-11-08T18:58:27+00:00
Next Scan 2025-12-08T18:58:27+00:00

Last Scan

Scanned2025-11-08T18:58:27+00:00
URL http://textblog.de/robots.txt
Domain IPs 217.160.0.80
Response IP 217.160.0.80
Found Yes
Hash 6764d4dadc6644dd9bdce3d2d60c1b51d42f8f072358593d7d00a92151a0c67c
SimHash 6010f8b2c3f1

Groups

googlebot-image

Rule Path
Disallow /

psbot

Rule Path
Disallow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

ia_archiver

Rule Path
Disallow /

*

Rule Path
Disallow /index.php/notizen/rss_2.0/