stadtmagazin-muenchen24.de
robots.txt

Robots Exclusion Standard data for stadtmagazin-muenchen24.de

Resource Scan

Scan Details

Site Domain stadtmagazin-muenchen24.de
Base Domain stadtmagazin-muenchen24.de
Scan Status Ok
Last Scan2024-09-20T03:33:45+00:00
Next Scan 2024-09-27T03:33:45+00:00

Last Scan

Scanned2024-09-20T03:33:45+00:00
URL https://stadtmagazin-muenchen24.de/robots.txt
Domain IPs 2a02:2350:5:10a:ff:c8c4:ff07:c06e, 46.30.213.26
Response IP 46.30.213.26
Found Yes
Hash e591fd332ac7af2c98d9316e56704a545cb8937a5ff94de10caf10fd07149fc9
SimHash 60305e025386

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

teoma

Rule Path
Disallow

gigabot

Rule Path
Disallow

robozilla

Rule Path
Disallow

nutch

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

baiduspider

Rule Path
Disallow

naverbot

Rule Path
Disallow

yeti

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

psbot

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /trackback/
Disallow /feed/
Disallow /comments/
Disallow */trackback/
Disallow */feed/
Disallow */comments/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 120