veranstaltungen.meinestadt.de
robots.txt

Robots Exclusion Standard data for veranstaltungen.meinestadt.de

Resource Scan

Scan Details

Site Domain veranstaltungen.meinestadt.de
Base Domain meinestadt.de
Scan Status Ok
Last Scan2025-02-23T08:05:24+00:00
Next Scan 2025-03-25T08:05:24+00:00

Last Scan

Scanned2025-02-23T08:05:24+00:00
URL https://veranstaltungen.meinestadt.de/robots.txt
Domain IPs 23.36.48.10
Response IP 23.54.56.12
Found Yes
Hash 1b16c0b54318eaa343ba0c11a1e90c902d67d3a4a2a03cfb1b82d2c91b64043e
SimHash 6b0c08446071

Groups

*

Rule Path
Disallow /*marktjagd_pageflip.html*
Disallow /site/meinestadt/marktjagdTracking
Disallow /jobs-files/
Disallow /coop/
Disallow /*/redirects/deutsche_bahn
Disallow /*/suche
Disallow /site/meinestadt/resourceCached/*/htdocs/js/src/leSpecial.js
Disallow *?curDatesPage=*
Disallow *?allDatesPage=*
Disallow *?words=*
Disallow /kalender/
Disallow *?event_id=*
Disallow *%26date_id%3D

thesubot

Rule Path
Disallow /

acontbot

Rule Path
Disallow /

mainseek_bot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://veranstaltungen.meinestadt.de/x/google/google-locations-sitemap.xml
sitemap https://veranstaltungen.meinestadt.de/x/google/google-events-sitemap.xml
sitemap https://veranstaltungen.meinestadt.de/sitemaps/veranstaltungen-sitemap-index.xml

Comments

  • 19.11.2024 remove bingbot crawl delay
  • User-agent: bingbot
  • Crawl-delay: 1