auto.meinestadt.de
robots.txt

Robots Exclusion Standard data for auto.meinestadt.de

Resource Scan

Scan Details

Site Domain auto.meinestadt.de
Base Domain meinestadt.de
Scan Status Ok
Last Scan2025-02-23T13:34:20+00:00
Next Scan 2025-03-25T13:34:20+00:00

Last Scan

Scanned2025-02-23T13:34:20+00:00
URL https://auto.meinestadt.de/robots.txt
Domain IPs 23.36.48.10
Response IP 23.54.56.12
Found Yes
Hash 3c45f2af46fe608d0befa502c3e968243dc7ecd23716c0e123e291b142ef0b3c
SimHash 638df454e5b8

Groups

*

Rule Path
Disallow /*marktjagd_pageflip.html*
Disallow /site/meinestadt/marktjagdTracking
Disallow /jobs-files/
Disallow /coop/
Disallow /mail/
Disallow /*/redirects/deutsche_bahn
Disallow /site/meinestadt/resourceCached/*/htdocs/js/src/leSpecial.js
Disallow */navtiming
Disallow */126611261/

ahrefsbot

Rule Path
Disallow /*marktjagd_pageflip.html*
Disallow /site/meinestadt/marktjagdTracking
Disallow /jobs-files/
Disallow /coop/
Disallow /*/redirects/deutsche_bahn
Disallow /site/meinestadt/resourceCached/*/htdocs/js/src/leSpecial.js

Other Records

Field Value
crawl-delay 30

thesubot

Rule Path
Disallow /

acontbot

Rule Path
Disallow /

mainseek_bot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://auto.meinestadt.de/sitemaps/technische-daten.xml
sitemap https://auto.meinestadt.de/sitemaps/gebrauchtwagen-index.xml
sitemap https://auto.meinestadt.de/sitemaps/auto-gebrauchtwagen-azl-deutschland.xml