jobs.meinestadt.de
robots.txt

Robots Exclusion Standard data for jobs.meinestadt.de

Resource Scan

Scan Details

Site Domain jobs.meinestadt.de
Base Domain meinestadt.de
Scan Status Ok
Last Scan2025-02-23T09:02:51+00:00
Next Scan 2025-03-25T09:02:51+00:00

Last Scan

Scanned2025-02-23T09:02:51+00:00
URL https://jobs.meinestadt.de/robots.txt
Domain IPs 23.36.48.10
Response IP 23.54.56.12
Found Yes
Hash 7dfa9f692fe2685c5ef69bc526ec83e0bed3b6855bafd7843239859257bb5538
SimHash 790e3842a4b0

Groups

*

Rule Path
Disallow /*marktjagd_pageflip.html*
Disallow /site/meinestadt/marktjagdTracking
Disallow /jobs-files/
Disallow /coop/
Disallow /redirect/
Disallow /*/redirects/deutsche_bahn
Disallow /site/meinestadt/resourceCached/*/htdocs/js/src/leSpecial.js
Disallow /*/videostellenanzeigen
Disallow /*/ba-preview?id=
Disallow /*?*cid=
Disallow /*?*hsfp=
Disallow /*?*lang=
Disallow /*?*loc-interest=
Disallow /*?*jobwrds=
Disallow /*?*apsi%2F
Disallow /suche*?*page=
Disallow /*?*service=
Allow /jobs-files/labs/amptest
Allow /jobs-files/sitemap/stellen/*
Allow /jobs-files/sitemap/google4jobs/*
Allow /jobs-files/sitemap/arbeitgeber/*
Allow /jobs-files/sitemap/skills/*
Allow /jobs-files/sitemap/lehrstellen/*

thesubot

Rule Path
Disallow /

acontbot

Rule Path
Disallow /

mainseek_bot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://jobs.meinestadt.de/sitemaps/jobs-magazin-themen.xml
sitemap https://jobs.meinestadt.de/sitemaps/alltagshelfer-sitemap-index.xml
sitemap https://jobs.meinestadt.de/jobs-files/sitemap/stellen/sitemap-index.xml
sitemap https://jobs.meinestadt.de/jobs-files/sitemap/lehrstellen/sitemap-index.xml
sitemap https://jobs.meinestadt.de/jobs-files/sitemap/arbeitgeber/sitemap-index.xml
sitemap https://jobs.meinestadt.de/jobs-files/sitemap/skills/sitemap-index.xml
sitemap https://jobs.meinestadt.de/jobs-files/sitemap/google4jobs/sitemap-index.xml

Comments

  • 19.11.2024 remove bingbot crawl delay
  • User-agent: bingbot
  • Crawl-delay: 1