backinjob.de
robots.txt

Robots Exclusion Standard data for backinjob.de

Resource Scan

Scan Details

Site Domain backinjob.de
Base Domain backinjob.de
Scan Status Ok
Last Scan2024-09-27T21:22:28+00:00
Next Scan 2024-10-04T21:22:28+00:00

Last Scan

Scanned2024-09-27T21:22:28+00:00
URL https://backinjob.de/robots.txt
Domain IPs 136.243.84.225
Response IP 136.243.84.225
Found Yes
Hash a69ad8bb5891db11d74fc10a598071c7167788d6f00b2efb0514e5be1eb8a6e6
SimHash 0fc4ca80c13c

Groups

*

Rule Path
Disallow /remember.php
Disallow /redirect.php
Disallow /detailFrame.php
Disallow /detailFrame.php*
Disallow /frameDetailTop.php
Disallow /frameDetailTop.php*
Disallow /toolbar.php
Disallow /toolbar.php*
Disallow /Kooperationspartner/
Disallow /suchtipps.php
Disallow /usuchtipps.php
Disallow /druckenextern_neu.php
Disallow /problemreport.php
Disallow /Firma/Drucken/
Disallow /Firma/bearbeiten/
Disallow /Firma/loeschen/
Disallow /Firma/bestaetigen/
Disallow /stellenanzeigen/index.php?page=bj-news*
Disallow /homepage.php
Disallow /stellengesuche/suche.html
Disallow /lehrstellen/berufsinformationen/
Disallow /suche.html
Disallow /suche.html*
Disallow /jobsuche.html
Disallow /jobsuche.html*
Disallow /aushilfen/suche.html
Disallow /aushilfen/suche.html*
Disallow /international/suche.html
Disallow /international/suche.html*
Disallow /lehrstellen/suche.html
Disallow /lehrstellen/suche.html*
Disallow /praktikum/suche.html
Disallow /praktikum/suche.html*
Disallow /pdf.php
Disallow /pdf.php*
Disallow /jobfilter/
Disallow /jobfilter/*

mediapartners-google

Rule Path
Disallow /detailFrame.php
Disallow /detailFrame.php*
Disallow /redirect.php
Disallow /redirect.php*
Disallow /toolbar.php
Disallow /toolbar.php*

bingbot

Rule Path
Disallow /remember.php
Disallow /redirect.php
Disallow /detailFrame.php
Disallow /detailFrame.php*
Disallow /frameDetailTop.php
Disallow /frameDetailTop.php*
Disallow /toolbar.php
Disallow /toolbar.php*
Disallow /Kooperationspartner/
Disallow /suchtipps.php
Disallow /usuchtipps.php
Disallow /druckenextern_neu.php
Disallow /problemreport.php
Disallow /Firma/Drucken/
Disallow /Firma/bearbeiten/
Disallow /Firma/loeschen/
Disallow /Firma/bestaetigen/
Disallow /stellenanzeigen/index.php?page=bj-news*
Disallow /homepage.php
Disallow /stellengesuche/suche.html
Disallow /lehrstellen/berufsinformationen/
Disallow /suche.html
Disallow /suche.html*
Disallow /jobsuche.html
Disallow /jobsuche.html*
Disallow /aushilfen/suche.html
Disallow /aushilfen/suche.html*
Disallow /international/suche.html
Disallow /international/suche.html*
Disallow /lehrstellen/suche.html
Disallow /lehrstellen/suche.html*
Disallow /praktikum/suche.html
Disallow /praktikum/suche.html*
Disallow /pdf.php
Disallow /pdf.php*
Disallow /jobfilter/
Disallow /jobfilter/*

Other Records

Field Value
crawl-delay 2

sistrix

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /arbeitgeber/firmenlogos/
Disallow /arbeitgeber/firmenlogos/*

msnbot-media

Rule Path
Disallow /arbeitgeber/firmenlogos/
Disallow /arbeitgeber/firmenlogos/*

psbot

Rule Path
Disallow /arbeitgeber/firmenlogos/
Disallow /arbeitgeber/firmenlogos/*

magpie-crawler

Rule Path
Disallow /arbeitgeber/firmenlogos/
Disallow /arbeitgeber/firmenlogos/*

yandeximages

Rule Path
Disallow /arbeitgeber/firmenlogos/
Disallow /arbeitgeber/firmenlogos/*

yandexmedia

Rule Path
Disallow /arbeitgeber/firmenlogos/
Disallow /arbeitgeber/firmenlogos/*

yahoo-mmcrawler

Rule Path
Disallow /arbeitgeber/firmenlogos/
Disallow /arbeitgeber/firmenlogos/*

tineye

Rule Path
Disallow /arbeitgeber/firmenlogos/
Disallow /arbeitgeber/firmenlogos/*

baiduspider-image

Rule Path
Disallow /arbeitgeber/firmenlogos/
Disallow /arbeitgeber/firmenlogos/*

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

gigabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

teoma

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

bleriot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

sistrix

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mtrobot

Rule Path
Disallow /

femtosearchbot

Rule Path
Disallow /

bingpreview

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /