jobrapido.de
robots.txt

Robots Exclusion Standard data for jobrapido.de

Resource Scan

Scan Details

Site Domain jobrapido.de
Base Domain jobrapido.de
Scan Status Ok
Last Scan2024-09-22T17:49:56+00:00
Next Scan 2024-09-29T17:49:56+00:00

Last Scan

Scanned2024-09-22T17:49:56+00:00
URL http://jobrapido.de/robots.txt
Redirect https://de.jobrapido.com/robots.txt
Redirect Domain de.jobrapido.com
Redirect Base jobrapido.com
Domain IPs 35.205.208.203
Redirect IPs 34.111.124.179
Response IP 34.111.124.179
Found Yes
Hash 6186b341afe97d57e631c60f1c4bb708ed5c09f207d55391747d7a135edd7351
SimHash 1c399bd4bbb0

Groups

*

Rule Path
Disallow /*?*&o=*
Disallow /*?o=*
Disallow /*?*&l=*
Disallow /*?l=*
Disallow /*?*&q=*
Disallow /*?q=*
Disallow /*?*&w=*
Disallow /*?w=*
Disallow /*?*&r=*
Disallow /*?r=*
Disallow /job/*
Disallow /jobpreview/*
Disallow /empleo/*
Disallow /trabajo/*
Disallow /info/privacy-policy
Disallow /images
Disallow /banners
Disallow /download
Disallow /track
Disallow /browserevent/*
Disallow /*?*&sortby=*
Disallow /*?sortby=*
Disallow *?ft=*

adidxbot

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

googlebot
bingbot
yandex
seznambot

Rule Path
Disallow /*?*&o=*
Disallow /*?o=*
Disallow /*?*&l=*
Disallow /*?l=*
Disallow /*?*&q=*
Disallow /*?q=*
Disallow /*?*&w=*
Disallow /*?w=*
Disallow /*?*&r=*
Disallow /*?r=*
Disallow /job/*
Disallow /empleo/*
Disallow /trabajo/*
Disallow /info/privacy-policy
Disallow /images
Disallow /banners
Disallow /download
Disallow /track
Disallow /browserevent/*
Disallow /*?*&sortby=*
Disallow /*?sortby=*
Disallow *?ft=*
Disallow /*?*&s=*
Disallow /*?s=*
Disallow /sitemap/suggestedjobtitles/
Disallow /sitemap/relatedlocations/
Disallow /sitemap/topjobtitles/
Disallow /info_/
Disallow /login
Disallow /signup
Disallow /favouritejobs
Disallow /info/contact-terms-registration
Disallow /info/privacy-policy-registration
Disallow /recoverpassword
Disallow /blog/wp-login
Disallow /blog/wp-admin
Disallow /*?*&utm_agid=*
Disallow /*?utm_agid=*
Disallow /*?*&utm_kwid=*
Disallow /*?utm_kwid=*
Disallow /*?*&ft=*
Disallow /*?adwords*
Disallow /%3Fq%3D
Disallow /*?j=*
Disallow /media/