openjob.ch
robots.txt

Robots Exclusion Standard data for openjob.ch

Resource Scan

Scan Details

Site Domain openjob.ch
Base Domain openjob.ch
Scan Status Ok
Last Scan2024-09-25T21:26:20+00:00
Next Scan 2024-10-02T21:26:20+00:00

Last Scan

Scanned2024-09-25T21:26:20+00:00
URL https://openjob.ch/robots.txt
Redirect https://www.openjob.ch/robots.txt
Redirect Domain www.openjob.ch
Redirect Base openjob.ch
Domain IPs 2001:1600:4:13:d294:66ff:fe7d:73c4, 83.166.138.122
Redirect IPs 2001:1600:4:13:d294:66ff:fe7d:73c4, 83.166.138.122
Response IP 83.166.138.122
Found Yes
Hash 73ccdeae37833f36400432140f5361c54e19699238fddd551be5c7623efd0330
SimHash c1147e51c4d0

Groups

*

Rule Path
Disallow /?mode=about&action=conditions
Disallow /?mode=about&action=privacy
Disallow /about/conditions
Disallow /about/privacy

Other Records

Field Value
crawl-delay 2

iccrawler - icjobs

Rule Path
Disallow /

jobboersebot

Rule Path
Disallow /

iccrawler-icjobs

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /*sid%3D

adidxbot

Rule Path
Allow /*sid%3D

googlebot-image

Rule Path
Disallow /trendgraph/*

msnbot-media

Rule Path
Disallow /trendgraph/*

jobdiggerspider

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.openjob.ch/sitemap.php

Warnings

  • 2 invalid lines.