jobs-more.ch
robots.txt

Robots Exclusion Standard data for jobs-more.ch

Resource Scan

Scan Details

Site Domain jobs-more.ch
Base Domain jobs-more.ch
Scan Status Ok
Last Scan2024-09-29T16:31:14+00:00
Next Scan 2024-10-06T16:31:14+00:00

Last Scan

Scanned2024-09-29T16:31:14+00:00
URL https://jobs-more.ch/robots.txt
Domain IPs 80.74.154.6
Response IP 80.74.154.6
Found Yes
Hash ecc85b951178ab3da0495945e9211a07bca41a00dd0074f6c63bb03494cd7a13
SimHash c1165a53c3d0

Groups

*

Rule Path
Disallow /*?mode=about&action=conditions*
Disallow /*?mode=about&action=privacy*
Disallow /*about/conditions*
Disallow /*about/privacy*

Other Records

Field Value
crawl-delay 2

iccrawler - icjobs

Rule Path
Disallow /

iccrawler-icjobs

Rule Path
Disallow /

jobboersebot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

adidxbot

Rule Path
Allow /*sid%3D

msnbot-media

Rule Path
Disallow /

jobdiggerspider

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.jobs-more.ch/sitemap.php
sitemap https://www.jobs-more.ch/sitemap-de.php
sitemap https://www.jobs-more.ch/sitemap-es.php

Warnings

  • 2 invalid lines.