accentjobs.be
robots.txt

Robots Exclusion Standard data for accentjobs.be

Resource Scan

Scan Details

Site Domain accentjobs.be
Base Domain accentjobs.be
Scan Status Ok
Last Scan2024-11-01T15:20:04+00:00
Next Scan 2024-12-01T15:20:04+00:00

Last Scan

Scanned2024-11-01T15:20:04+00:00
URL https://accentjobs.be/robots.txt
Domain IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash 0f1745de8bb10c19848af6f01948391bc6913714d19900a8823e24ecf7f87f36
SimHash c50cd927ead0

Groups

baiduspider
baiduspider-image
baiduspider-video
yandexbot
jobdiggerspider
cliqzbot
ia_archiver
omniexplorer_bot

Rule Path
Disallow *

*

Rule Path
Allow /
Disallow /nl/my-accent
Disallow /fr/my-accent
Disallow /en/my-accent
Disallow /node/*
Disallow /nl/vacancy*
Disallow /nl/offredemploi*
Disallow /fr/vacature*
Disallow /fr/vacancy*
Disallow /en/vacature*
Disallow /en/offredemploi*

Other Records

Field Value
sitemap https://accentjobs.be/sitemap.xml

Warnings

  • 1 invalid line.