accentjobs.be
robots.txt
Robots Exclusion Standard data for accentjobs.be
Resource Scan
Scan Details
Site Domain | accentjobs.be |
Base Domain | accentjobs.be |
Scan Status | Ok |
Last Scan | 2024-11-01T15:20:04+00:00 |
Next Scan | 2024-12-01T15:20:04+00:00 |
Last Scan
Scanned | 2024-11-01T15:20:04+00:00 |
URL | https://accentjobs.be/robots.txt |
Domain IPs | 13.107.246.59, 2620:1ec:bdf::59 |
Response IP | 13.107.246.59 |
Found | Yes |
Hash | 0f1745de8bb10c19848af6f01948391bc6913714d19900a8823e24ecf7f87f36 |
SimHash | c50cd927ead0 |
Groups
baiduspider
baiduspider-image
baiduspider-video
yandexbot
jobdiggerspider
cliqzbot
ia_archiver
omniexplorer_bot
Rule | Path |
---|---|
Disallow | * |
*
Rule | Path |
---|---|
Allow | / |
Disallow | /nl/my-accent |
Disallow | /fr/my-accent |
Disallow | /en/my-accent |
Disallow | /node/* |
Disallow | /nl/vacancy* |
Disallow | /nl/offredemploi* |
Disallow | /fr/vacature* |
Disallow | /fr/vacancy* |
Disallow | /en/vacature* |
Disallow | /en/offredemploi* |
Other Records
Field | Value |
---|---|
sitemap | https://accentjobs.be/sitemap.xml |
Warnings
- 1 invalid line.