opleiding.com
robots.txt

Robots Exclusion Standard data for opleiding.com

Resource Scan

Scan Details

Site Domain opleiding.com
Base Domain opleiding.com
Scan Status Ok
Last Scan2025-09-15T21:21:16+00:00
Next Scan 2025-09-22T21:21:16+00:00

Last Scan

Scanned2025-09-15T21:21:16+00:00
URL https://opleiding.com/robots.txt
Domain IPs 149.210.166.118
Response IP 149.210.166.118
Found Yes
Hash c943b3b674780db2ad3168bfc93579e5aa917461c4b0b3a1f322142ff83aac21
SimHash 6b11d011c531

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow /api/
Disallow /bekijk/

cazoodlebot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

teracent-feed-processing

Rule Path
Disallow /

ingrid

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

jyxobot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

yahoo! slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://opleiding.com/sitemap.xml