cibworld.nl
robots.txt

Robots Exclusion Standard data for cibworld.nl

Resource Scan

Scan Details

Site Domain cibworld.nl
Base Domain cibworld.nl
Scan Status Ok
Last Scan2025-05-26T14:29:44+00:00
Next Scan 2025-06-25T14:29:44+00:00

Last Scan

Scanned2025-05-26T14:29:44+00:00
URL https://cibworld.nl/robots.txt
Redirect https://www.cibworld.nl/robots.txt
Redirect Domain www.cibworld.nl
Redirect Base cibworld.nl
Domain IPs 104.21.42.120, 172.67.161.218, 2606:4700:3031::ac43:a1da, 2606:4700:3036::6815:2a78
Redirect IPs 104.21.42.120, 172.67.161.218, 2606:4700:3031::ac43:a1da, 2606:4700:3036::6815:2a78
Response IP 104.21.42.120
Found Yes
Hash 8f9177c527716c5cdb658925fd0ca5114163e41fbe71bac4b4d3c5c84442c8ff
SimHash 001dc0c2cbb2

Groups

cliqzbot

Rule Path
Disallow /

iria

Rule Path
Disallow /

alphabot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

ahrefsbot/6.1

Rule Path
Disallow /

queryn

Rule Path
Disallow /

semrushbot/1.1~bl

Rule Path
Disallow /

downloader

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

mag-net

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mixrankbot

Rule Path
Disallow /

*

Rule Path
Disallow /browse
Disallow /wp-admin/
Disallow /_qa/
Disallow /show/*
Allow /wp-admin/admin-ajax.php