deloox.nl
robots.txt

Robots Exclusion Standard data for deloox.nl

Resource Scan

Scan Details

Site Domain deloox.nl
Base Domain deloox.nl
Scan Status Ok
Last Scan2024-11-01T18:04:34+00:00
Next Scan 2024-12-01T18:04:34+00:00

Last Scan

Scanned2024-11-01T18:04:34+00:00
URL https://deloox.nl/robots.txt
Redirect https://www.deloox.nl/robots.txt
Redirect Domain www.deloox.nl
Redirect Base deloox.nl
Domain IPs 87.233.198.107
Redirect IPs 87.233.198.107
Response IP 87.233.198.107
Found Yes
Hash 374c892c6ba1b97c010491bdfedcee451f3c57d54671868d783ad7af3a879be2
SimHash 284ad830c273

Groups

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

yahoo! slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

thesis-research-bot

Rule Path
Disallow /