mensenlinq.nl
robots.txt

Robots Exclusion Standard data for mensenlinq.nl

Resource Scan

Scan Details

Site Domain mensenlinq.nl
Base Domain mensenlinq.nl
Scan Status Ok
Last Scan2024-11-15T14:39:30+00:00
Next Scan 2024-11-22T14:39:30+00:00

Last Scan

Scanned2024-11-15T14:39:30+00:00
URL https://mensenlinq.nl/robots.txt
Domain IPs 104.18.10.136, 104.18.11.136, 2606:4700::6812:a88, 2606:4700::6812:b88
Response IP 104.18.11.136
Found Yes
Hash 366191681a0af95a1e21612ff966140418b2a09c7618a060f80490483ea38761
SimHash 6015dc44779b

Groups

*

Rule Path
Disallow

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

obot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600

grapeshotcrawler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600

proximic

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600