kernmetpit.nl
robots.txt

Robots Exclusion Standard data for kernmetpit.nl

Resource Scan

Scan Details

Site Domain kernmetpit.nl
Base Domain kernmetpit.nl
Scan Status Ok
Last Scan2025-10-03T07:44:09+00:00
Next Scan 2025-10-17T07:44:09+00:00

Last Scan

Scanned2025-10-03T07:44:09+00:00
URL https://kernmetpit.nl/robots.txt
Domain IPs 5.22.248.122
Response IP 5.22.248.122
Found Yes
Hash 049659049c00acdf818f4f2949d3e8eab9ccd12e326f3bbdec9c8081131b3174
SimHash 131c8040bb92

Groups

*

Rule Path
Disallow /shortcuts/
Allow /shortcuts/*.gif$
Allow /shortcuts/*.jpg$
Allow /shortcuts/*.jpeg$
Allow /shortcuts/*.png$

adscanner bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bytedance

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

guzzlehttp

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot/3~bl

Rule Path
Disallow /

timpi

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.kernmetpit.nl/sitemap.xml