loesje.nl
robots.txt

Robots Exclusion Standard data for loesje.nl

Resource Scan

Scan Details

Site Domain loesje.nl
Base Domain loesje.nl
Scan Status Ok
Last Scan2024-09-25T01:21:44+00:00
Next Scan 2024-10-25T01:21:44+00:00

Last Scan

Scanned2024-09-25T01:21:44+00:00
URL https://loesje.nl/robots.txt
Redirect https://www.loesje.nl/robots.txt
Redirect Domain www.loesje.nl
Redirect Base loesje.nl
Domain IPs 75.2.60.5, 99.83.231.61
Redirect IPs 13.228.199.255, 13.251.96.10, 2406:da18:880:3802::c8, 2406:da18:b3d:e201::64
Response IP 46.137.195.11
Found Yes
Hash 31db7cb8a195ed0363ed51fe597eb2d5897027890aff04c4e30772e762cc0717
SimHash 541c5b50e480

Groups

adsbot-google
amazonbot
anthropic-ai
applebot
awariorssbot
awariosmartbot
bytespider
ccbot
chatgpt-user
claudebot
claude-web
cohere-ai
dataforseobot
facebookbot
google-extended
googleother
gptbot
imagesiftbot
magpie-crawler
omgili
omgilibot
peer39_crawler
peer39_crawler/1.0
perplexitybot
youbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.loesje.nl/sitemap_index.xml