jagermodelspoor.nl
robots.txt

Robots Exclusion Standard data for jagermodelspoor.nl

Resource Scan

Scan Details

Site Domain jagermodelspoor.nl
Base Domain jagermodelspoor.nl
Scan Status Ok
Last Scan2025-12-08T21:15:30+00:00
Next Scan 2026-01-07T21:15:30+00:00

Last Scan

Scanned2025-12-08T21:15:30+00:00
URL https://jagermodelspoor.nl/robots.txt
Redirect https://www.jagermodelspoor.nl/robots.txt
Redirect Domain www.jagermodelspoor.nl
Redirect Base jagermodelspoor.nl
Domain IPs 104.26.4.103, 104.26.5.103, 172.67.71.254, 2606:4700:20::681a:467, 2606:4700:20::681a:567, 2606:4700:20::ac43:47fe
Redirect IPs 104.26.4.103, 104.26.5.103, 172.67.71.254, 2606:4700:20::681a:467, 2606:4700:20::681a:567, 2606:4700:20::ac43:47fe
Response IP 104.26.5.103
Found Yes
Hash a64fcbb1a4908ef9f32db0b26d887f9e5cced4a1f4a629d39fe0d4c5cf23c354
SimHash 441fc571dc99

Groups

*

Rule Path
Allow /
Disallow /cart/
Disallow /checkout/
Disallow /customer/*
Disallow /search/

Other Records

Field Value
crawl-delay 30

ahrefsbot
alphabot
baiduspider
barkrowler
blexbot
cazoodlebot
dotbot
exabot
gigabot
go-http-client
imagesiftbot
jyxobot
magpie-crawler
mail.ru_bot
mauibot
mj12bot
node/simplecrawler
nuclei
petalbot
riddler
semrushbot
sitegurucrawler
vagabondo
wikido
zoominfobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.jagermodelspoor.nl/rss/