bronzenbeeldenwinkel.nl
robots.txt

Robots Exclusion Standard data for bronzenbeeldenwinkel.nl

Resource Scan

Scan Details

Site Domain bronzenbeeldenwinkel.nl
Base Domain bronzenbeeldenwinkel.nl
Scan Status Ok
Last Scan2024-09-10T14:41:15+00:00
Next Scan 2024-10-10T14:41:15+00:00

Last Scan

Scanned2024-09-10T14:41:15+00:00
URL https://bronzenbeeldenwinkel.nl/robots.txt
Redirect https://www.bronzenbeeldenwinkel.nl/robots.txt
Redirect Domain www.bronzenbeeldenwinkel.nl
Redirect Base bronzenbeeldenwinkel.nl
Domain IPs 104.25.115.40, 104.25.116.40, 172.67.99.152, 2606:4700:20::6819:7328, 2606:4700:20::6819:7428, 2606:4700:20::ac43:6398
Redirect IPs 104.25.115.40, 104.25.116.40, 172.67.99.152, 2606:4700:20::6819:7328, 2606:4700:20::6819:7428, 2606:4700:20::ac43:6398
Response IP 104.25.116.40
Found Yes
Hash 093a9e050d8b36ccc49c77b8e1b4a4c59f2a72d290975397e8be1211c45bcbf1
SimHash 4617d471dc91

Groups

*

Rule Path
Allow /
Disallow /cart/
Disallow /checkout/
Disallow /customer/*
Disallow /search/

Other Records

Field Value
crawl-delay 30

ahrefsbot
alphabot
baiduspider
barkrowler
blexbot
cazoodlebot
dotbot/1.0
exabot
gigabot
go-http-client
jyxobot
magpie-crawler
mail.ru_bot
mauibot
mj12bot
node/simplecrawler
nuclei
petalbot
riddler
semrushbot
vagabondo
wikido
zoominfobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bronzenbeeldenwinkel.nl/rss/