zwembaden4fun.nl
robots.txt

Robots Exclusion Standard data for zwembaden4fun.nl

Resource Scan

Scan Details

Site Domain zwembaden4fun.nl
Base Domain zwembaden4fun.nl
Scan Status Ok
Last Scan2024-05-09T03:57:21+00:00
Next Scan 2024-06-08T03:57:21+00:00

Last Scan

Scanned2024-05-09T03:57:21+00:00
URL https://zwembaden4fun.nl/robots.txt
Redirect https://www.zwembaden4fun.nl/robots.txt
Redirect Domain www.zwembaden4fun.nl
Redirect Base zwembaden4fun.nl
Domain IPs 104.26.6.111, 104.26.7.111, 172.67.74.38, 2606:4700:20::681a:66f, 2606:4700:20::681a:76f, 2606:4700:20::ac43:4a26
Redirect IPs 104.26.6.111, 104.26.7.111, 172.67.74.38, 2606:4700:20::681a:66f, 2606:4700:20::681a:76f, 2606:4700:20::ac43:4a26
Response IP 172.67.74.38
Found Yes
Hash 2fbca8b215feb2b3b3260856a2edff5dcc1bf3978afb3256115cc4c4ced3012f
SimHash 601959f0ce91

Groups

*

Rule Path
Allow /
Disallow /cart/
Disallow /checkout/
Disallow /customer/*
Disallow /search/

Other Records

Field Value
crawl-delay 30

alphabot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.zwembaden4fun.nl/rss/