bestecanvas.nl
robots.txt

Robots Exclusion Standard data for bestecanvas.nl

Resource Scan

Scan Details

Site Domain bestecanvas.nl
Base Domain bestecanvas.nl
Scan Status Ok
Last Scan2024-05-31T12:43:35+00:00
Next Scan 2024-06-30T12:43:35+00:00

Last Scan

Scanned2024-05-31T12:43:35+00:00
URL https://bestecanvas.nl/robots.txt
Redirect https://www.bestecanvas.nl/robots.txt
Redirect Domain www.bestecanvas.nl
Redirect Base bestecanvas.nl
Domain IPs 108.156.133.101, 108.156.133.111, 108.156.133.16, 108.156.133.91
Redirect IPs 108.156.133.101, 108.156.133.111, 108.156.133.16, 108.156.133.91, 2600:9000:2755:1800:4:6c59:7140:93a1, 2600:9000:2755:3a00:4:6c59:7140:93a1, 2600:9000:2755:6c00:4:6c59:7140:93a1, 2600:9000:2755:9e00:4:6c59:7140:93a1, 2600:9000:2755:c200:4:6c59:7140:93a1, 2600:9000:2755:d000:4:6c59:7140:93a1, 2600:9000:2755:d200:4:6c59:7140:93a1, 2600:9000:2755:fe00:4:6c59:7140:93a1
Response IP 108.156.133.91
Found Yes
Hash ccb69f3f29c79cbf519514bab6580db5ce309e31494b10d554cdee7f4ccd6562
SimHash 587979e77516

Groups

*

Rule Path
Disallow *.pdf
Allow *.css
Allow *.js
Allow *.png
Allow *.jpg
Allow /java/
Allow /banner/
Allow /css/
Allow /staticimages/
Allow /jquery/

googlebot

Rule Path
Disallow *.pdf
Allow *.css
Allow *.js
Allow *.png
Allow *.jpg
Allow /java/
Allow /banner/
Allow /css/
Allow /staticimages/
Allow /jquery/

googlebot-mobile

Rule Path
Disallow *.pdf
Allow *.css
Allow *.js
Allow *.png
Allow *.jpg
Allow /java/
Allow /banner/
Allow /css/
Allow /staticimages/
Allow /jquery/