Log In Sign Up

finalwebsites.nl
robots.txt

Robots Exclusion Standard data for finalwebsites.nl

Resource Scan

Scan Details

Site Domain finalwebsites.nl
Base Domain finalwebsites.nl
Scan Status Ok
Last Scan2025-09-01T03:22:06+00:00
Next Scan 2025-09-15T03:22:06+00:00

Last Scan

Scanned2025-09-01T03:22:06+00:00
URL https://finalwebsites.nl/robots.txt
Redirect https://www.finalwebsites.nl/robots.txt
Redirect Domain www.finalwebsites.nl
Redirect Base finalwebsites.nl
Domain IPs 2a03:4000:69:9ff:a4cd:f6ff:fe9f:bba8, 89.58.52.41
Redirect IPs 2a03:4000:69:9ff:a4cd:f6ff:fe9f:bba8, 89.58.52.41
Response IP 89.58.52.41
Found Yes
Hash 38e7392c8566f05af82bc9ec411d53f9c664225e315d9d2cf04569db107c5d30
SimHash c92d9a302c82

Groups

inetdex-bot
barkrowler
updownerbot
ahrefsbot
mj12bot
semrushbot
seznambot
olbicobot
baiduspider

Rule Path
Disallow /

*

Rule Path
Disallow /out/
Disallow *.txt
Disallow *.html
Disallow *.pdf
Disallow */feed/
Disallow /wp-admin/admin-ajax.php
Back to top

Other Records

Field Value
sitemap https://www.finalwebsites.nl/sitemap_index.xml
Back to top