bureauvet.nl
robots.txt
Robots Exclusion Standard data for bureauvet.nl
Resource Scan
Scan Details
| Site Domain | bureauvet.nl |
| Base Domain | bureauvet.nl |
| Scan Status | Ok |
| Last Scan | 2024-10-21T20:17:09+00:00 |
| Next Scan | 2024-11-20T20:17:09+00:00 |
Last Scan
| Scanned | 2024-10-21T20:17:09+00:00 |
| URL | https://bureauvet.nl/robots.txt |
| Redirect | https://www.brightdigital.com/robots.txt |
| Redirect Domain | www.brightdigital.com |
| Redirect Base | brightdigital.com |
| Domain IPs | 199.60.103.10, 199.60.103.110 |
| Redirect IPs | 199.60.103.226, 199.60.103.30, 2606:2c40::c73c:671e, 2606:2c40::c73c:67e2 |
| Response IP | 199.60.103.226 |
| Found | Yes |
| Hash | 7a7650c3282c5a712e3de970702beacfb5a5a19f0177e9d4499e4d697afb92f4 |
| SimHash | be96cea1ecbb |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /sample-* |
| Disallow | /blog/sample-* |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /nl/blog/tag/* |
| Disallow | /en/blog/tag/* |
| Disallow | /nl/blog/author/* |
| Disallow | /en/blog/author/* |
| Disallow | /nl/blog/page/* |
| Disallow | /en/blog/page/* |
| Disallow | /nl/privacyverklaring |
| Disallow | /en/privacy |
| Disallow | /hs/preferences-center/ |
| Disallow | /*?*hs_preview=* |
| Disallow | /*?*hsCacheBuster=* |
cazoodlebot
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /hs/preferences-center/ |
| Disallow | /*?*hs_preview=* |
| Disallow | /*?*hsCacheBuster=* |
dotbot
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /hs/preferences-center/ |
| Disallow | /*?*hs_preview=* |
| Disallow | /*?*hsCacheBuster=* |
gigabot
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /hs/preferences-center/ |
| Disallow | /*?*hs_preview=* |
| Disallow | /*?*hsCacheBuster=* |
fasterfox
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /hs/preferences-center/ |
| Disallow | /*?*hs_preview=* |
| Disallow | /*?*hsCacheBuster=* |
baiduspider
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /hs/preferences-center/ |
| Disallow | /*?*hs_preview=* |
| Disallow | /*?*hsCacheBuster=* |
yandexbot
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /hs/preferences-center/ |
| Disallow | /*?*hs_preview=* |
| Disallow | /*?*hsCacheBuster=* |
jyxobot
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /hs/preferences-center/ |
| Disallow | /*?*hs_preview=* |
| Disallow | /*?*hsCacheBuster=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.brightdigital.com/sitemap.xml |
Comments