tom-bv.com
robots.txt
Robots Exclusion Standard data for tom-bv.com
Resource Scan
Scan Details
| Site Domain | tom-bv.com |
| Base Domain | tom-bv.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-07-17T01:33:27+00:00 |
| Next Scan | 2024-10-15T01:33:27+00:00 |
Last Successful Scan
| Scanned | 2022-12-02T01:06:36+00:00 |
| URL | https://tom-bv.com/robots.txt |
| Redirect | https://www.internet-bikes.com/robots.txt |
| Redirect Domain | www.internet-bikes.com |
| Redirect Base | internet-bikes.com |
| Domain IPs | 213.171.135.165 |
| Redirect IPs | 213.214.121.169 |
| Response IP | 213.214.121.169 |
| Found | Yes |
| Hash | ed11f396037c0c08970fb7878681081ecb74f2db75400c8a9c2f073735cc6443 |
| SimHash | 2e89122abf90 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /factuur/ |
| Disallow | /facturen/ |
| Disallow | /inc/ |
| Disallow | /onestepcheckout/ |
| Disallow | /wensenlijst/ |
| Disallow | /winkelwagen/ |
| Disallow | /wachtwoordreset/ |
| Disallow | /account/ |
| Disallow | /referenties/ |
| Disallow | /zoek-cadeau/* |
| Disallow | /m/zoek-cadeau/* |
| Disallow | /en/find-gift/* |
| Disallow | /m/en/find-gift/* |
| Disallow | /de/such-geschenk/* |
| Disallow | /m/de/such-geschenk/* |
| Disallow | /fr/cherche-cadeaux/* |
| Disallow | /m/fr/cherche-cadeaux/* |
| Disallow | /zoeken/?search=* |
| Disallow | /zoeken/*/?search=* |
| Disallow | /zoeken/*/*/?search=* |
| Disallow | /de/suchen/?search=* |
| Disallow | /en/search/*/?search=* |
| Disallow | /en/search/*/*/?search=* |
| Disallow | /en/search/?search=* |
| Disallow | /de/suchen/*/?search=* |
| Disallow | /de/suchen/*/*/?search=* |
| Disallow | /responsibledisclosure/ |
| Disallow | /responsible-disclosure/ |
| Disallow | /en/security/ |
| Disallow | /de/security/ |
| Disallow | /fr/security/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.internet-bikes.com/sitemap.xml |
| sitemap | https://www.internet-toys.com/sitemap.xml |
| sitemap | https://www.internet-sportclubs.com/sitemap.xml |
| sitemap | https://www.internet-sportandcasuals.com/sitemap.xml |
| sitemap | https://www.internet-automotive.com/sitemap.xml |
| sitemap | https://www.internet-eyewear.com/sitemap.xml |
| sitemap | https://www.internet-bookshop.com/sitemap.xml |
| sitemap | https://www.internet-babyshop.com/sitemap.xml |
| sitemap | https://www.internet-outdoorshop.com/sitemap.xml |
| sitemap | https://www.internet-homeandgarden.com/sitemap.xml |
| sitemap | https://www.internet-partyshop.com/sitemap.xml |
| sitemap | https://www.twm-bv.com/sitemap.xml |
| sitemap | https://www.giga-bikes.nl/sitemap.xml |