halder.com
robots.txt
Robots Exclusion Standard data for halder.com
Resource Scan
Scan Details
| Site Domain | halder.com |
| Base Domain | halder.com |
| Scan Status | Ok |
| Last Scan | 2024-10-23T05:35:31+00:00 |
| Next Scan | 2024-11-22T05:35:31+00:00 |
Last Scan
| Scanned | 2024-10-23T05:35:31+00:00 |
| URL | https://halder.com/robots.txt |
| Redirect | https://www.halder.com/robots.txt |
| Redirect Domain | www.halder.com |
| Redirect Base | halder.com |
| Domain IPs | 185.110.152.174 |
| Redirect IPs | 18.155.68.113, 18.155.68.6, 18.155.68.77, 18.155.68.80, 2600:9000:23d2:4600:c:ff8c:b7c0:93a1, 2600:9000:23d2:4e00:c:ff8c:b7c0:93a1, 2600:9000:23d2:5200:c:ff8c:b7c0:93a1, 2600:9000:23d2:5a00:c:ff8c:b7c0:93a1, 2600:9000:23d2:b600:c:ff8c:b7c0:93a1, 2600:9000:23d2:c600:c:ff8c:b7c0:93a1, 2600:9000:23d2:d800:c:ff8c:b7c0:93a1, 2600:9000:23d2:e800:c:ff8c:b7c0:93a1 |
| Response IP | 18.155.68.80 |
| Found | Yes |
| Hash | db55cdb0331acc3f87259335a1bb174a65948097ad8bfd41388f04383989b704 |
| SimHash | 1d190192af32 |
Groups
webreaper
webcopier
offline explorer
httrack
microsoft.url.control
emailcollector
penthesilea
mj12bot
ahrefsbot
semrushbot
dotbot
mauibot
petalbot
blexbot
| Rule | Path |
|---|---|
| Disallow | / |
googlebot
| Rule | Path |
|---|---|
| Allow | /pf-fragment* |
| Allow | */content/search/* |
| Allow | */preference/ |
| Allow | */preferences/* |
| Allow | */switchlanguage/* |
| Allow | */ix-wishlist/add-related-object/* |
| Disallow | /user-account* |
| Disallow | /admin* |
| Disallow | /administration* |
| Disallow | /ngadminui* |
| Disallow | */view/content/ |
| Disallow | */class/ |
| Disallow | */Users/ |
| Disallow | /tags* |
| Disallow | /extranet* |
| Disallow | */wishlist-detail* |
| Disallow | /pf-fragment* |
| Disallow | */content/search/* |
| Disallow | */preference/ |
| Disallow | */preferences/* |
| Disallow | */switchlanguage/* |
| Disallow | */ix-wishlist/add-related-object/* |
| Disallow | */teaser-content* |
| Disallow | */link-content* |
| Disallow | */contacts* |
*
| Rule | Path |
|---|---|
| Disallow | /user-account* |
| Disallow | /admin* |
| Disallow | /administration* |
| Disallow | /ngadminui* |
| Disallow | */view/content/ |
| Disallow | */class/ |
| Disallow | */Users/ |
| Disallow | /tags* |
| Disallow | /extranet* |
| Disallow | */wishlist-detail* |
| Disallow | /pf-fragment* |
| Disallow | */content/search/* |
| Disallow | */preference/ |
| Disallow | */preferences/* |
| Disallow | */switchlanguage/* |
| Disallow | */ix-wishlist/add-related-object/* |
| Disallow | */teaser-content* |
| Disallow | */link-content* |
| Disallow | */contacts* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.halder.com/sitemap.xml |
| sitemap | https://www.halderusa.com/sitemap.xml |
| sitemap | https://www.halder.fr/sitemap.xml |
Comments