en-us.sennheiser.com
robots.txt
Robots Exclusion Standard data for en-us.sennheiser.com
Resource Scan
Scan Details
Site Domain | en-us.sennheiser.com |
Base Domain | sennheiser.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-13T06:56:03+00:00 |
Next Scan | 2024-12-12T06:56:03+00:00 |
Last Successful Scan
Scanned | 2024-07-22T23:51:41+00:00 |
URL | https://en-us.sennheiser.com/robots.txt |
Domain IPs | 104.16.205.2, 104.16.206.2, 2606:4700::6810:cd02, 2606:4700::6810:ce02 |
Response IP | 104.16.206.2 |
Found | Yes |
Hash | 3defd75fc55d52c4775fccdeae957c702807afe419db267ecf63ab67cefc28e2 |
SimHash | 2e551d93e6d9 |
Groups
adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
adidxbot
applebot
applenewsbot
baiduspider
baiduspider-image
bingbot
bingpreview
bublupbot
ccbot
cliqzbot
coccoc
coccocbot-image
coccocbot-web
daumoa
dazoobot
deusu
duckduckbot
duckduckgo-favicons-bot
euripbot
exploratodo
facebot
feedly
findxbot
googlebot
googlebot-image
googlebot-mobile
googlebot-news
googlebot-video
haosouspider
ichiro
istellabot
jikespider
lycos
mail.ru
mediapartners-google
mojeekbot
msnbot
msnbot-media
optimizer
orangebot
pinterest
plukkie
qwantify
rambler
rytebot
screaming frog seo spider
semrushbot
seznambot
sosospider
slurp
sogou blog
sogou inst spider
sogou news spider
sogou orion spider
sogou spider2
sogou web spider
sputnikbot
teoma
twitterbot
wotbox
yacybot
yandex
yandexmobilebot
yeti
yioopbot
yoozbot
youdaobot
siteauditbot
Rule | Path |
---|---|
Disallow | /ajax |
Disallow | /api |
Disallow | /downloads/download/file/5520/Facebook_Sweepstakes_Official_Rules.pdf |
Disallow | /downloads/download/file/5521/Instagram_Terms_and_Conditions.pdf |
Disallow | /downloads/download/file/5521/Instagram_Terms_and_Conditions.pdf |
Disallow | /pricelists |
Disallow | /pricelists-neumann-excel-files |
Disallow | /pricelists-neumann-pdf-files |
Disallow | /pricelists-sennheiser-excel-files |
Disallow | /pricelists-sennheiser-pdf-files |
Disallow | /pricelists-third-party-pdf-files |
Disallow | /search |
Disallow | /sku |
Disallow | /v4r |
Disallow |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
*
Rule | Path |
---|---|
Disallow | / |
Warnings
- 3 invalid lines.
Comments