eurobikes.it
robots.txt

Robots Exclusion Standard data for eurobikes.it

Resource Scan

Scan Details

Site Domain eurobikes.it
Base Domain eurobikes.it
Scan Status Ok
Last Scan4/3/2025, 1:01:33 AM
Next Scan 5/3/2025, 1:01:33 AM

Last Scan

Scanned4/3/2025, 1:01:33 AM
URL https://eurobikes.it/robots.txt
Redirect https://www.eurobikes.it/robots.txt
Redirect Domain www.eurobikes.it
Redirect Base eurobikes.it
Domain IPs 104.26.12.14, 104.26.13.14, 172.67.71.161, 2606:4700:20::681a:c0e, 2606:4700:20::681a:d0e, 2606:4700:20::ac43:47a1
Redirect IPs 104.26.12.14, 104.26.13.14, 172.67.71.161, 2606:4700:20::681a:c0e, 2606:4700:20::681a:d0e, 2606:4700:20::ac43:47a1
Response IP 172.67.71.161
Found Yes
Hash a4b9b19363d8a4953931a541f57dc11a8ffb5b06cbe3e55009784a170dceabc1
SimHash 491d9732aec2

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /_next/image*

*

Rule Path Comment
Disallow /login -
Disallow /account -
Disallow /reset-password -
Disallow /reset-password/* -
Disallow /cart -
Disallow /cart/payment-ok -
Disallow /cart/payment-error -
Disallow /contact-us -
Disallow /moto/ -
Disallow /404 -
Disallow /500 -
Disallow /400 -
Disallow /financiacion-cetelem -
Disallow /finanzierung-cetelem -
Disallow /financing-cetelem -
Disallow /financement-cetelem -
Disallow /finanziamento-celebrit%C3%83 -
Disallow /financiamento-cetelem -
Disallow /cookies -
Disallow /legal -
Disallow /support -
Disallow /support *
Disallow /api/routes -
Disallow /api/routes/* -
Disallow /api/catalogue -
Disallow /api/catalogue/* -
Disallow /_next -
Disallow /_next/* -

bytespider

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.eurobikes.it/sitemap/sitemap.xml