aldoshoes.pt
robots.txt

Robots Exclusion Standard data for aldoshoes.pt

Resource Scan

Scan Details

Site Domain aldoshoes.pt
Base Domain aldoshoes.pt
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-25T15:48:48+00:00
Next Scan 2024-12-24T15:48:48+00:00

Last Successful Scan

Scanned2024-05-06T15:47:35+00:00
URL https://aldoshoes.pt/robots.txt
Domain IPs 185.15.20.150, 94.46.20.69
Response IP 94.46.20.69
Found Yes
Hash 24a4d8011469ec3b1b481629ee67e444cc87fe1a64fca63f317d9312025cabc3
SimHash e54194f0fb80

Groups

*

Rule Path
Disallow /public/*
Disallow /backoffice
Disallow /pt/login
Disallow /pt/login/*
Disallow /pt/pesquisa/*
Disallow /pt/carrinho/*
Disallow /pt/wishlist
Disallow /pt/promocoes/*
Disallow /pt/sugestoes/*
Disallow /pt/novidades/*
Disallow /es/login
Disallow /es/login/*
Disallow /es/busqueda/*
Disallow /es/cesta/*
Disallow /es/wishlist
Disallow /es/promociones/*
Disallow /es/sugerencias/*
Disallow /es/destacado/*
Disallow /404

ahrefsbot

Rule Path
Disallow /public/*
Disallow /backoffice
Disallow /pt/login
Disallow /pt/login/*
Disallow /pt/pesquisa/*
Disallow /pt/carrinho/*
Disallow /pt/wishlist
Disallow /pt/promocoes/*
Disallow /pt/sugestoes/*
Disallow /pt/novidades/*
Disallow /es/login
Disallow /es/login/*
Disallow /es/busqueda/*
Disallow /es/cesta/*
Disallow /es/wishlist
Disallow /es/promociones/*
Disallow /es/sugerencias/*
Disallow /es/destacado/*
Disallow /404

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

nutch

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://aldoshoes.pt/sitemap.xml
sitemap https://aldoshoes.pt/sitemap_images.xml
sitemap https://aldoshoes.pt/sitemap.xml
sitemap https://aldoshoes.pt/sitemap_images.xml

Comments

  • Robots.txt generated by weasy.io e-commerce