eshoppingadvisor.com
robots.txt

Robots Exclusion Standard data for eshoppingadvisor.com

Resource Scan

Scan Details

Site Domain eshoppingadvisor.com
Base Domain eshoppingadvisor.com
Scan Status Ok
Last Scan2024-09-25T18:11:04+00:00
Next Scan 2024-10-02T18:11:04+00:00

Last Scan

Scanned2024-09-25T18:11:04+00:00
URL https://eshoppingadvisor.com/robots.txt
Redirect https://www.eshoppingadvisor.com/robots.txt
Redirect Domain www.eshoppingadvisor.com
Redirect Base eshoppingadvisor.com
Domain IPs 20.238.133.183
Redirect IPs 20.238.133.183
Response IP 20.238.133.183
Found Yes
Hash df1076164bedb04d0b81eec01e10639d88063abccf80fa02600ccf361e739605
SimHash 50bcdca741aa

Groups

*

Rule Path
Disallow /admin/
Disallow /business/
Disallow /STATS/
Disallow /*reviews/
Disallow /*?*rev=*
Disallow /*?*RLF*
Disallow *reviews-like
Disallow *registrazione
Disallow *oauth-verify
Disallow *shareThumb
Disallow *leggiTutto
Disallow *generalUserAvatar
Disallow *areariservata
Disallow *classifica-recensori?p=*
Disallow *userAvatar/*
Disallow *userAvatarSocial/*
Disallow *products/
Disallow /*?s=
Disallow *productsInfo

facebookexternalhit

Rule Path
Allow /

moget
ichiro

Rule Path
Disallow /

naverbot
yeti

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image
sogou spider
youdaobot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

alexabot

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

semrushbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

Other Records

Field Value
sitemap https://www.eshoppingadvisor.com/sitemap.xml

Comments

  • Disallow: /aziende/
  • Disallow: /*?*EshopReviewModel_page=*
  • Disallow: /*?*EshoppingModel_page=*
  • Disallow: /*?*page=*
  • Disallow: *getEmail
  • Disallow: *getTel
  • Disallow: *reviewsFilter
  • MOTORI DI RICERCA GIAPPONESI
  • MOTORI DI RICERCA KOREANI
  • MOTORI DI RICERCA CINESI
  • MOTORI DI RICERCA RUSSI