stefanoricci.com
robots.txt

Robots Exclusion Standard data for stefanoricci.com

Resource Scan

Scan Details

Site Domain stefanoricci.com
Base Domain stefanoricci.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-05-03T06:08:47+00:00
Next Scan 2024-08-01T06:08:47+00:00

Last Successful Scan

Scanned2023-06-16T02:51:08+00:00
URL https://stefanoricci.com/robots.txt
Redirect https://www.stefanoricci.com/robots.txt
Redirect Domain www.stefanoricci.com
Redirect Base stefanoricci.com
Domain IPs 78.159.220.46
Redirect IPs 78.159.220.46
Response IP 78.159.220.46
Found Yes
Hash f83adf3b3090a9dd3faba24e0bf3dac71acc6449556a0be5ff10338f69e7a49a
SimHash 6316dd60c315

Groups

*

Rule Path
Allow /
Allow /*/Shop/
Allow /*/Slaves/
Allow /*/Ricerca/
Allow /*/Servizi/GeneraSitemap.ashx
Allow /App_Stuff/
Allow /App_Themes/
Disallow /App_GlobalResources/
Disallow /bin/
Disallow /*/Club/
Disallow /Config/
Disallow /Controls/
Disallow /*/Gateway/
Disallow /*/Purchase/
Disallow /*/Servizi/
Disallow /status/

Other Records

Field Value
crawl-delay 45

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

yahoo! slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

ahrefsbot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru/

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.stefanoricci.com/sitemap.xml

Comments

  • GENERICI
  • MICROSOFT BOTS
  • YAHOO BOTS
  • SCONSIGLIATI