giglio.com
robots.txt

Robots Exclusion Standard data for giglio.com

Resource Scan

Scan Details

Site Domain giglio.com
Base Domain giglio.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-23T02:16:22+00:00
Next Scan 2024-08-21T02:16:22+00:00

Last Successful Scan

Scanned2023-01-19T07:28:22+00:00
URL https://giglio.com/robots.txt
Redirect https://www.giglio.com/robots.txt
Redirect Domain www.giglio.com
Redirect Base giglio.com
Domain IPs 23.52.171.225, 23.59.168.162, 2600:1417:3f::b81c:eb52, 2600:1417:3f::b81c:eb68
Redirect IPs 23.52.171.225, 23.59.168.162, 2600:1413:1::173b:a86b, 2600:1413:1::173b:a883
Response IP 23.64.122.72
Found Yes
Hash f5b2d36aa608dc4e9ffe0db4bc027a22ca7c8572d15950ef1dd4f2adb8ef71b8
SimHash 0c5ccc618648

Groups

*

Rule Path
Disallow /logo/
Disallow /api/
Disallow /js/
Disallow /widgetInvestors/
Disallow /*?k=*
Disallow /*?pag=*
Disallow /*%26pag%3D*
Disallow /*?designer=*
Disallow /*?category=*
Disallow /*?color=*
Disallow /*?woman-clothing=*
Disallow /*?man-clothing=*
Disallow /*?man-shoes=*
Disallow /*?woman-shoes=*
Disallow /*?size=*
Disallow /*%2C*
Disallow /*philocaly/*

etaospider

Rule Path
Disallow /

psbot

Rule Path
Disallow /

npbot-1/2.0

Rule Path
Disallow /

npbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.giglio.com/sitemap_index_ita.xml
sitemap https://www.giglio.com/sitemap_index_eng.xml
sitemap https://www.giglio.com/sitemap_index_rus.xml
sitemap https://www.giglio.com/sitemap_index_esp.xml
sitemap https://www.giglio.com/sitemap_index_deu.xml
sitemap https://www.giglio.com/sitemap_index_fra.xml
sitemap https://www.giglio.com/sitemap_index_gbr.xml
sitemap https://www.giglio.com/sitemap_index_chn.xml
sitemap https://www.giglio.com/sitemap_index_ja-jp.xml
sitemap https://www.giglio.com/sitemap_index_ko-kr.xml