grayiyi.com
robots.txt

Robots Exclusion Standard data for grayiyi.com

Resource Scan

Scan Details

Site Domain grayiyi.com
Base Domain grayiyi.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-12-15T05:04:19+00:00
Next Scan 2026-03-15T05:04:19+00:00

Last Successful Scan

Scanned2023-05-04T13:11:37+00:00
URL https://www.grayiyi.com/robots.txt
Domain IPs 104.17.232.29, 104.17.233.29
Response IP 104.17.233.29
Found Yes
Hash 542ab59d1c5f7b54b740d3827dd441633117ea2b99344d5076da8255c8695727
SimHash 2d141d6851c0

Groups

*

Rule Path
Disallow /admin
Disallow /cart
Disallow /checkout
Disallow /orders
Disallow /search
Disallow /openapi
Disallow /*preview_theme_id*
Disallow /cdn-cgi

adsbot-google

Rule Path
Disallow /checkout
Disallow /cart
Disallow /orders
Disallow /*preview_theme_id*
Disallow /cdn-cgi

pinterest

Rule Path
Disallow /api/cart*

Other Records

Field Value
crawl-delay 1

pinterestbot

Rule Path
Disallow /api/cart*

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.cozper.com/sitemap.xml.gz
sitemap https://www.cozper.com/sitemap.xml.gz

Comments

  • Google adsbot ignores robots.txt unless specifically named!