yoaer.com
robots.txt

Robots Exclusion Standard data for yoaer.com

Resource Scan

Scan Details

Site Domain yoaer.com
Base Domain yoaer.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-24T20:29:05+00:00
Next Scan 2026-02-22T20:29:05+00:00

Last Successful Scan

Scanned2024-07-10T08:23:28+00:00
URL https://yoaer.com/robots.txt
Redirect https://www.yoaer.com/robots.txt
Redirect Domain www.yoaer.com
Redirect Base yoaer.com
Domain IPs 103.172.191.1
Redirect IPs 104.17.246.119, 104.17.247.119, 2606:4700::6811:f677, 2606:4700::6811:f777
Response IP 104.17.246.119
Found Yes
Hash 5dceb0600fc22c94c35a83e9ba19bff9b18305c68d4327bfa82ae8c03d0949dd
SimHash 25005f2a1883

Groups

*

Rule Path
Disallow /admin
Disallow /cart
Disallow /checkout
Disallow /orders
Disallow /search
Disallow /openapi
Disallow /*preview_theme_id*
Disallow /cdn-cgi
Disallow /api/bundle-popups
Disallow /api/bundle-sales
Disallow /api/bundle-sales/global-text
Disallow /api/cart/*
Disallow /api/comment-config
Disallow /api/comment/*
Disallow /api/discount-code/coupons
Disallow /api/monkey-i18n
Disallow /api/multi-currency/finance-list
Disallow /api/popups
Disallow /api/preload-checkout
Disallow /api/recommend-app/rule/query

adsbot-google

Rule Path
Disallow /checkout
Disallow /cart
Disallow /orders
Disallow /*preview_theme_id*
Disallow /cdn-cgi

pinterest

Rule Path
Disallow /api/cart*

Other Records

Field Value
crawl-delay 1

pinterestbot

Rule Path
Disallow /api/cart*

Other Records

Field Value
crawl-delay 1

facebookbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.yoaer.com/sitemap.xml.gz
sitemap https://www.yoaer.com/sitemap.xml.gz

Comments

  • Google adsbot ignores robots.txt unless specifically named!