Log In Sign Up

aspectled.com
robots.txt

Robots Exclusion Standard data for aspectled.com

Resource Scan

Scan Details

Site Domain aspectled.com
Base Domain aspectled.com
Scan Status Ok
Last Scan2024-06-16T14:37:57+00:00
Next Scan 2024-06-30T14:37:57+00:00

Last Scan

Scanned2024-06-16T14:37:57+00:00
URL https://aspectled.com/robots.txt
Redirect https://www.aspectled.com/robots.txt
Redirect Domain www.aspectled.com
Redirect Base aspectled.com
Domain IPs 13.226.210.100, 13.226.210.111, 13.226.210.125, 13.226.210.43
Redirect IPs 13.226.210.100, 13.226.210.111, 13.226.210.125, 13.226.210.43
Response IP 3.160.246.60
Found Yes
Hash cf71260110db0ba617606191acb63354e2eef2bf92df446a90ddd632e5fb289c
SimHash 2f148c4a1590

Groups

*

Rule Path
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkout
Disallow /4097929/checkouts
Disallow /carts
Disallow /account
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /*design_theme_id*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*
Disallow /apple-app-site-association

adsbot-google

Rule Path
Disallow /checkout
Disallow /carts
Disallow /orders
Disallow /4097929/checkouts
Disallow /*design_theme_id*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*

archive.org_bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

nutch

Rule Path
Disallow /

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.aspectled.com/sitemap.xml
Back to top

Comments

  • Google adsbot ignores robots.txt unless specifically named!
Back to top