Log In Sign Up

egrimesdirect.com
robots.txt

Robots Exclusion Standard data for egrimesdirect.com

Resource Scan

Scan Details

Site Domain egrimesdirect.com
Base Domain egrimesdirect.com
Scan Status Ok
Last Scan2024-10-01T12:55:56+00:00
Next Scan 2024-10-15T12:55:56+00:00

Last Scan

Scanned2024-10-01T12:55:56+00:00
URL https://egrimesdirect.com/robots.txt
Redirect https://www.egrimesdirect.com/robots.txt
Redirect Domain www.egrimesdirect.com
Redirect Base egrimesdirect.com
Domain IPs 23.227.38.32
Redirect IPs 23.227.38.74, 2620:127:f00f:e::
Response IP 23.227.38.74
Found Yes
Hash 8f676a0fc784b7c1ff45d0376bb012e0891d2e6bc8852645829e8f64235fa9a4
SimHash 3c9453f2d643

Groups

*

Rule Path
Disallow /admin/
Disallow /cart/
Disallow /account/
Disallow /checkout/
Disallow /checkouts/
Disallow /orders/
Disallow /carts/
Disallow /password
Disallow /policies/
Disallow /search/
Disallow /contact/
Disallow /refunds/
Disallow /shipping/
Disallow /terms/
Disallow /privacy/
Disallow /blogs/*/comments
Disallow /apple-app-site-association
Disallow /.well-known/
Disallow /*?*sort_by*
Disallow /*?*page=*
Disallow /*?*grid_list=*
Disallow /*?*view=*
Disallow /*?*direction=*
Disallow /*?*pr_seq=uniform*
Disallow /*?*oseid=*
Disallow /*?*variant=*
Disallow /*?*utm_*
Disallow /*?*session_*
Disallow /*?*ref=*
Disallow /*?*affiliate=*
Disallow /*?*preview_theme_id*
Disallow /*?*preview_script_id*
Disallow /*?*ls=*
Disallow /*?*ls%3D*
Disallow /*?*ls%3D*
Disallow /*?*currency=*
Disallow /*?*locale=*
Disallow /*?*q=*
Disallow /*?*type=*
Allow /collections/
Allow /products/
Allow /blogs/
Allow /pages/
Allow /assets/
Allow /images/
Allow /scripts/
Allow /styles/

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /admin/
Disallow /cart/
Disallow /account/
Disallow /checkout/
Disallow /checkouts/
Disallow /orders/
Disallow /carts/
Disallow /password
Disallow /policies/
Disallow /search/
Disallow /contact/
Disallow /*?*sort_by*
Disallow /*?*page=*
Disallow /*?*utm_*
Disallow /*?*session_*
Disallow /*?*ref=*
Disallow /*?*affiliate=*
Disallow /*?*currency=*
Disallow /*?*locale=*
Disallow /*?*q=*
Allow /collections/
Allow /products/
Allow /blogs/
Allow /pages/

adsbot-google

Rule Path
Disallow /checkout/
Disallow /checkouts/
Disallow /cart/
Disallow /orders/
Disallow /*?*oseid=*
Disallow /*?*preview_theme_id*
Disallow /*?*preview_script_id*

googlebot-image

Rule Path
Disallow /images/private/
Allow /images/

googlebot-mobile

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Disallow /videos/private/
Allow /videos/

bingbot

Rule Path
Disallow /admin/
Disallow /cart/
Disallow /account/
Disallow /checkout/
Disallow /checkouts/
Disallow /orders/
Disallow /carts/
Disallow /password
Disallow /policies/
Disallow /search/
Disallow /contact/
Disallow /*?*sort_by*
Disallow /*?*page=*
Disallow /*?*utm_*
Disallow /*?*session_*
Disallow /*?*ref=*
Disallow /*?*affiliate=*
Allow /collections/
Allow /products/
Allow /blogs/
Allow /pages/

Other Records

Field Value
crawl-delay 10

bingpreview

Rule Path
Allow /

slurp

Rule Path
Disallow /admin/
Disallow /cart/
Disallow /account/
Disallow /checkout/
Disallow /checkouts/
Disallow /orders/
Disallow /carts/
Disallow /password
Disallow /policies/
Disallow /search/
Disallow /contact/
Disallow /*?*sort_by*
Disallow /*?*page=*
Allow /collections/
Allow /products/
Allow /blogs/
Allow /pages/

Other Records

Field Value
crawl-delay 10

baiduspider

Rule Path
Disallow /admin/
Disallow /cart/
Disallow /account/
Disallow /checkout/
Disallow /checkouts/
Disallow /orders/
Disallow /carts/
Disallow /
Allow /collections/
Allow /products/
Allow /blogs/
Allow /pages/

Other Records

Field Value
crawl-delay 10

yandex

Rule Path
Disallow /admin/
Disallow /cart/
Disallow /account/
Disallow /checkout/
Disallow /checkouts/
Disallow /orders/
Disallow /carts/
Disallow /
Allow /collections/
Allow /products/
Allow /blogs/
Allow /pages/

Other Records

Field Value
crawl-delay 10

duckduckbot

Rule Path
Disallow /admin/
Disallow /cart/
Disallow /account/
Disallow /checkout/
Disallow /checkouts/
Disallow /orders/
Disallow /carts/
Disallow /password
Disallow /policies/
Disallow /search/
Disallow /contact/
Allow /collections/
Allow /products/
Allow /blogs/
Allow /pages/

Other Records

Field Value
crawl-delay 5

sogou spider

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

exabot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

seznambot

Rule Path
Disallow /admin/
Disallow /cart/
Disallow /account/
Disallow /checkout/
Disallow /checkouts/
Disallow /orders/
Disallow /carts/
Disallow /password
Disallow /search/
Disallow /*?*
Allow /collections/
Allow /products/
Allow /blogs/
Allow /pages/

Other Records

Field Value
crawl-delay 10

facebot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

pinterest

Rule Path
Allow /
Disallow /admin/
Disallow /cart/
Disallow /account/
Disallow /checkout/
Disallow /checkouts/
Disallow /orders/
Disallow /carts/
Disallow /password
Disallow /search/
Disallow /contact/

Other Records

Field Value
crawl-delay 1

whatsapp

Rule Path
Allow /

applebot

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

sitebulb

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

netcraftsurveyagent

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

linkassistant

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

spbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

nutch

Rule Path
Disallow /

yeti

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

java

Rule Path
Disallow /

libwww-perl

Rule Path
Disallow /

curl

Rule Path
Disallow /

wget

Rule Path
Disallow /

httrack

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

email extractor

Rule Path
Disallow /

backdoorbot

Rule Path
Disallow /

mozilla/5.0 (compatible)

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap /sitemap.xml
sitemap /sitemap_products_1.xml?from=1121514356780&to=1121833975852
sitemap /sitemap_products_2.xml?from=1121834106924&to=1124138549292
sitemap /sitemap_products_3.xml?from=1124138614828&to=1146394902572
sitemap /sitemap_products_4.xml?from=1146396114988&to=1768990146604
sitemap /sitemap_products_5.xml?from=1768990179372&to=1812355678252
sitemap /sitemap_products_6.xml?from=1812355711020&to=1813056946220
sitemap /sitemap_products_7.xml?from=1813056978988&to=1813371355180
sitemap /sitemap_products_8.xml?from=1813371387948&to=4254980636716
sitemap /sitemap_products_9.xml?from=4254980669484&to=4333380730924
sitemap /sitemap_products_10.xml?from=4333380796460&to=7901223059605
sitemap /sitemap_products_11.xml?from=7901223092373&to=7915512594581
sitemap /sitemap_products_12.xml?from=7915512692885&to=7925895823509
sitemap /sitemap_products_13.xml?from=7925895856277&to=7925986001045
sitemap /sitemap_products_14.xml?from=7925986033813&to=8057888833685
sitemap /sitemap_products_15.xml?from=8057888931989&to=8602294222997
sitemap /sitemap_pages_1.xml?from=5781553196&to=686353449109
sitemap /sitemap_collections_1.xml?from=30676844588&to=318150115477
sitemap /sitemap_blogs_1.xml
Back to top

Comments

  • =======================================================
  • robots.txt.liquid file for
  • We use Shopify as our e-commerce platform.
  • Last updated: 2024-10-01
  • =======================================================
  • =======================================================
  • Sitemap Locations
  • =======================================================
  • Primary Sitemap Index
  • Individual Sitemaps
  • =======================================================
  • Global Rules for All User Agents
  • =======================================================
  • --- Disallowed Directories ---
  • --- Disallowed Parameters ---
  • --- Allowed Directories ---
  • --- Crawl Delay ---
  • =======================================================
  • Specific Rules for Search Engine Bots
  • =======================================================
  • --- Google Crawlers ---
  • --- Bing Crawlers ---
  • --- Yahoo Crawlers ---
  • --- Baidu Crawlers ---
  • --- Yandex Crawlers ---
  • --- DuckDuckGo ---
  • --- Sogou ---
  • --- Exalead ---
  • --- Seznam ---
  • =======================================================
  • Social Media Bots
  • =======================================================
  • --- Facebook ---
  • --- Twitter ---
  • --- LinkedIn ---
  • --- Pinterest ---
  • --- WhatsApp ---
  • --- Apple ---
  • =======================================================
  • SEO Tools and Crawlers
  • =======================================================
  • --- Ahrefs ---
  • --- SEMrush ---
  • --- Majestic ---
  • --- Moz ---
  • --- Screaming Frog ---
  • --- Sitebulb ---
  • --- SEOkicks ---
  • --- DataForSeo ---
  • --- Netcraft ---
  • --- BLEXBot ---
  • --- SiteExplorer ---
  • --- Sistrix ---
  • --- LinkAssistant ---
  • --- UptimeRobot ---
  • --- Other SEO Crawlers ---
  • =======================================================
  • Known Bad Bots and Scrapers
  • =======================================================
  • --- Empty User Agent ---
  • --- Suspicious User Agents ---
  • =======================================================
  • End of robots.txt.liquid
  • =======================================================
Back to top

Warnings

  • 2 invalid lines.
Back to top