Log In Sign Up

egrimesdirect.com
robots.txt

Robots Exclusion Standard data for egrimesdirect.com

Resource Scan

Scan Details

Site Domain egrimesdirect.com
Base Domain egrimesdirect.com
Scan Status Ok
Last Scan2024-11-12T12:57:42+00:00
Next Scan 2024-11-26T12:57:42+00:00

Last Scan

Scanned2024-11-12T12:57:42+00:00
URL https://egrimesdirect.com/robots.txt
Redirect https://www.egrimesdirect.com/robots.txt
Redirect Domain www.egrimesdirect.com
Redirect Base egrimesdirect.com
Domain IPs 23.227.38.32
Redirect IPs 23.227.38.74, 2620:127:f00f:e::
Response IP 23.227.38.74
Found Yes
Hash f9834da43b491aa99aeda82f30a6b70a1727f363dbe8209e761a0dc39a4a5276
SimHash 3c9e53f2c64b

Groups

*

Rule Path
Disallow /admin/
Disallow /cart/
Disallow /account/
Disallow /checkout/
Disallow /checkouts/
Disallow /orders/
Disallow /carts/
Disallow /password
Disallow /policies/
Disallow /search/
Disallow /contact/
Disallow /refunds/
Disallow /shipping/
Disallow /terms/
Disallow /privacy/
Disallow /blogs/*/comments
Disallow /apple-app-site-association
Disallow /.well-known/
Disallow /*?*sort_by*
Disallow /*?*page=*
Disallow /*?*grid_list=*
Disallow /*?*view=*
Disallow /*?*direction=*
Disallow /*?*pr_seq=uniform*
Disallow /*?*oseid=*
Disallow /*?*variant=*
Disallow /*?*utm_*
Disallow /*?*session_*
Disallow /*?*ref=*
Disallow /*?*affiliate=*
Disallow /*?*preview_theme_id*
Disallow /*?*preview_script_id*
Disallow /*?*ls=*
Disallow /*?*ls%3D*
Disallow /*?*ls%3D*
Disallow /*?*currency=*
Disallow /*?*locale=*
Disallow /*?*q=*
Disallow /*?*type=*
Allow /collections/
Allow /products/
Allow /blogs/
Allow /pages/
Allow /assets/
Allow /images/
Allow /scripts/
Allow /styles/

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /admin/
Disallow /cart/
Disallow /account/
Disallow /checkout/
Disallow /checkouts/
Disallow /orders/
Disallow /carts/
Disallow /password
Disallow /policies/
Disallow /search/
Disallow /contact/
Disallow /*?*sort_by*
Disallow /*?*page=*
Disallow /*?*utm_*
Disallow /*?*session_*
Disallow /*?*ref=*
Disallow /*?*affiliate=*
Disallow /*?*currency=*
Disallow /*?*locale=*
Disallow /*?*q=*
Allow /collections/
Allow /products/
Allow /blogs/
Allow /pages/

adsbot-google

Rule Path
Disallow /checkout/
Disallow /checkouts/
Disallow /cart/
Disallow /orders/
Disallow /*?*oseid=*
Disallow /*?*preview_theme_id*
Disallow /*?*preview_script_id*

googlebot-image

Rule Path
Disallow /images/private/
Allow /images/

googlebot-mobile

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Disallow /videos/private/
Allow /videos/

bingbot

Rule Path
Disallow /admin/
Disallow /cart/
Disallow /account/
Disallow /checkout/
Disallow /checkouts/
Disallow /orders/
Disallow /carts/
Disallow /password
Disallow /policies/
Disallow /search/
Disallow /contact/
Disallow /*?*sort_by*
Disallow /*?*page=*
Disallow /*?*utm_*
Disallow /*?*session_*
Disallow /*?*ref=*
Disallow /*?*affiliate=*
Allow /collections/
Allow /products/
Allow /blogs/
Allow /pages/

Other Records

Field Value
crawl-delay 10

bingpreview

Rule Path
Allow /

slurp

Rule Path
Disallow /admin/
Disallow /cart/
Disallow /account/
Disallow /checkout/
Disallow /checkouts/
Disallow /orders/
Disallow /carts/
Disallow /password
Disallow /policies/
Disallow /search/
Disallow /contact/
Disallow /*?*sort_by*
Disallow /*?*page=*
Allow /collections/
Allow /products/
Allow /blogs/
Allow /pages/

Other Records

Field Value
crawl-delay 10

baiduspider

Rule Path
Disallow /admin/
Disallow /cart/
Disallow /account/
Disallow /checkout/
Disallow /checkouts/
Disallow /orders/
Disallow /carts/
Disallow /
Allow /collections/
Allow /products/
Allow /blogs/
Allow /pages/

Other Records

Field Value
crawl-delay 10

yandex

Rule Path
Disallow /admin/
Disallow /cart/
Disallow /account/
Disallow /checkout/
Disallow /checkouts/
Disallow /orders/
Disallow /carts/
Disallow /
Allow /collections/
Allow /products/
Allow /blogs/
Allow /pages/

Other Records

Field Value
crawl-delay 10

duckduckbot

Rule Path
Disallow /admin/
Disallow /cart/
Disallow /account/
Disallow /checkout/
Disallow /checkouts/
Disallow /orders/
Disallow /carts/
Disallow /password
Disallow /policies/
Disallow /search/
Disallow /contact/
Allow /collections/
Allow /products/
Allow /blogs/
Allow /pages/

Other Records

Field Value
crawl-delay 5

sogou spider

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

exabot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

seznambot

Rule Path
Disallow /admin/
Disallow /cart/
Disallow /account/
Disallow /checkout/
Disallow /checkouts/
Disallow /orders/
Disallow /carts/
Disallow /password
Disallow /search/
Disallow /*?*
Allow /collections/
Allow /products/
Allow /blogs/
Allow /pages/

Other Records

Field Value
crawl-delay 10

facebot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

pinterest

Rule Path
Allow /
Disallow /admin/
Disallow /cart/
Disallow /account/
Disallow /checkout/
Disallow /checkouts/
Disallow /orders/
Disallow /carts/
Disallow /password
Disallow /search/
Disallow /contact/

Other Records

Field Value
crawl-delay 1

whatsapp

Rule Path
Allow /

applebot

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

sitebulb

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

netcraftsurveyagent

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

linkassistant

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

spbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

nutch

Rule Path
Disallow /

yeti

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

java

Rule Path
Disallow /

libwww-perl

Rule Path
Disallow /

curl

Rule Path
Disallow /

wget

Rule Path
Disallow /

httrack

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

email extractor

Rule Path
Disallow /

backdoorbot

Rule Path
Disallow /

mozilla/5.0 (compatible)

Rule Path
Disallow /
Back to top

Comments

  • =======================================================
  • robots.txt.liquid file for
  • We use Shopify as our e-commerce platform.
  • Last updated: 2024-11-12
  • =======================================================
  • =======================================================
  • Global Rules for All User Agents
  • =======================================================
  • --- Disallowed Directories ---
  • --- Disallowed Parameters ---
  • --- Allowed Directories ---
  • --- Crawl Delay ---
  • =======================================================
  • Specific Rules for Search Engine Bots
  • =======================================================
  • --- Google Crawlers ---
  • --- Bing Crawlers ---
  • --- Yahoo Crawlers ---
  • --- Baidu Crawlers ---
  • --- Yandex Crawlers ---
  • --- DuckDuckGo ---
  • --- Sogou ---
  • --- Exalead ---
  • --- Seznam ---
  • =======================================================
  • Social Media Bots
  • =======================================================
  • --- Facebook ---
  • --- Twitter ---
  • --- LinkedIn ---
  • --- Pinterest ---
  • --- WhatsApp ---
  • --- Apple ---
  • =======================================================
  • SEO Tools and Crawlers
  • =======================================================
  • --- Ahrefs ---
  • --- SEMrush ---
  • --- Majestic ---
  • --- Moz ---
  • --- Screaming Frog ---
  • --- Sitebulb ---
  • --- SEOkicks ---
  • --- DataForSeo ---
  • --- Netcraft ---
  • --- BLEXBot ---
  • --- SiteExplorer ---
  • --- Sistrix ---
  • --- LinkAssistant ---
  • --- UptimeRobot ---
  • --- Other SEO Crawlers ---
  • =======================================================
  • Known Bad Bots and Scrapers
  • =======================================================
  • --- Suspicious User Agents ---
  • =======================================================
  • End of robots.txt.liquid
  • =======================================================
Back to top