mx.dfranklincreation.com
robots.txt

Robots Exclusion Standard data for mx.dfranklincreation.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	mx.dfranklincreation.com
Base Domain	dfranklincreation.com
Scan Status	Ok
Last Scan	2025-12-05T11:56:17+00:00
Next Scan	2025-12-19T11:56:17+00:00

Last Scan

Scanned	2025-12-05T11:56:17+00:00
URL	https://mx.dfranklincreation.com/robots.txt
Domain IPs	23.227.38.74, 2620:127:f00f:e::
Response IP	23.227.38.74
Found	Yes
Hash	7e291d3ec78cca5056eee7bdb592bc3a34f85725a97fc82dff4f884f8c75db0a
SimHash	6b194272de92

Groups

*

Rule	Path
Disallow	/a/downloads/-/*
Disallow	/admin
Disallow	/cart
Disallow	/orders
Disallow	/checkouts/
Disallow	/checkout
Disallow	/14332624950/checkouts
Disallow	/14332624950/orders
Disallow	/carts
Disallow	/account
Disallow	/collections/sort_by
Disallow	//collections/sort_by*
Disallow	/collections/%2B
Disallow	/collections/%2B
Disallow	/collections/%2B
Disallow	//collections/%2B*
Disallow	//collections/%2B*
Disallow	//collections/%2B*
Disallow	/collections/filter%26filter*
Disallow	/blogs/%2B
Disallow	/blogs/%2B
Disallow	/blogs/%2B
Disallow	//blogs/%2B*
Disallow	//blogs/%2B*
Disallow	//blogs/%2B*
Disallow	/?oseid=*
Disallow	/preview_theme_id
Disallow	/preview_script_id
Disallow	/policies/
Disallow	/*/policies/
Disallow	//?ls=&ls=*
Disallow	//?ls%3D%3Fls%3D*
Disallow	//?ls%3D%3Fls%3D*
Disallow	/search
Disallow	/apple-app-site-association
Disallow	/.well-known/shopify/monorail
Disallow	/cdn/wpm/*.js
Disallow	/recommendations/products
Disallow	/*/recommendations/products
Disallow	/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	//products/-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	/collections//products/-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	//collections//products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	/%26limit%3D
Disallow	/*?page=1
Disallow	//?page=
Disallow	/?pr_prod_strat=
Disallow	/?refSrc=
Disallow	//?_pos=
Disallow	//?ibg_source=
Disallow	//?nosto_source=
Disallow	//?___from_store=
Disallow	//?ref=
Disallow	/collections/all/products/*
Disallow	/collections/all?page=
Disallow	/*?page=
Disallow	/?page=
Disallow	//?p=
Disallow	/?*=
Disallow	/?PRE_SALES
Disallow	/?ref=
Disallow	//?SID=
Disallow	//?pageu
Disallow	//?awc=
Disallow	//?cupon=
Disallow	//?nosto=
Disallow	//?___SID=
Disallow	/discount
Disallow	//.atom
Disallow	/search
Disallow	/collections/filter%26filter*
Allow	//?page=2
Allow	/?ref=*utm_
Allow	//?cupon=*utm_

Rule

Path

Disallow

/a/downloads/-/*

Disallow

/admin

Disallow

/cart

Disallow

/orders

Disallow

/checkouts/

Disallow

/checkout

Disallow

/14332624950/checkouts

Disallow

/14332624950/orders

Disallow

/carts

Disallow

/account

Disallow

/collections/*sort_by*

Disallow

/*/collections/*sort_by*

Disallow

/collections/*%2B*

Disallow

/collections/*%2B*

Disallow

/collections/*%2B*

Disallow

/*/collections/*%2B*

Disallow

/*/collections/*%2B*

Disallow

/*/collections/*%2B*

Disallow

*/collections/*filter*%26*filter*

Disallow

/blogs/*%2B*

Disallow

/blogs/*%2B*

Disallow

/blogs/*%2B*

Disallow

/*/blogs/*%2B*

Disallow

/*/blogs/*%2B*

Disallow

/*/blogs/*%2B*

Disallow

/*?*oseid=*

Disallow

/*preview_theme_id*

Disallow

/*preview_script_id*

Disallow

/policies/

Disallow

/*/policies/

Disallow

/*/*?*ls=*&ls=*

Disallow

/*/*?*ls%3D*%3Fls%3D*

Disallow

/*/*?*ls%3D*%3Fls%3D*

Disallow

/search

Disallow

/apple-app-site-association

Disallow

/.well-known/shopify/monorail

Disallow

/cdn/wpm/*.js

Disallow

/recommendations/products

Disallow

/*/recommendations/products

Disallow

/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/collections/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/*/collections/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/*%26limit%3D*

Disallow

/*?page=1

Disallow

/*/*?page=

Disallow

/*?pr_prod_strat=*

Disallow

/*?refSrc=*

Disallow

/*/*?_pos=

Disallow

/*/*?ibg_source=

Disallow

/*/*?nosto_source=

Disallow

/*/*?___from_store=

Disallow

/*/*?ref=

Disallow

/collections/all/products/*

Disallow

/collections/all?page=

Disallow

/*?page=

Disallow

/?page=

Disallow

/*/*?p=

Disallow

/?*=

Disallow

/?PRE_SALES

Disallow

/?ref=

Disallow

/*/*?SID=

Disallow

/*/*?pageu

Disallow

/*/*?awc=

Disallow

/*/*?cupon=

Disallow

/*/*?nosto=

Disallow

/*/*?___SID=

Disallow

/discount

Disallow

/*/*.atom

Disallow

*/search*

Disallow

*/collections/*filter*%26*filter*

Allow

/*/*?page=2

Allow

/?ref=*utm_

Allow

/*/*?cupon=*utm_

adsbot-google

Rule	Path
Disallow	/checkouts/
Disallow	/checkout
Disallow	/carts
Disallow	/orders
Disallow	/14332624950/checkouts
Disallow	/14332624950/orders
Disallow	/?oseid=*
Disallow	/preview_theme_id
Disallow	/preview_script_id
Disallow	/cdn/wpm/*.js
Disallow	/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	//products/-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	/collections//products/-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	//collections//products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Rule

Path

Disallow

/checkouts/

Disallow

/checkout

Disallow

/carts

Disallow

/orders

Disallow

/14332624950/checkouts

Disallow

/14332624950/orders

Disallow

/*?*oseid=*

Disallow

/*preview_theme_id*

Disallow

/*preview_script_id*

Disallow

/cdn/wpm/*.js

Disallow

/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/collections/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/*/collections/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

nutch

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/a/downloads/-/*
Disallow	/admin
Disallow	/cart
Disallow	/orders
Disallow	/checkouts/
Disallow	/checkout
Disallow	/14332624950/checkouts
Disallow	/14332624950/orders
Disallow	/carts
Disallow	/account
Disallow	/collections/sort_by
Disallow	//collections/sort_by*
Disallow	/collections/%2B
Disallow	/collections/%2B
Disallow	/collections/%2B
Disallow	//collections/%2B*
Disallow	//collections/%2B*
Disallow	//collections/%2B*
Disallow	/collections/filter%26filter*
Disallow	/blogs/%2B
Disallow	/blogs/%2B
Disallow	/blogs/%2B
Disallow	//blogs/%2B*
Disallow	//blogs/%2B*
Disallow	//blogs/%2B*
Disallow	/?oseid=*
Disallow	/preview_theme_id
Disallow	/preview_script_id
Disallow	/policies/
Disallow	/*/policies/
Disallow	//?ls=&ls=*
Disallow	//?ls%3D%3Fls%3D*
Disallow	//?ls%3D%3Fls%3D*
Disallow	/search
Disallow	/apple-app-site-association
Disallow	/.well-known/shopify/monorail
Disallow	/cdn/wpm/*.js
Disallow	/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	//products/-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	/collections//products/-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	//collections//products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Rule

Path

Disallow

/a/downloads/-/*

Disallow

/admin

Disallow

/cart

Disallow

/orders

Disallow

/checkouts/

Disallow

/checkout

Disallow

/14332624950/checkouts

Disallow

/14332624950/orders

Disallow

/carts

Disallow

/account

Disallow

/collections/*sort_by*

Disallow

/*/collections/*sort_by*

Disallow

/collections/*%2B*

Disallow

/collections/*%2B*

Disallow

/collections/*%2B*

Disallow

/*/collections/*%2B*

Disallow

/*/collections/*%2B*

Disallow

/*/collections/*%2B*

Disallow

*/collections/*filter*%26*filter*

Disallow

/blogs/*%2B*

Disallow

/blogs/*%2B*

Disallow

/blogs/*%2B*

Disallow

/*/blogs/*%2B*

Disallow

/*/blogs/*%2B*

Disallow

/*/blogs/*%2B*

Disallow

/*?*oseid=*

Disallow

/*preview_theme_id*

Disallow

/*preview_script_id*

Disallow

/policies/

Disallow

/*/policies/

Disallow

/*/*?*ls=*&ls=*

Disallow

/*/*?*ls%3D*%3Fls%3D*

Disallow

/*/*?*ls%3D*%3Fls%3D*

Disallow

/search

Disallow

/apple-app-site-association

Disallow

/.well-known/shopify/monorail

Disallow

/cdn/wpm/*.js

Disallow

/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/collections/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/*/collections/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Other Records

Field	Value
crawl-delay	10

Field

Value

crawl-delay

ahrefssiteaudit

Rule	Path
Disallow	/a/downloads/-/*
Disallow	/admin
Disallow	/cart
Disallow	/orders
Disallow	/checkouts/
Disallow	/checkout
Disallow	/14332624950/checkouts
Disallow	/14332624950/orders
Disallow	/carts
Disallow	/account
Disallow	/collections/sort_by
Disallow	//collections/sort_by*
Disallow	/collections/%2B
Disallow	/collections/%2B
Disallow	/collections/%2B
Disallow	//collections/%2B*
Disallow	//collections/%2B*
Disallow	//collections/%2B*
Disallow	/collections/filter%26filter*
Disallow	/blogs/%2B
Disallow	/blogs/%2B
Disallow	/blogs/%2B
Disallow	//blogs/%2B*
Disallow	//blogs/%2B*
Disallow	//blogs/%2B*
Disallow	/?oseid=*
Disallow	/preview_theme_id
Disallow	/preview_script_id
Disallow	/policies/
Disallow	/*/policies/
Disallow	//?ls=&ls=*
Disallow	//?ls%3D%3Fls%3D*
Disallow	//?ls%3D%3Fls%3D*
Disallow	/search
Disallow	/apple-app-site-association
Disallow	/.well-known/shopify/monorail
Disallow	/cdn/wpm/*.js
Disallow	/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	//products/-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	/collections//products/-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	//collections//products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Rule

Path

Disallow

/a/downloads/-/*

Disallow

/admin

Disallow

/cart

Disallow

/orders

Disallow

/checkouts/

Disallow

/checkout

Disallow

/14332624950/checkouts

Disallow

/14332624950/orders

Disallow

/carts

Disallow

/account

Disallow

/collections/*sort_by*

Disallow

/*/collections/*sort_by*

Disallow

/collections/*%2B*

Disallow

/collections/*%2B*

Disallow

/collections/*%2B*

Disallow

/*/collections/*%2B*

Disallow

/*/collections/*%2B*

Disallow

/*/collections/*%2B*

Disallow

*/collections/*filter*%26*filter*

Disallow

/blogs/*%2B*

Disallow

/blogs/*%2B*

Disallow

/blogs/*%2B*

Disallow

/*/blogs/*%2B*

Disallow

/*/blogs/*%2B*

Disallow

/*/blogs/*%2B*

Disallow

/*?*oseid=*

Disallow

/*preview_theme_id*

Disallow

/*preview_script_id*

Disallow

/policies/

Disallow

/*/policies/

Disallow

/*/*?*ls=*&ls=*

Disallow

/*/*?*ls%3D*%3Fls%3D*

Disallow

/*/*?*ls%3D*%3Fls%3D*

Disallow

/search

Disallow

/apple-app-site-association

Disallow

/.well-known/shopify/monorail

Disallow

/cdn/wpm/*.js

Disallow

/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/collections/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/*/collections/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Other Records

Field	Value
crawl-delay	10

Field

Value

crawl-delay

mj12bot

No rules defined. All paths allowed.

Other Records

Field	Value
crawl-delay	10

Field

Value

crawl-delay

No rules defined. All paths allowed.

Other Records

Field	Value
crawl-delay	1

Field

Value

crawl-delay

oai-searchbot

Rule	Path
Allow	/

Rule

Path

Allow

chatgpt-user

Rule	Path
Allow	/

Rule

Path

Allow

google-extended

Rule	Path
Disallow	/

Rule

Path

Disallow

perplexitybot

Rule	Path
Allow	/

Rule

Path

Allow

firecrawlagent

Rule	Path
Allow	/

Rule

Path

Allow

andibot

Rule	Path
Allow	/

Rule

Path

Allow

exabot

Rule	Path
Allow	/

Rule

Path

Allow

phindbot

Rule	Path
Allow	/

Rule

Path

Allow

youbot

Rule	Path
Allow	/

Rule

Path

Allow

gptbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot

Rule	Path
Disallow	/

Rule

Path

Disallow

google-extended

Rule	Path
Disallow	/

Rule

Path

Disallow

Other Records

Field	Value
sitemap	https://mx.dfranklincreation.com/sitemap.xml
sitemap	https://mx.dfranklincreation.com/sitemap.xml
sitemap	https://mx.dfranklincreation.com/sitemap.xml
sitemap	https://mx.dfranklincreation.com/sitemap.xml
sitemap	https://mx.dfranklincreation.com/sitemap_blogs_1.xml
sitemap	https://mx.dfranklincreation.com/sitemap_products_1.xml?from=1980785655905&to=15286885843269
sitemap	https://mx.dfranklincreation.com/sitemap_pages_1.xml?from=26093715553&to=699100856645
sitemap	https://mx.dfranklincreation.com/sitemap_collections_1.xml?from=94862082145&to=660220707141

Field

Value

sitemap

https://mx.dfranklincreation.com/sitemap.xml

sitemap

https://mx.dfranklincreation.com/sitemap.xml

sitemap

https://mx.dfranklincreation.com/sitemap.xml

sitemap

https://mx.dfranklincreation.com/sitemap.xml

sitemap

https://mx.dfranklincreation.com/sitemap_blogs_1.xml

sitemap

https://mx.dfranklincreation.com/sitemap_products_1.xml?from=1980785655905&to=15286885843269

sitemap

https://mx.dfranklincreation.com/sitemap_pages_1.xml?from=26093715553&to=699100856645

sitemap

https://mx.dfranklincreation.com/sitemap_collections_1.xml?from=94862082145&to=660220707141

Comments

Allow AI search and agent use
Disallow AI training data collection

mx.dfranklincreation.comrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

*

adsbot-google

nutch

ahrefsbot

Other Records

ahrefssiteaudit

Other Records

mj12bot

Other Records

pinterest

Other Records

oai-searchbot

chatgpt-user

google-extended

perplexitybot

firecrawlagent

andibot

exabot

phindbot

youbot

gptbot

ccbot

google-extended

Other Records

Comments

mx.dfranklincreation.com
robots.txt