pescience.com
robots.txt

Robots Exclusion Standard data for pescience.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	pescience.com
Base Domain	pescience.com
Scan Status	Ok
Last Scan	2025-10-29T16:49:23+00:00
Next Scan	2025-11-12T16:49:23+00:00

Last Scan

Scanned	2025-10-29T16:49:23+00:00
URL	https://www.pescience.com/robots.txt
Redirect	https://pescience.com/robots.txt
Redirect Domain	pescience.com
Redirect Base	pescience.com
Domain IPs	23.227.38.74, 2620:127:f00f:e::
Redirect IPs	23.227.38.32
Response IP	23.227.38.32
Found	Yes
Hash	34414b9eb720706b7d84888e900c330e54cd6a2b15d99eb889aac879df3e692d
SimHash	ff940e429ed9

Groups

*

Rule	Path
Disallow	/a/downloads/-/*
Disallow	/admin
Disallow	/cart
Disallow	/orders
Disallow	/checkouts/
Disallow	/checkout
Disallow	/19437603/checkouts
Disallow	/19437603/orders
Disallow	/carts
Disallow	/account
Disallow	/collections/sort_by
Disallow	//collections/sort_by*
Disallow	/collections/%2B
Disallow	/collections/%2B
Disallow	/collections/%2B
Disallow	//collections/%2B*
Disallow	//collections/%2B*
Disallow	//collections/%2B*
Disallow	/collections/filter%26filter*
Disallow	/blogs/%2B
Disallow	/blogs/%2B
Disallow	/blogs/%2B
Disallow	//blogs/%2B*
Disallow	//blogs/%2B*
Disallow	//blogs/%2B*
Disallow	/?oseid=*
Disallow	/preview_theme_id
Disallow	/preview_script_id
Disallow	/policies/
Disallow	/*/policies/
Disallow	//?ls=&ls=*
Disallow	//?ls%3D%3Fls%3D*
Disallow	//?ls%3D%3Fls%3D*
Disallow	/search
Disallow	/apple-app-site-association
Disallow	/.well-known/shopify/monorail
Disallow	/cdn/wpm/*.js
Disallow	/recommendations/products
Disallow	/*/recommendations/products
Disallow	/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	//products/-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	/collections//products/-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	//collections//products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Rule

Path

Disallow

/a/downloads/-/*

Disallow

/admin

Disallow

/cart

Disallow

/orders

Disallow

/checkouts/

Disallow

/checkout

Disallow

/19437603/checkouts

Disallow

/19437603/orders

Disallow

/carts

Disallow

/account

Disallow

/collections/*sort_by*

Disallow

/*/collections/*sort_by*

Disallow

/collections/*%2B*

Disallow

/collections/*%2B*

Disallow

/collections/*%2B*

Disallow

/*/collections/*%2B*

Disallow

/*/collections/*%2B*

Disallow

/*/collections/*%2B*

Disallow

*/collections/*filter*%26*filter*

Disallow

/blogs/*%2B*

Disallow

/blogs/*%2B*

Disallow

/blogs/*%2B*

Disallow

/*/blogs/*%2B*

Disallow

/*/blogs/*%2B*

Disallow

/*/blogs/*%2B*

Disallow

/*?*oseid=*

Disallow

/*preview_theme_id*

Disallow

/*preview_script_id*

Disallow

/policies/

Disallow

/*/policies/

Disallow

/*/*?*ls=*&ls=*

Disallow

/*/*?*ls%3D*%3Fls%3D*

Disallow

/*/*?*ls%3D*%3Fls%3D*

Disallow

/search

Disallow

/apple-app-site-association

Disallow

/.well-known/shopify/monorail

Disallow

/cdn/wpm/*.js

Disallow

/recommendations/products

Disallow

/*/recommendations/products

Disallow

/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/collections/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/*/collections/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

adsbot-google

Rule	Path
Disallow	/checkouts/
Disallow	/checkout
Disallow	/carts
Disallow	/orders
Disallow	/19437603/checkouts
Disallow	/19437603/orders
Disallow	/?oseid=*
Disallow	/preview_theme_id
Disallow	/preview_script_id
Disallow	/cdn/wpm/*.js
Disallow	/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	//products/-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	/collections//products/-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	//collections//products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Rule

Path

Disallow

/checkouts/

Disallow

/checkout

Disallow

/carts

Disallow

/orders

Disallow

/19437603/checkouts

Disallow

/19437603/orders

Disallow

/*?*oseid=*

Disallow

/*preview_theme_id*

Disallow

/*preview_script_id*

Disallow

/cdn/wpm/*.js

Disallow

/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/collections/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/*/collections/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

nutch

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/a/downloads/-/*
Disallow	/admin
Disallow	/cart
Disallow	/orders
Disallow	/checkouts/
Disallow	/checkout
Disallow	/19437603/checkouts
Disallow	/19437603/orders
Disallow	/carts
Disallow	/account
Disallow	/collections/sort_by
Disallow	//collections/sort_by*
Disallow	/collections/%2B
Disallow	/collections/%2B
Disallow	/collections/%2B
Disallow	//collections/%2B*
Disallow	//collections/%2B*
Disallow	//collections/%2B*
Disallow	/collections/filter%26filter*
Disallow	/blogs/%2B
Disallow	/blogs/%2B
Disallow	/blogs/%2B
Disallow	//blogs/%2B*
Disallow	//blogs/%2B*
Disallow	//blogs/%2B*
Disallow	/?oseid=*
Disallow	/preview_theme_id
Disallow	/preview_script_id
Disallow	/policies/
Disallow	/*/policies/
Disallow	//?ls=&ls=*
Disallow	//?ls%3D%3Fls%3D*
Disallow	//?ls%3D%3Fls%3D*
Disallow	/search
Disallow	/apple-app-site-association
Disallow	/.well-known/shopify/monorail
Disallow	/cdn/wpm/*.js
Disallow	/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	//products/-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	/collections//products/-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	//collections//products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Rule

Path

Disallow

/a/downloads/-/*

Disallow

/admin

Disallow

/cart

Disallow

/orders

Disallow

/checkouts/

Disallow

/checkout

Disallow

/19437603/checkouts

Disallow

/19437603/orders

Disallow

/carts

Disallow

/account

Disallow

/collections/*sort_by*

Disallow

/*/collections/*sort_by*

Disallow

/collections/*%2B*

Disallow

/collections/*%2B*

Disallow

/collections/*%2B*

Disallow

/*/collections/*%2B*

Disallow

/*/collections/*%2B*

Disallow

/*/collections/*%2B*

Disallow

*/collections/*filter*%26*filter*

Disallow

/blogs/*%2B*

Disallow

/blogs/*%2B*

Disallow

/blogs/*%2B*

Disallow

/*/blogs/*%2B*

Disallow

/*/blogs/*%2B*

Disallow

/*/blogs/*%2B*

Disallow

/*?*oseid=*

Disallow

/*preview_theme_id*

Disallow

/*preview_script_id*

Disallow

/policies/

Disallow

/*/policies/

Disallow

/*/*?*ls=*&ls=*

Disallow

/*/*?*ls%3D*%3Fls%3D*

Disallow

/*/*?*ls%3D*%3Fls%3D*

Disallow

/search

Disallow

/apple-app-site-association

Disallow

/.well-known/shopify/monorail

Disallow

/cdn/wpm/*.js

Disallow

/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/collections/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/*/collections/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Other Records

Field	Value
crawl-delay	10

Field

Value

crawl-delay

ahrefssiteaudit

Rule	Path
Disallow	/a/downloads/-/*
Disallow	/admin
Disallow	/cart
Disallow	/orders
Disallow	/checkouts/
Disallow	/checkout
Disallow	/19437603/checkouts
Disallow	/19437603/orders
Disallow	/carts
Disallow	/account
Disallow	/collections/sort_by
Disallow	//collections/sort_by*
Disallow	/collections/%2B
Disallow	/collections/%2B
Disallow	/collections/%2B
Disallow	//collections/%2B*
Disallow	//collections/%2B*
Disallow	//collections/%2B*
Disallow	/collections/filter%26filter*
Disallow	/blogs/%2B
Disallow	/blogs/%2B
Disallow	/blogs/%2B
Disallow	//blogs/%2B*
Disallow	//blogs/%2B*
Disallow	//blogs/%2B*
Disallow	/?oseid=*
Disallow	/preview_theme_id
Disallow	/preview_script_id
Disallow	/policies/
Disallow	/*/policies/
Disallow	//?ls=&ls=*
Disallow	//?ls%3D%3Fls%3D*
Disallow	//?ls%3D%3Fls%3D*
Disallow	/search
Disallow	/apple-app-site-association
Disallow	/.well-known/shopify/monorail
Disallow	/cdn/wpm/*.js
Disallow	/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	//products/-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	/collections//products/-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow	//collections//products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Rule

Path

Disallow

/a/downloads/-/*

Disallow

/admin

Disallow

/cart

Disallow

/orders

Disallow

/checkouts/

Disallow

/checkout

Disallow

/19437603/checkouts

Disallow

/19437603/orders

Disallow

/carts

Disallow

/account

Disallow

/collections/*sort_by*

Disallow

/*/collections/*sort_by*

Disallow

/collections/*%2B*

Disallow

/collections/*%2B*

Disallow

/collections/*%2B*

Disallow

/*/collections/*%2B*

Disallow

/*/collections/*%2B*

Disallow

/*/collections/*%2B*

Disallow

*/collections/*filter*%26*filter*

Disallow

/blogs/*%2B*

Disallow

/blogs/*%2B*

Disallow

/blogs/*%2B*

Disallow

/*/blogs/*%2B*

Disallow

/*/blogs/*%2B*

Disallow

/*/blogs/*%2B*

Disallow

/*?*oseid=*

Disallow

/*preview_theme_id*

Disallow

/*preview_script_id*

Disallow

/policies/

Disallow

/*/policies/

Disallow

/*/*?*ls=*&ls=*

Disallow

/*/*?*ls%3D*%3Fls%3D*

Disallow

/*/*?*ls%3D*%3Fls%3D*

Disallow

/search

Disallow

/apple-app-site-association

Disallow

/.well-known/shopify/monorail

Disallow

/cdn/wpm/*.js

Disallow

/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/collections/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Disallow

/*/collections/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Other Records

Field	Value
crawl-delay	10

Field

Value

crawl-delay

mj12bot

No rules defined. All paths allowed.

Other Records

Field	Value
crawl-delay	10

Field

Value

crawl-delay

No rules defined. All paths allowed.

Other Records

Field	Value
crawl-delay	1

Field

Value

crawl-delay

chatgpt-user

Rule	Path
Allow	/

Rule

Path

Allow

gptbot

Rule	Path
Allow	/

Rule

Path

Allow

googlebot

Rule	Path
Allow	/

Rule

Path

Allow

google-extended

Rule	Path
Allow	/

Rule

Path

Allow

anthropic-bot

Rule	Path
Allow	/

Rule

Path

Allow

claudebot

Rule	Path
Allow	/

Rule

Path

Allow

ccbot

Rule	Path
Allow	/

Rule

Path

Allow

geminibot

Rule	Path
Allow	/

Rule

Path

Allow

teslabot

Rule	Path
Allow	/

Rule

Path

Allow

grok

Rule	Path
Allow	/

Rule

Path

Allow

*

Rule	Path
Disallow	/admin
Disallow	/cart
Disallow	/checkout
Disallow	/orders
Disallow	/account
Allow	/

Rule

Path

Disallow

/admin

Disallow

/cart

Disallow

/checkout

Disallow

/orders

Disallow

/account

Allow

Other Records

Field	Value
sitemap	https://pescience.com/sitemap.xml
sitemap	https://pescience.com/sitemap.xml
sitemap	https://pescience.com/sitemap.xml

Field

Value

sitemap

https://pescience.com/sitemap.xml

sitemap

https://pescience.com/sitemap.xml

sitemap

https://pescience.com/sitemap.xml

Comments

we use Shopify as our ecommerce platform

pescience.comrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

*

adsbot-google

nutch

ahrefsbot

Other Records

ahrefssiteaudit

Other Records

mj12bot

Other Records

pinterest

Other Records

chatgpt-user

gptbot

googlebot

google-extended

anthropic-bot

claudebot

ccbot

geminibot

teslabot

grok

*

Other Records

Comments

pescience.com
robots.txt