pureencapsulationspro.com
robots.txt

Robots Exclusion Standard data for pureencapsulationspro.com

Resource Scan

Scan Details

Site Domain pureencapsulationspro.com
Base Domain pureencapsulationspro.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-26T23:11:08+00:00
Next Scan 2024-06-24T23:11:08+00:00

Last Successful Scan

Scanned2023-02-08T16:36:36+00:00
URL https://pureencapsulationspro.com/robots.txt
Redirect https://www.pureencapsulationspro.com/robots.txt
Redirect Domain www.pureencapsulationspro.com
Redirect Base pureencapsulationspro.com
Domain IPs 3.224.123.132, 35.171.238.11
Redirect IPs 23.209.46.135, 23.209.46.138, 2600:1413:b000:1c::17d1:2ecb, 2600:1413:b000:1c::17d1:2ecf
Response IP 23.52.40.59
Found Yes
Hash aa1a6f1e8efb8a1ce4dea606e7563c5f7d09c965e254e75fab979f1407f292b4
SimHash 3c0ce29502b8

Groups

baiduspider
blexbot
yandex

Rule Path
Disallow /

*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider
semrushbot

Rule Path
Disallow */CHANGELOG.md
Disallow */composer.json
Disallow */composer.lock
Disallow */CONTRIBUTING.md
Disallow */CONTRIBUTOR_LICENSE_AGREEMENT.html
Disallow */COPYING.txt
Disallow */Gruntfile.js
Disallow */ISSUE_TEMPLATE.md
Disallow */LICENSE.html
Disallow */LICENSE.txt
Disallow */LICENSE_AFL.txt
Disallow */nginx.conf.sample
Disallow */package.json
Disallow */package.json.sample
Disallow */php.ini.sample
Disallow */RELEASE_NOTES.txt

*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider
semrushbot

Rule Path
Disallow */account/
Disallow */address/
Disallow */app/
Disallow */bin/
Disallow */cart/
Disallow */catalog/
Disallow */catalogsearch/
Disallow */checkout/
Disallow */contacts/
Disallow */control/
Disallow */customer/
Disallow */CVS/
Disallow */dev/
Disallow */giftcard/
Disallow */guest/
Disallow */index.php/
Disallow */newsletter/
Disallow */order/
Disallow */phpserver/
Disallow */product_compare/
Disallow */report/
Disallow */review/
Disallow */sales/
Disallow */sendfriend/
Disallow */setup/
Disallow */shell/
Disallow */storecredit/
Disallow */update/
Disallow */var/
Disallow */vault/
Disallow */vendor/
Disallow */wishlist/

*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider
semrushbot

Rule Path
Disallow /*.CVS
Disallow /*.Idea$
Disallow /*.Sql$
Disallow /*.Svn$
Disallow /*.Tgz$
Disallow /*.Zip$

*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider
semrushbot

Rule Path
Disallow /*.php$
Disallow /*SID%3D
Disallow /*sid%3D

*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider
semrushbot

Rule Path
Disallow /*%26allergen_indicators%3D
Disallow /*?allergen_indicators=
Disallow /*%26delivery_format%3D
Disallow /*?delivery_format=
Disallow /*%26product_list_dir%3D
Disallow /*?product_list_dir=
Disallow /*%26product_list_limit%3D
Disallow /*?product_list_limit=
Disallow /*%26product_list_mode%3D
Disallow /*?product_list_mode=
Disallow /*%26product_list_order%3D
Disallow /*?product_list_order=
Disallow /*%26Price_range%3D
Disallow /*?Price_range=
Disallow /*%26q%3D
Disallow /*?q=
Disallow /*%26p%3D
Disallow /*?p=
Disallow /*%26cat%3D
Disallow /*?cat=
Disallow /*?*

*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider
semrushbot

Rule Path
Disallow /resources
Disallow /product-unavailable
Disallow /friends-and-family

Other Records

Field Value
sitemap https://www.pureencapsulationspro.com/sitemap.xml

Comments

  • Bad Bots
  • Files
  • Directories
  • CVS SVN directory and dump files
  • Session ID
  • Parameters
  • Pages