douglaslabs.com
robots.txt
Robots Exclusion Standard data for douglaslabs.com
Resource Scan
Scan Details
Site Domain | douglaslabs.com |
Base Domain | douglaslabs.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-23T08:10:10+00:00 |
Next Scan | 2024-12-22T08:10:10+00:00 |
Last Successful Scan
Scanned | 2023-02-09T01:39:43+00:00 |
URL | https://douglaslabs.com/robots.txt |
Redirect | https://www.douglaslabs.com/robots.txt |
Redirect Domain | www.douglaslabs.com |
Redirect Base | douglaslabs.com |
Domain IPs | 3.224.123.132, 35.171.238.11 |
Redirect IPs | 23.215.7.30, 23.215.7.32, 2600:1413:b000:1b::17d7:71e, 2600:1413:b000:1b::17d7:720 |
Response IP | 23.215.7.30 |
Found | Yes |
Hash | 8de04b4f6d1eef907cccb3425910649258509a1c38f6c9b717e72fc2decda8fa |
SimHash | 3c04e195a2f8 |
Groups
*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider
Rule | Path |
---|---|
Disallow | */CHANGELOG.md |
Disallow | */composer.json |
Disallow | */composer.lock |
Disallow | */CONTRIBUTING.md |
Disallow | */CONTRIBUTOR_LICENSE_AGREEMENT.html |
Disallow | */COPYING.txt |
Disallow | */Gruntfile.js |
Disallow | */ISSUE_TEMPLATE.md |
Disallow | */LICENSE.html |
Disallow | */LICENSE.txt |
Disallow | */LICENSE_AFL.txt |
Disallow | */nginx.conf.sample |
Disallow | */package.json |
Disallow | */package.json.sample |
Disallow | */php.ini.sample |
Disallow | */RELEASE_NOTES.txt |
Disallow | */bbdl-registration |
Disallow | */bbdl-registration/ |
*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider
Rule | Path |
---|---|
Disallow | */account/ |
Disallow | */address/ |
Disallow | */app/ |
Disallow | */bin/ |
Disallow | */cart/ |
Disallow | */catalogsearch/ |
Disallow | */checkout/ |
Disallow | */contacts/ |
Disallow | */control/ |
Disallow | */customer/ |
Disallow | */CVS/ |
Disallow | */dev/ |
Disallow | */giftcard/ |
Disallow | */guest/ |
Disallow | */index.php/ |
Disallow | */newsletter/ |
Disallow | */order/ |
Disallow | */phpserver/ |
Disallow | */product_compare/ |
Disallow | */report/ |
Disallow | */review/ |
Disallow | */sales/ |
Disallow | */sendfriend/ |
Disallow | */setup/ |
Disallow | */shell/ |
Disallow | */storecredit/ |
Disallow | */update/ |
Disallow | */var/ |
Disallow | */vault/ |
Disallow | */vendor/ |
Disallow | */wishlist/ |
Disallow | */bbdl-registration |
Disallow | */bbdl-registration/ |
*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider
Rule | Path |
---|---|
Disallow | /*.CVS |
Disallow | /*.Idea$ |
Disallow | /*.Sql$ |
Disallow | /*.Svn$ |
Disallow | /*.Tgz$ |
Disallow | /*.Zip$ |
*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider
Rule | Path |
---|---|
Disallow | /*.php$ |
Disallow | /*SID%3D |
Disallow | /*sid%3D |
*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider
Rule | Path |
---|---|
Disallow | /*%26allergen_indicators%3D |
Disallow | /*?allergen_indicators= |
Disallow | /*%26delivery_format%3D |
Disallow | /*?delivery_format= |
Disallow | /*%26product_list_dir%3D |
Disallow | /*?product_list_dir= |
Disallow | /*%26product_list_limit%3D |
Disallow | /*?product_list_limit= |
Disallow | /*%26product_list_mode%3D |
Disallow | /*?product_list_mode= |
Disallow | /*%26product_list_order%3D |
Disallow | /*?product_list_order= |
Disallow | /*%26Price_range%3D |
Disallow | /*?Price_range= |
Disallow | /*%26q%3D |
Disallow | /*?q= |
Disallow | /*%26p%3D |
Disallow | /*?p= |
Disallow | /*%26cat%3D |
Disallow | /*?cat= |
Disallow | /*?* |
Disallow | /friends-and-family |
Other Records
Field | Value |
---|---|
sitemap | https://www.douglaslabs.com/sitemap.xml |
Comments