Log In Sign Up

opticsplanet.com
robots.txt

Robots Exclusion Standard data for opticsplanet.com

Resource Scan

Scan Details

Site Domain opticsplanet.com
Base Domain opticsplanet.com
Scan Status Ok
Last Scan2024-06-14T00:17:11+00:00
Next Scan 2024-06-28T00:17:11+00:00

Last Scan

Scanned2024-06-14T00:17:11+00:00
URL https://opticsplanet.com/robots.txt
Redirect https://www.opticsplanet.com/robots.txt
Redirect Domain www.opticsplanet.com
Redirect Base opticsplanet.com
Domain IPs 13.59.111.21, 3.19.46.72, 3.21.146.26
Redirect IPs 192.229.179.188
Response IP 192.229.179.188
Found Yes
Hash b6750800702b0fab3915999ec60f4cf966c720531b92dc13ff8a51ddb74fa162
SimHash cc3a6547fd40

Groups

*

Rule Path
Disallow /staging/
Disallow /cgi-bin/
Disallow /RT/
Disallow /TG/
Disallow /QS/
Disallow /wgl/
Disallow /P/
Disallow /ymix/
Disallow /OS/
Disallow /cs/
Disallow /en%3D
Disallow /p/s%3D
Disallow /bt%3D
Disallow /sid%3D
Disallow /io%3D
Disallow /ii%3D
Disallow /api/
Disallow /iv-api/
Disallow /checkout/
Disallow /email/manage
Disallow /email/unsubscribe
Disallow /fed-experiments-7ae6f108-47ff-4853-ad45-c50e7f1fc5e9/
Disallow /utc-time

roverbot

Rule Path
Disallow /

spotbot

Rule Path
Disallow /

fatbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

halebot

Rule Path
Disallow /
Disallow /plugins/feedback.php
Back to top

Other Records

Field Value
sitemap https://www.opticsplanet.com/sitemap.product.orderable.rap.index.xml
sitemap https://www.opticsplanet.com/sitemap.info.flag.free-second-day-air.index.xml
sitemap https://www.opticsplanet.com/sitemap.search_results.index.xml
sitemap https://www.opticsplanet.com/sitemap.info.grid.index.xml
sitemap https://www.opticsplanet.com/sitemap.dynamic_landing.index.xml
sitemap https://www.opticsplanet.com/sitemap.howto.index.xml
sitemap https://www.opticsplanet.com/sitemap.info.content.index.xml
sitemap https://www.opticsplanet.com/sitemap.info.flag.best-rated.index.xml
sitemap https://www.opticsplanet.com/sitemap.info.flag.clearance.index.xml
sitemap https://www.opticsplanet.com/sitemap.info.flag.coupons.index.xml
sitemap https://www.opticsplanet.com/sitemap.info.flag.deals.index.xml
sitemap https://www.opticsplanet.com/sitemap.info.flag.demo.index.xml
sitemap https://www.opticsplanet.com/sitemap.info.flag.extra-bucks.index.xml
sitemap https://www.opticsplanet.com/sitemap.info.flag.final-sale.index.xml
sitemap https://www.opticsplanet.com/sitemap.info.flag.outlet.index.xml
sitemap https://www.opticsplanet.com/sitemap.info.flag.on-sale.index.xml
sitemap https://www.opticsplanet.com/sitemap.info.flag.made-in-usa.index.xml
sitemap https://www.opticsplanet.com/sitemap.info.flag.other.index.xml
sitemap https://www.opticsplanet.com/sitemap.info.flag.new.index.xml
sitemap https://www.opticsplanet.com/sitemap.info.flag.rebate.index.xml
sitemap https://www.opticsplanet.com/sitemap.info.flag.unavailable.index.xml
sitemap https://www.opticsplanet.com/sitemap.info.flag.with-free-gifts.index.xml
sitemap https://www.opticsplanet.com/sitemap.list.brand.index.xml
sitemap https://www.opticsplanet.com/sitemap.list.brand_category.index.xml
sitemap https://www.opticsplanet.com/sitemap.list.category.index.xml
sitemap https://www.opticsplanet.com/sitemap.list.department.index.xml
sitemap https://www.opticsplanet.com/sitemap.list.family.index.xml
sitemap https://www.opticsplanet.com/sitemap.list.family_category.index.xml
sitemap https://www.opticsplanet.com/sitemap.other.index.xml
sitemap https://www.opticsplanet.com/sitemap.product.orderable.index.xml
sitemap https://www.opticsplanet.com/sitemap.product.unorderable.index.xml
sitemap https://www.opticsplanet.com/sitemap.info.flag.shed.index.xml
sitemap https://www.opticsplanet.com/sitemap.qna.answers.index.xml
sitemap https://www.opticsplanet.com/sitemap.qna.questions.index.xml
sitemap https://www.opticsplanet.com/sitemap.reviews.author.index.xml
sitemap https://www.opticsplanet.com/sitemap.reviews.list.index.xml
sitemap https://www.opticsplanet.com/sitemap.reviews.review.index.xml
sitemap https://www.opticsplanet.com/sitemap.static.index.xml
sitemap https://www.opticsplanet.com/sitemap.store_reviews.index.xml
sitemap https://www.opticsplanet.com/sitemap.variant.unorderable.index.xml
sitemap https://www.opticsplanet.com/sitemap.variant.orderable.index.xml
sitemap https://www.opticsplanet.com/sitemap.product.unorderable.firearms.index.xml
sitemap https://www.opticsplanet.com/sitemap.xml
Back to top

Comments

  • Sitemaps
  • Cap is html
  • Rover is a bad dog <http://www.roverbot.com>
  • Block Indix.com
  • Block TheFind.com
  • Block CommonCrawl
  • Block Halebot (biggeye.tacitknowledge.com)
  • Googlebot doesn't work well with Facebook Comments
Back to top