republicoftea.com
robots.txt

Robots Exclusion Standard data for republicoftea.com

Resource Scan

Scan Details

Site Domain republicoftea.com
Base Domain republicoftea.com
Scan Status Ok
Last Scan2024-05-20T15:03:40+00:00
Next Scan 2024-06-19T15:03:40+00:00

Last Scan

Scanned2024-05-20T15:03:40+00:00
URL https://republicoftea.com/robots.txt
Redirect https://www.republicoftea.com/robots.txt
Redirect Domain www.republicoftea.com
Redirect Base republicoftea.com
Domain IPs 18.67.39.11, 18.67.39.128, 18.67.39.42, 18.67.39.47
Redirect IPs 18.244.214.104, 18.244.214.124, 18.244.214.23, 18.244.214.66
Response IP 108.157.60.2
Found Yes
Hash f90ecca87b1a090b2c75727257a69c52fad9ed8d2956b438358be0c648d271c6
SimHash c200df6cc303

Groups

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow */filter
Disallow /controls/
Disallow /logs/
Disallow /bin/
Disallow /cart.aspx
Disallow /signin.aspx
Disallow /register.aspx
Disallow /checkoutsignin.aspx
Disallow /checkout.aspx
Disallow /summary.aspx
Disallow /embassy.aspx
Disallow /embassyform.aspx
Disallow /viewembassyrequest.aspx
Disallow /article.aspx?a=Z11
Disallow /Welcome-Back---Free-Shipping-On-Orders-Over-%2425/a/Z11/
Disallow /article/a/LIFEOFPI/
Disallow /LIFEOFPI/a/LIFEOFPI/
Disallow /Limited-Time-Gift-with-Purchase/c/test2/
Disallow /ClickMailFeed.aspx
Disallow /SLIDataFeedProduct.aspx
Disallow /SLI5StarProducts.aspx
Disallow /SMTRCategoryDefinitionFeed.aspx
Disallow /SMTRCategoryProductFeed.aspx
Disallow /SMTRCategoryRelationFeed.aspx
Disallow /SMTRFeedProduct.aspx
Disallow /ProductGroupReportData.aspx
Disallow /AdrollRemarketingAdsFeed.aspx
Disallow /AllProductAttributesFeed.aspx
Disallow /FailedOrderListNotification.aspx
Disallow /richrelevancecatalog.aspx
Disallow /ProductGroupReportData.aspx
Disallow /bogo1cuppa-72ct/c/bogo1cuppa72/
Disallow /vanilla-coconut-100-white-tea/p/41167/
Disallow /select-gift-tea/p/97020/
Disallow /ginger-pooch-tea-for-dogs/c/gingerpooch/
Disallow /get-dandelion-organic-herb-tea-for-rejuvenation/p/v20386/
Disallow /buy3get1/c/buy3get1/
Disallow /buy4get1/c/buy4get1/
Disallow /ceylon-infusing-pitcher/p/v20443/
Disallow /year-of-tea-sweepstakes/a/year-of-tea/
Disallow /year-of-tea-sweepstakes-december-2017/a/year-of-tea-dec-2017/
Disallow /year-of-tea-sweepstakes-april-2018/a/year-of-tea-apr-2018/
Disallow /sip-by-sip-auto-ship-free-premium-samples/a/sip-by-sip-auto-ship-samples/
Disallow /auto-ship-frequently-asked-questions/a/sip-by-sip-auto-ship-free-shipping/
Disallow /wholesale-terms-and-conditions/a/whsale-tc/
Disallow /publitasfeed.aspx
Disallow /quickview.aspx*
Disallow /search.aspx*

Other Records

Field Value
sitemap https://www.republicoftea.com/sitemap.xml

Comments

  • keep all bots out of the listed files and folders
  • Disallow: /favicon.ico
  • Disallow: /images/
  • Disallow: /styles/
  • Disallow: /javascript/