teepublic.com
robots.txt
Robots Exclusion Standard data for teepublic.com
Resource Scan
Scan Details
| Site Domain | teepublic.com |
| Base Domain | teepublic.com |
| Scan Status | Ok |
| Last Scan | 2024-06-17T08:12:24+00:00 |
| Next Scan | 2024-07-17T08:12:24+00:00 |
Last Scan
| Scanned | 2024-06-17T08:12:24+00:00 |
| URL | https://teepublic.com/robots.txt |
| Redirect | https://www.teepublic.com/robots.txt |
| Redirect Domain | www.teepublic.com |
| Redirect Base | teepublic.com |
| Domain IPs | 108.156.133.44, 108.156.133.82, 108.156.133.9, 108.156.133.90 |
| Redirect IPs | 104.18.24.3, 104.18.25.3, 2606:4700::6812:1803, 2606:4700::6812:1903 |
| Response IP | 104.18.24.3 |
| Found | Yes |
| Hash | 8f8aa301e9146f176bc482f616f4e43cda85708e6e150b06c7de857dc1ad3567 |
| SimHash | e1a4ac3f7462 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /kids-long-sleeve-t-shirt/*?feed_sku* |
| Allow | /tote/*?countrycode* |
| Disallow | /*/poll_avatar |
| Disallow | /*/poll_banner |
| Disallow | /*%3D%3D$ |
| Disallow | /*?*canvas_subclass= |
| Disallow | /*?*color= |
| Disallow | /*?*gender= |
| Disallow | /*?*product_id= |
| Disallow | /*?*query= |
| Disallow | /*?*scroll_id= |
| Disallow | /*?*sort= |
| Disallow | /404 |
| Disallow | /422 |
| Disallow | /500 |
| Disallow | /503 |
| Disallow | /cart |
| Disallow | /cdn-cgi/* |
| Disallow | /checkout |
| Disallow | /designs/*/edit |
| Disallow | /following |
| Disallow | /gift-ideas |
| Disallow | /gifting-module/* |
| Disallow | /header |
| Disallow | /kids-long-sleeve-t-shirt/* |
| Disallow | /kids-long-sleeve-t-shirts |
| Disallow | /kids-long-sleeve-t-shirts/* |
| Disallow | /laptop-case |
| Disallow | /laptop-case/* |
| Disallow | /my-store |
| Disallow | /new_campaign |
| Disallow | /notebook |
| Disallow | /notebook/* |
| Disallow | /stores/*/kids-long-sleeve-t-shirts |
| Disallow | /stores/*/laptop-case |
| Disallow | /stores/*/notebook |
| Disallow | /stores/*/totes |
| Disallow | /tote/* |
| Disallow | /totes |
| Disallow | /totes/* |
| Disallow | /stores/*/baby-bodysuits |
| Disallow | /baby-bodysuit/* |
| Disallow | /baby-bodysuits |
| Disallow | /baby-bodysuits/* |
| Disallow | /user/*/kids-long-sleeve-t-shirts |
| Disallow | /user/*/laptop-case |
| Disallow | /user/*/notebook |
| Disallow | /user/*/totes |
| Disallow | /user/*/baby-bodysuits |
| Disallow | /users/password |
| Disallow | /*US_CENSUS_NAME* |
| Disallow | /designs/*/canvas/*/also_available_as |
| Disallow | /designs/*/canvas/*/also-available-products |
| Disallow | /designs/*/canvas/*/product_images |
| Disallow | /designs/*/canvas/*/similar_products |
| Disallow | /lazyload_cart_component_content |
| Disallow | /lazyload_cart_tray_content |
| Disallow | /lazyload_shop_tray_best_sellers_content |
| Disallow | /shop_designs_button |
| Disallow | /tray_trending_tags |
| Disallow | /ab-test/* |
| Disallow | /de/ |
| Disallow | /en-au/ |
| Disallow | /en-gb/ |
| Disallow | /es-mx/ |
| Disallow | /fr/ |
| Disallow | /it/ |
| Disallow | /pl/ |
| Disallow | /*/*sexy-bf* |
| Disallow | /*/*bf-sexy* |
| Disallow | /*/*sexybf* |
| Disallow | /*/*indian-bf* |
| Disallow | /*/*sexi-bf* |
| Disallow | /*/*baby-alien-porn* |
| Disallow | /*/*xxx14* |
| Disallow | /*/*bangladeshi-bf* |
| Disallow | /*/*xxx12* |
| Disallow | /*/*shemale-tube* |
| Disallow | /*/*sexy-bf* |
| Disallow | /*/*bf-video* |
| Disallow | /*/*xxx15* |
| Disallow | /*/*bangla-bf* |
| Disallow | /*/*bengali-bf* |
| Disallow | /*/*xxx13* |
| Disallow | /*/*bangladeshi-bf-bangladeshi-bf* |
| Disallow | /*/*baby-alien-porno* |
| Disallow | /*/*xxx8* |
| Disallow | /*/*bangla-bf-video* |
| Disallow | /*/*bf-sexy* |
| Disallow | /*/*cute-porn* |
| Disallow | /*/*xxx10* |
| Disallow | /*/*porn-baby-alien* |
| Disallow | /*/*hot-fuck* |
| Disallow | /*/*tamil-aunty* |
| Disallow | /*/*bf-bangladeshi* |
| Disallow | /*/*bf-bangla* |
| Disallow | /*/*big-boobs-porn* |
pinterest/0.2 (+https://www.pinterest.com/bot.html)
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Comments