semagi.com
robots.txt
Robots Exclusion Standard data for semagi.com
Resource Scan
Scan Details
| Site Domain | semagi.com |
| Base Domain | semagi.com |
| Scan Status | Ok |
| Last Scan | 2025-09-06T09:47:07+00:00 |
| Next Scan | 2025-10-06T09:47:07+00:00 |
Last Scan
| Scanned | 2025-09-06T09:47:07+00:00 |
| URL | https://semagi.com/robots.txt |
| Domain IPs | 34.149.120.3, 34.160.81.203, 35.190.31.54, 35.244.153.44 |
| Response IP | 34.149.120.3 |
| Found | Yes |
| Hash | a44602f53d769289a3ac608299964bbf37a9182ea47041db1a5d7f039ccec8ad |
| SimHash | e7e11ac3591d |
Groups
*
| Rule | Path |
|---|---|
| Allow | /wp-admin/admin-ajax.php |
| Allow | /*/*.css |
| Allow | /*/*.js |
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /readme.html |
| Disallow | /license.txt |
| Disallow | /xmlrpc.php |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | */disclaimer/* |
| Disallow | *?attachment_id= |
| Disallow | /privacy-policy |
| Disallow | /wishlist-2/ |
| Disallow | /wishlist/ |
| Disallow | /store-locator/ |
| Disallow | /shop-item-style/ |
| Disallow | /sample-page/ |
| Disallow | /shop/ |
| Disallow | /order-tracking/ |
| Disallow | /my-account-2/ |
| Disallow | /my-account/ |
| Disallow | /checkout/ |
| Disallow | /checkout-2/ |
| Disallow | /cart-2/ |
| Disallow | /cart/ |
| Disallow | /product-tag/ |
| Disallow | /product/calvin-shorts/feed/ |
| Disallow | /product-category/ |
| Disallow | /feed/ |
| Disallow | /product/holiday-nuts-gift-basket/ |
| Disallow | /hello-world/ |
| Disallow | /home-4/ |
| Disallow | /home-6/ |
| Disallow | /home-3/ |
| Disallow | /home-8/ |
| Disallow | /category/beauty/ |
| Disallow | /category/uncategorized/ |
| Disallow | /product/500-tokens/ |
| Disallow | /category/company/ |
| Disallow | /shop-2/ |
| Disallow | /home-11/ |
| Disallow | /shop-item-style/ |
| Disallow | /home-7/ |
| Disallow | /home-5/ |
| Disallow | /home-1/ |
| Disallow | /category/style/ |
| Disallow | /tree-earth-fowl-given-moveth-deep-lesser-after/ |
| Disallow | /heaven-upon-heaven-moveth-every-have/ |
| Disallow | /given-set-was-without-from-god-divide-rule-hath/ |
Comments