modernplanet.com
robots.txt
Robots Exclusion Standard data for modernplanet.com
Resource Scan
Scan Details
| Site Domain | modernplanet.com |
| Base Domain | modernplanet.com |
| Scan Status | Ok |
| Last Scan | 2024-09-08T14:17:57+00:00 |
| Next Scan | 2024-10-08T14:17:57+00:00 |
Last Scan
| Scanned | 2024-09-08T14:17:57+00:00 |
| URL | https://modernplanet.com/robots.txt |
| Domain IPs | 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132 |
| Response IP | 151.101.130.132 |
| Found | Yes |
| Hash | 4dbb2a83be553f49fa3d488f7e1002a995cc1d9041abb5377ab6dcd15d40b208 |
| SimHash | eaac2301c0f3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /app/ |
| Disallow | /cgi-bin/ |
| Disallow | /downloader/ |
| Disallow | /errors/ |
| Disallow | /includes/ |
| Disallow | /lib/ |
| Disallow | /magento/ |
| Disallow | /pkginfo/ |
| Disallow | /report/ |
| Disallow | /scripts/ |
| Disallow | /shell/ |
| Disallow | /stats/ |
| Disallow | /var/ |
| Disallow | /catalog/category/view/ |
| Disallow | /catalog/product/view/ |
| Disallow | /catalogsearch/ |
| Disallow | /checkout/ |
| Disallow | /checkout/onepage/ |
| Disallow | /checkout/onepage/billing/ |
| Disallow | /checkout/onepage/shipping/ |
| Disallow | /checkout/onepage/shipping_method/ |
| Disallow | /checkout/onepage/payment/ |
| Disallow | /checkout/onepage/review/ |
| Disallow | /checkout/onepage/success/ |
| Disallow | /onestepcheckout/ |
| Disallow | /control/ |
| Disallow | /contacts/ |
| Disallow | /customer/ |
| Disallow | /customize/ |
| Disallow | /newsletter/ |
| Disallow | /poll/ |
| Disallow | /review/ |
| Disallow | /sendfriend/ |
| Disallow | /tag/ |
| Disallow | /wishlist/ |
| Disallow | /*?SID= |
| Disallow | /*?___SID=* |
| Disallow | /*%26___SID%3D* |
| Disallow | /*?limit=all |
| Disallow | /*?dir=* |
| Disallow | /*%26dir%3D* |
| Disallow | /*?mode=* |
| Disallow | /*%26mode%3D* |
| Disallow | /*?order=* |
| Disallow | /*%26order%3D* |
| Disallow | /*%26p%3D* |
| Disallow | /*?p=*& |
| Disallow | /textiles* |
| Disallow | /*cat%3D* |
| Disallow | /*cat_b%3D* |
| Disallow | /*cat_i%3D* |
| Disallow | /*cat_o%3D* |
| Disallow | /*cat_s%3D* |
| Disallow | /*cat_t%3D* |
| Disallow | /*designer%3D* |
| Disallow | /*price%3D* |
| Disallow | /*material%3D* |
| Disallow | /*product_list_order%3D* |
| Disallow | /*product_list_order%3D* |
| Allow | /*?p= |
| Allow | / |
Warnings
- 2 invalid lines.