supply24.online
robots.txt
Robots Exclusion Standard data for supply24.online
Resource Scan
Scan Details
Site Domain | supply24.online |
Base Domain | supply24.online |
Scan Status | Ok |
Last Scan | 2024-05-21T21:44:24+00:00 |
Next Scan | 2024-06-20T21:44:24+00:00 |
Last Scan
Scanned | 2024-05-21T21:44:24+00:00 |
URL | https://supply24.online/robots.txt |
Domain IPs | 104.21.12.76, 172.67.131.243, 2606:4700:3030::ac43:83f3, 2606:4700:3031::6815:c4c |
Response IP | 104.21.12.76 |
Found | Yes |
Hash | 1ccfbec92fbf33288e1b028dcbae665dd2a0645807d499c37c6f53345d8381f5 |
SimHash | b93db6630a65 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /cart/ |
Disallow | /login/ |
Disallow | /forgot-password/ |
Disallow | /*/compare |
Disallow | /*affiliate* |
Disallow | /*route%3Daccount/wishlist |
Disallow | /wishlist/ |
Disallow | /catalog/ |
Disallow | /downloads/ |
Disallow | /export |
Disallow | /system |
Disallow | /*-account/ |
Disallow | /*captcha |
Disallow | /*privacy |
Disallow | /address-book/ |
Disallow | /change-password/ |
Disallow | /register_account/ |
Disallow | /contact-us/* |
Disallow | /newsletter/ |
Disallow | /reward-points/ |
Disallow | /*route%3Dinformation/contact/success |
Disallow | /*route%3Daccount/* |
Disallow | /*route%3Dinformation/information/agree* |
Disallow | /*route%3Dindex.php?route=api%2Forder%2Fhistory* |
Disallow | /returns/ |
Disallow | /transactions/ |
Disallow | /change-password/ |
Disallow | /address-book/ |
Disallow | /order-history/ |
Disallow | /newsletter/ |
Disallow | /*route%3Dcommon/cart/* |
Disallow | /*route%3Dcommon/home |
Disallow | /*route%3Dcheckout/oct_fastorder%26lctoken%3D* |
Disallow | /*route%3Dcheckout/oct_fastorder/* |
Disallow | /*route%3Dcheckout/success |
Disallow | /*route%3Dproduct/product/breadlistcr%26cat_id%3D* |
Disallow | /*route%3Dproduct/product/getAutoRels%26product_id%3D* |
Disallow | /*route%3Dproduct/product/update_prices |
Disallow | /*route%3Dtool/losted_cart_api/collector |
Disallow | /*?limit=* |
Disallow | /*%26limit%3D* |
Disallow | /*?sort=* |
Disallow | /*%26sort%3D* |
Disallow | /*?order= |
Disallow | /*%26order%3D |
Disallow | /*?oct_filter=* |
Disallow | /*%26oct_filter%3D* |
Disallow | /*search%3D* |
Disallow | /*tag%3D* |
Disallow | /*country_id%3D* |
Disallow | /*order_id%3D* |
Disallow | /*language_id%3D* |
Disallow | /*store_id%3D* |
Disallow | /*customer_group_id%3D* |
Disallow | /*currency%3D* |
Disallow | /*keyword%3D* |
Allow | /*.js |
Allow | /*.css |
Allow | /*.xsl |
Allow | /*.jpg |
Allow | /*.jpeg |
Allow | /*.gif |
Allow | /*.png |
Allow | /*.webp |
Allow | /*route%3Dproduct/product/review* |
Allow | *.svg |
Allow | *.ttf |
Allow | *.woff2 |
Allow | *.woff |
Allow | *index.php?route=extension%2Ffeed%2Fyandex_yml* |
Allow | *index.php?route=octemplates%2Fblog_category%2Fsitemap |
Other Records
Field | Value |
---|---|
sitemap | https://supply24.online/fx-sitemap/ |
sitemap | https://supply24.online/index.php?route=octemplates/blog_category/sitemap |