mby.com
robots.txt
Robots Exclusion Standard data for mby.com
Resource Scan
Scan Details
| Site Domain | mby.com |
| Base Domain | mby.com |
| Scan Status | Ok |
| Last Scan | 2024-06-29T11:20:06+00:00 |
| Next Scan | 2024-07-06T11:20:06+00:00 |
Last Scan
| Scanned | 2024-06-29T11:20:06+00:00 |
| URL | https://mby.com/robots.txt |
| Redirect | https://www.mby.com/robots.txt |
| Redirect Domain | www.mby.com |
| Redirect Base | mby.com |
| Domain IPs | 34.241.23.183 |
| Redirect IPs | 151.101.130.114, 151.101.194.114, 151.101.2.114, 151.101.66.114 |
| Response IP | 199.232.46.114 |
| Found | Yes |
| Hash | 788d14501c83ffbd90c290a0e08a1549fa8521b246bd7893e792f1a654419f60 |
| SimHash | dfa0f355e0af |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | *?s=* |
| Disallow | /search/* |
| Disallow | /reviews?*period= |
| Disallow | /reviews?s= |
| Disallow | /reviews?*sorting= |
| Disallow | /reviews?*product_type= |
| Disallow | /reviews?*brands= |
| Disallow | /guide?*period= |
| Disallow | /guide?*&s= |
| Disallow | /guide?*brands= |
| Disallow | /guide?*product_type= |
| Disallow | /recipes?s= |
| Disallow | /recipes?*&s= |
| Disallow | /recipes/?*&s= |
| Disallow | /recipes/tag/*?s= |
| Disallow | /recipes/tag/*/?s= |
| Disallow | /recipes/tag/*?*&s= |
| Disallow | /recipes/tag/*/?*&s= |
| Disallow | /wp-json/* |
| Disallow | /discount-codes/discount-codes/visit |
| Disallow | /vouchers/vouchers/visit |
| Disallow | */utils* |
| Disallow | */utils/definitions |
| Disallow | */ChildVisitor |
| Disallow | */ProxyVisitor |
| Disallow | */encode |
| Disallow | */decode |
| Disallow | */definitions |
| Disallow | */Message |
| Disallow | */consent-string |
| Disallow | */PlaceholderVisitor |
| Disallow | */enums* |
| Disallow | /wp-content/plugins/keystone-taboola/assets/js/taboola.js* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mby.com/sitemap.xml |
Comments