ybw.com
robots.txt
Robots Exclusion Standard data for ybw.com
Resource Scan
Scan Details
| Site Domain | ybw.com |
| Base Domain | ybw.com |
| Scan Status | Ok |
| Last Scan | 2024-05-29T18:08:11+00:00 |
| Next Scan | 2024-06-05T18:08:11+00:00 |
Last Scan
| Scanned | 2024-05-29T18:08:11+00:00 |
| URL | https://ybw.com/robots.txt |
| Redirect | https://www.ybw.com/robots.txt |
| Redirect Domain | www.ybw.com |
| Redirect Base | ybw.com |
| Domain IPs | 34.241.23.183 |
| Redirect IPs | 151.101.130.114, 151.101.194.114, 151.101.2.114, 151.101.66.114 |
| Response IP | 199.232.46.114 |
| Found | Yes |
| Hash | 7680cb01323dfcf7c627f7d5c4e8306396cde0381b65edb63af61248dd0d3757 |
| SimHash | dba0d35560ef |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | *?s=* |
| Disallow | /search/* |
| Disallow | /reviews?*period= |
| Disallow | /reviews?s= |
| Disallow | /reviews?*sorting= |
| Disallow | /reviews?*product_type= |
| Disallow | /reviews?*brands= |
| Disallow | /guide?*period= |
| Disallow | /guide?*&s= |
| Disallow | /guide?*brands= |
| Disallow | /guide?*product_type= |
| Disallow | /recipes?s= |
| Disallow | /recipes?*&s= |
| Disallow | /recipes/?*&s= |
| Disallow | /recipes/tag/*?s= |
| Disallow | /recipes/tag/*/?s= |
| Disallow | /recipes/tag/*?*&s= |
| Disallow | /recipes/tag/*/?*&s= |
| Disallow | /wp-json/* |
| Disallow | /discount-codes/discount-codes/visit |
| Disallow | /vouchers/vouchers/visit |
| Disallow | */utils* |
| Disallow | */utils/definitions |
| Disallow | */ChildVisitor |
| Disallow | */ProxyVisitor |
| Disallow | */encode |
| Disallow | */decode |
| Disallow | */definitions |
| Disallow | */Message |
| Disallow | */consent-string |
| Disallow | */PlaceholderVisitor |
| Disallow | */enums* |
| Disallow | /wp-content/plugins/keystone-taboola/assets/js/taboola.js* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.ybw.com/sitemap.xml |
Comments