best24news.com
robots.txt
Robots Exclusion Standard data for best24news.com
Resource Scan
Scan Details
Site Domain | best24news.com |
Base Domain | best24news.com |
Scan Status | Ok |
Last Scan | 2024-05-13T04:44:42+00:00 |
Next Scan | 2024-05-20T04:44:42+00:00 |
Last Scan
Scanned | 2024-05-13T04:44:42+00:00 |
URL | https://best24news.com/robots.txt |
Domain IPs | 2a02:4780:38:63a0:7410:402a:f445:4520, 84.32.84.155 |
Response IP | 179.61.189.112 |
Found | Yes |
Hash | 3330a6076d7af076f70558d7e5bbf803b5b2cf00c221ee6fe8e7605256da21e1 |
SimHash | 68294a40ed93 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /dgd_scrollbox/ |
Warnings
- `https` is not a known field.
Comments