bostecperu.com
robots.txt
Robots Exclusion Standard data for bostecperu.com
Resource Scan
Scan Details
| Site Domain | bostecperu.com |
| Base Domain | bostecperu.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-09-04T17:20:24+00:00 |
| Next Scan | 2024-12-03T17:20:24+00:00 |
Last Successful Scan
| Scanned | 2024-05-08T14:30:38+00:00 |
| URL | http://bostecperu.com/robots.txt |
| Redirect | https://ithethao.vn/robots.txt |
| Redirect Domain | ithethao.vn |
| Redirect Base | ithethao.vn |
| Domain IPs | 165.154.55.70 |
| Redirect IPs | 103.143.206.202 |
| Response IP | 103.143.206.202 |
| Found | Yes |
| Hash | 033f0ef69de41b86e0c58024c592ba81d9ec3b8325ebe11e5c340d6d545e334d |
| SimHash | 7d0dc2b24b17 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*.html?preview=* |
| Disallow | /tac-gia-*.html?page=* |
| Disallow | /news/load-content-live* |
| Disallow | /files/tiktok* |
| Disallow | /files/load-data-football* |
| Disallow | /files/load-data* |
| Disallow | /embed/video* |
| Disallow | /livescore/odd-live.html* |
| Disallow | /football-data/widget-calendar-ajax.html* |
| Disallow | /chi-tiet-tran-dau/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://ithethao.vn/sitemap.xml |
| sitemap | https://ithethao.vn/sitemap/news.xml |