hbtl.co
robots.txt
Robots Exclusion Standard data for hbtl.co
Resource Scan
Scan Details
| Site Domain | hbtl.co |
| Base Domain | hbtl.co |
| Scan Status | Ok |
| Last Scan | 2024-10-07T05:55:06+00:00 |
| Next Scan | 2024-11-06T05:55:06+00:00 |
Last Scan
| Scanned | 2024-10-07T05:55:06+00:00 |
| URL | https://hbtl.co/robots.txt |
| Domain IPs | 104.26.0.31, 104.26.1.31, 172.67.75.107, 2606:4700:20::681a:11f, 2606:4700:20::681a:1f, 2606:4700:20::ac43:4b6b |
| Response IP | 104.26.0.31 |
| Found | Yes |
| Hash | d6f016882b6f7f566e97d578fa572cbcf3572c55a3ac8cd6cf1c2a6204257092 |
| SimHash | 230188108d92 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /mytxtbox |
| Disallow | /mpower |
| Disallow | /mpower/migration |
| Disallow | /hub |
Other Records
| Field | Value |
|---|---|
| sitemap | https://hubtel.com/page-sitemap.xml |