mobile.btolat.com
robots.txt
Robots Exclusion Standard data for mobile.btolat.com
Resource Scan
Scan Details
Site Domain | mobile.btolat.com |
Base Domain | btolat.com |
Scan Status | Ok |
Last Scan | 2024-05-29T02:23:50+00:00 |
Next Scan | 2024-06-05T02:23:50+00:00 |
Last Scan
Scanned | 2024-05-29T02:23:50+00:00 |
URL | https://mobile.btolat.com/robots.txt |
Domain IPs | 104.21.235.149, 104.21.235.150, 2606:4700:3038::6815:eb95, 2606:4700:3038::6815:eb96 |
Response IP | 104.21.235.150 |
Found | Yes |
Hash | f8786cf6812ce8d370cf6a8114f263fd492a593b611c0968d8d1c81360e2ed06 |
SimHash | 2912d80c80d2 |
Groups
*
Rule | Path |
---|---|
Disallow | /bin/ |
Disallow | /can.btolat.com |
Disallow | /canmob.btolat.com |
Disallow | /168615412$ |
Disallow | /video/loadmore/* |
Disallow | /news/loadmore/* |
Other Records
Field | Value |
---|---|
sitemap | https://mobile.btolat.com/sitemap.xml |