tubebg.com
robots.txt
Robots Exclusion Standard data for tubebg.com
Resource Scan
Scan Details
| Site Domain | tubebg.com |
| Base Domain | tubebg.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-09-14T20:29:26+00:00 |
| Next Scan | 2024-12-13T20:29:26+00:00 |
Last Successful Scan
| Scanned | 2024-05-18T20:27:36+00:00 |
| URL | https://tubebg.com/robots.txt |
| Redirect | https://www.tubebg.com/robots.txt |
| Redirect Domain | www.tubebg.com |
| Redirect Base | tubebg.com |
| Domain IPs | 104.26.14.144, 104.26.15.144, 172.67.70.10, 2606:4700:20::681a:e90, 2606:4700:20::681a:f90, 2606:4700:20::ac43:460a |
| Redirect IPs | 104.26.14.144, 104.26.15.144, 172.67.70.10, 2606:4700:20::681a:e90, 2606:4700:20::681a:f90, 2606:4700:20::ac43:460a |
| Response IP | 104.26.14.144 |
| Found | Yes |
| Hash | c3a38005eb0a8258ab4fc0a271836851574f4014fc24ebf395e66e120796c345 |
| SimHash | 2158dc846e13 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /index.php |
| Disallow | /rss.php |
| Disallow | /suggest_video.php |
| Disallow | /embedcode.php |
| Disallow | /stats.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.tubebg.com/sitemaps/siteindex.xml |