divan.tv
robots.txt
Robots Exclusion Standard data for divan.tv
Resource Scan
Scan Details
Site Domain | divan.tv |
Base Domain | divan.tv |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-08-14T05:23:17+00:00 |
Next Scan | 2024-11-12T05:23:17+00:00 |
Last Successful Scan
Scanned | 2022-02-03T00:58:42+00:00 |
URL | https://divan.tv/robots.txt |
Response IP | 77.222.132.6 |
Found | Yes |
Hash | 147f166eb43cc422d243f4555c42c48cccb4c0154bddc72fe5b3dc3ed9eb685f |
SimHash | 5d15d74226b0 |
Groups
*
Rule | Path |
---|---|
Disallow | /profile |
Disallow | /search |
Disallow | /*sort |
Disallow | /video/watch-later |
Disallow | /video/filmy/18 |
Disallow | /profile |
Disallow | /*/play |
Disallow | /tariffs/ |
Disallow | /tariff/ |
Disallow | /prestigio-d1-smart-tv |
Disallow | /promo |
Disallow | /video/filmy/18 |
Disallow | /dvr |
Disallow | /en/dvr |
Disallow | /uk/dvr |
Disallow | /zh/* |
Disallow | /ja/* |
Disallow | /ko/* |
Allow | /*.css |
Allow | /*.js |
Other Records
Field | Value |
---|---|
sitemap | https://divan.tv/sitemap.xml |
Warnings
- `host` is not a known field.