aryzindagi.tv
robots.txt
Robots Exclusion Standard data for aryzindagi.tv
Resource Scan
Scan Details
| Site Domain | aryzindagi.tv |
| Base Domain | aryzindagi.tv |
| Scan Status | Ok |
| Last Scan | 2024-10-12T07:22:06+00:00 |
| Next Scan | 2024-10-19T07:22:06+00:00 |
Last Scan
| Scanned | 2024-10-12T07:22:06+00:00 |
| URL | https://aryzindagi.tv/robots.txt |
| Domain IPs | 104.21.1.67, 172.67.128.190, 2606:4700:3036::6815:143, 2606:4700:3036::ac43:80be |
| Response IP | 104.21.1.67 |
| Found | Yes |
| Hash | 963489a8e445a608d87bbfde1d99fc9421b38a619137d686594ad6f54c391921 |
| SimHash | ea4c7e706012 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 600 |
googlebot
mediapartners-google
adsbot-google
googlebot-news
googlebot-image
googlebot-mobile
googlebot-video
msnbot
bingbot
ia_archiver
| Rule | Path |
|---|---|
| Allow | / |
*
| Rule | Path |
|---|---|
| Allow | /ads/preferences/ |
| Allow | /gpt/ |
| Allow | /pagead/show_ads.js |
| Allow | /pagead/js/adsbygoogle.js |
| Allow | /pagead/js/*/show_ads_impl.js |
| Allow | /static/glade.js |
| Allow | /static/glade/ |
| Allow | /tag/js/ |
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://videos.arydigital.tv/sitemap.php |
| sitemap | https://videos.arydigital.tv/sitemap.php?page=2 |
| sitemap | https://videos.arydigital.tv/sitemap.php?page=3 |
| sitemap | https://videos.arydigital.tv/sitemap.php?page=4 |
| sitemap | https://videos.arydigital.tv/sitemap.php?page=5 |
| sitemap | https://videos.arydigital.tv/sitemap.php?page=6 |
| sitemap | https://videos.arydigital.tv/sitemap.php?page=7 |
| sitemap | https://videos.arydigital.tv/sitemap.php?page=8 |
| sitemap | https://videos.arydigital.tv/sitemap.php?page=9 |
| sitemap | https://videos.arydigital.tv/sitemap.php?page=10 |
| sitemap | https://videos.arydigital.tv/sitemap_playlist.php |
| sitemap | https://videos.arydigital.tv/sitemap_playlist.php?page=2 |
| sitemap | https://videos.arydigital.tv/sitemap_playlist.php?page=3 |
| sitemap | https://videos.arydigital.tv/sitemap_playlist.php?page=4 |
Warnings
- `noindex` is not a known field.