malayalam.filmibeat.com
robots.txt
Robots Exclusion Standard data for malayalam.filmibeat.com
Resource Scan
Scan Details
Site Domain | malayalam.filmibeat.com |
Base Domain | filmibeat.com |
Scan Status | Ok |
Last Scan | 2024-05-03T06:59:44+00:00 |
Next Scan | 2024-06-02T06:59:44+00:00 |
Last Scan
Scanned | 2024-05-03T06:59:44+00:00 |
URL | https://malayalam.filmibeat.com/robots.txt |
Domain IPs | 104.18.14.76, 104.18.15.76, 2606:4700::6812:e4c, 2606:4700::6812:f4c |
Response IP | 104.18.14.76 |
Found | Yes |
Hash | d71b21aa0c19cf34fd1e485e7fc0dc054808ef2ab898285d4c285c1598296f20 |
SimHash | 4f25d3a4d6d1 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /temp |
Disallow | /promotions |
Disallow | /amphtml/temp/ |
Disallow | /*?utm=* |
Disallow | /404.html |
Disallow | /scripts/ |
Disallow | *?utm* |
Disallow | *?page* |
Disallow | *?ref* |
Disallow | /videos/amphtml/ |
Disallow | /videos/amphtml/* |
Disallow | /videos/search-videos/ |
Disallow | /videos/next-videos.html |
Other Records
Field | Value |
---|---|
sitemap | https://malayalam.filmibeat.com/sitemap_index.xml |
sitemap | https://malayalam.filmibeat.com/sitemap-latest.xml |
sitemap | https://malayalam.filmibeat.com/sitemap_news.xml |
sitemap | https://malayalam.filmibeat.com/sitemap/popcorn/sitemap-index.xml |
sitemap | https://malayalam.filmibeat.com/sitemap-images-index.xml |
sitemap | https://malayalam.filmibeat.com/sitemap-webstories.xml |