kannada.gizbot.com
robots.txt
Robots Exclusion Standard data for kannada.gizbot.com
Resource Scan
Scan Details
Site Domain | kannada.gizbot.com |
Base Domain | gizbot.com |
Scan Status | Ok |
Last Scan | 2024-05-11T10:45:29+00:00 |
Next Scan | 2024-06-10T10:45:29+00:00 |
Last Scan
Scanned | 2024-05-11T10:45:29+00:00 |
URL | https://kannada.gizbot.com/robots.txt |
Domain IPs | 104.18.18.4, 104.18.19.4, 2606:4700::6812:1204, 2606:4700::6812:1304 |
Response IP | 104.18.18.4 |
Found | Yes |
Hash | d198a5f8ab613d5111ff166dc3eaaa2793a15c3f9a5750bc0e0ad0fbf4dd49ef |
SimHash | 0927d3244010 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | *?utm* |
Disallow | *?ref* |
Disallow | *?h=* |
Disallow | *?cmsref=* |
Disallow | *?s=* |
Disallow | /2010/* |
Disallow | /2011/* |
Disallow | /2012/* |
Disallow | /2013/* |
Disallow | /2014/* |
Disallow | /2015/* |
Disallow | /2016/* |
Disallow | /2017/* |
Disallow | /2018/* |
Disallow | /2019/* |
Disallow | /2020/* |
Disallow | /2021/* |
Disallow | /2022/* |
Disallow | /temp/ |
Disallow | /amphtml/temp/ |
Disallow | /newsletter/ |
Disallow | /news-letter/ |
Disallow | /scripts/ |
Disallow | /common/ |
Disallow | */%26qu/* |
Disallow | *?story* |
Disallow | /videos/amphtml/ |
Disallow | /videos/amphtml/* |
Disallow | /videos/search-videos/ |
Other Records
Field | Value |
---|---|
sitemap | https://kannada.gizbot.com/sitemap_index.xml |
sitemap | https://kannada.gizbot.com/sitemap-latest.xml |
sitemap | https://kannada.gizbot.com/sitemap_news.xml |
sitemap | https://kannada.gizbot.com/sitemap-webstories.xml |