tamil.gizbot.com
robots.txt
Robots Exclusion Standard data for tamil.gizbot.com
Resource Scan
Scan Details
| Site Domain | tamil.gizbot.com |
| Base Domain | gizbot.com |
| Scan Status | Ok |
| Last Scan | 2024-05-16T15:43:27+00:00 |
| Next Scan | 2024-06-15T15:43:27+00:00 |
Last Scan
| Scanned | 2024-05-16T15:43:27+00:00 |
| URL | https://tamil.gizbot.com/robots.txt |
| Domain IPs | 104.18.18.4, 104.18.19.4, 2606:4700::6812:1204, 2606:4700::6812:1304 |
| Response IP | 104.18.19.4 |
| Found | Yes |
| Hash | cd622a6ae801ac9099e9723409e460e48ee332f256c73b192cb42e2e5f83025c |
| SimHash | 4d0753e44c10 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | *?utm* |
| Disallow | *?ref* |
| Disallow | /2010/* |
| Disallow | /2011/* |
| Disallow | /2012/* |
| Disallow | /2013/* |
| Disallow | /2014/* |
| Disallow | /2015/* |
| Disallow | /2016/* |
| Disallow | /2017/* |
| Disallow | /2018/* |
| Disallow | /2019/* |
| Disallow | /2020/* |
| Disallow | /2021/* |
| Disallow | /2022/* |
| Disallow | /temp/ |
| Disallow | /amphtml/temp/ |
| Disallow | /newsletter/ |
| Disallow | /news-letter/ |
| Disallow | /scripts/ |
| Disallow | /common/ |
| Disallow | */%26qu/* |
| Disallow | */?page-no=* |
| Disallow | */topic/* |
| Disallow | *?story* |
| Disallow | */articlecontent-* |
| Disallow | */new-mobiles/* |
| Disallow | /gadget-finder/ |
| Disallow | /videos/amphtml/ |
| Disallow | /videos/amphtml/* |
| Disallow | /videos/search-videos/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://tamil.gizbot.com/sitemap_index.xml |
| sitemap | https://tamil.gizbot.com/sitemap-latest.xml |
| sitemap | https://tamil.gizbot.com/sitemap_news.xml |
| sitemap | https://tamil.gizbot.com/sitemap-webstories.xml |