gizbot.com
robots.txt
Robots Exclusion Standard data for gizbot.com
Resource Scan
Scan Details
| Site Domain | gizbot.com |
| Base Domain | gizbot.com |
| Scan Status | Ok |
| Last Scan | 2024-11-12T13:54:09+00:00 |
| Next Scan | 2024-11-19T13:54:09+00:00 |
Last Scan
| Scanned | 2024-11-12T13:54:09+00:00 |
| URL | https://gizbot.com/robots.txt |
| Redirect | https://www.gizbot.com/robots.txt |
| Redirect Domain | www.gizbot.com |
| Redirect Base | gizbot.com |
| Domain IPs | 104.18.40.149, 172.64.147.107, 2606:4700:4400::6812:2895, 2606:4700:4400::ac40:936b |
| Redirect IPs | 104.18.40.149, 172.64.147.107, 2606:4700:4400::6812:2895, 2606:4700:4400::ac40:936b |
| Response IP | 172.64.147.107 |
| Found | Yes |
| Hash | 3ce21a21a4788adfecdc2da27c441b7f111ebe39df16cea3736a0f07af04916d |
| SimHash | 2b20d7a04d10 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /common/css/* |
| Allow | /common/min/* |
| Disallow | */?ref=* |
| Disallow | *?utm_* |
| Disallow | /temp/ |
| Disallow | /amphtml/temp/ |
| Disallow | /wp-content/ |
| Disallow | /newsletter/ |
| Disallow | /news-letter/ |
| Disallow | /*?replytocom |
| Disallow | /*?pid |
| Disallow | /gadget-finder/buynow/ |
| Disallow | /gadget-finder/search.html |
| Disallow | /common/ |
| Disallow | */compare/* |
| Disallow | */new-mobiles/* |
| Disallow | */page-* |
| Disallow | /scripts/ |
| Disallow | /*?utm=* |
| Disallow | */%26qu/* |
| Disallow | *?ref_* |
| Disallow | */?page-no=* |
| Disallow | */topic/* |
| Disallow | *?story* |
| Disallow | */articlecontent-* |
| Disallow | */buynow/* |
| Disallow | *?sort_by* |
| Disallow | */?page=* |
| Disallow | */competitors/* |
| Disallow | */https%3A//* |
| Disallow | *?q=* |
| Disallow | *?media=* |
| Disallow | */?sort_by=* |
| Disallow | */2010/* |
| Disallow | */2011/* |
| Disallow | */2012/* |
| Disallow | */2013/* |
| Disallow | */2014/* |
| Disallow | */2015/* |
| Disallow | */2016/* |
| Disallow | */2017/* |
| Disallow | */2018/* |
| Disallow | */2019/* |
| Disallow | */2020/* |
| Disallow | */2021/* |
| Disallow | */2022/* |
| Disallow | /videos/amphtml/ |
| Disallow | /videos/amphtml/* |
| Disallow | /videos/search-videos/ |
| Disallow | /scripts/videos/english-videos/scroll-ad.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.gizbot.com/sitemap_news.xml |
| sitemap | https://www.gizbot.com/sitemap-latest.xml |
| sitemap | https://www.gizbot.com/sitemap_index.xml |
| sitemap | https://www.gizbot.com/sitemap-videos-index.xml |
| sitemap | https://www.gizbot.com/sitemap-webstories.xml |
| sitemap | https://www.gizbot.com/sitemap-images-index.xml |