vikatan.com
robots.txt

Robots Exclusion Standard data for vikatan.com

Resource Scan

Scan Details

Site Domain vikatan.com
Base Domain vikatan.com
Scan Status Ok
Last Scan2024-05-11T00:36:04+00:00
Next Scan 2024-05-18T00:36:04+00:00

Last Scan

Scanned2024-05-11T00:36:04+00:00
URL https://vikatan.com/robots.txt
Redirect https://www.vikatan.com/robots.txt
Redirect Domain www.vikatan.com
Redirect Base vikatan.com
Domain IPs 23.20.179.164, 54.158.195.16
Redirect IPs 104.18.90.198, 104.18.91.198, 104.18.92.198, 104.18.93.198, 104.18.94.198, 2606:4700::6812:5ac6, 2606:4700::6812:5bc6, 2606:4700::6812:5cc6, 2606:4700::6812:5dc6, 2606:4700::6812:5ec6
Response IP 104.18.91.198
Found Yes
Hash 9dcc833abb3b66e4c8b27992dcc37900b038009bdbf86c36c0f130a992657cbc
SimHash 2a4518238fb2

Groups

*

Rule Path
Disallow /3849069/
Disallow /api/vikatan/v1/*
Disallow /api/v1/*
Disallow /story/*/element/*
Disallow /sponsored/
Disallow /cdn-cgi/
Disallow /common-assets/
Disallow /v1/api/*
Disallow /route-data.json

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow /topics/%E0%AE%9A%E0%AF%86%E0%AE%95%E0%AF%8D%E0%AE%B8%E0%AF%8D%2B%E0%AE%AA%E0%AE%9F%E0%AE%AE%E0%AF%8D
Disallow /topics/%E0%AE%9A%E0%AF%86%E0%AE%95%E0%AF%8D%E0%AE%B8%E0%AF%8D-%E0%AE%B5%E0%AF%80%E0%AE%9F%E0%AE%BF%E0%AE%AF%E0%AF%8B-%E0%AE%95%E0%AE%BE%E0%AE%9F%E0%AF%8D%E0%AE%9A%E0%AE%BF
Disallow /topics/Sex%2BVideo
Disallow /crime/gender/revenges-murders-between-rowdies-in-tiruvarur-district
Disallow /government-and-politics/today-marks-the-death-of-leelavathi-which-shocked-the-political-history
Disallow /health/sexual-wellness/

Other Records

Field Value
sitemap https://www.vikatan.com/sitemap/sitemap.xml
sitemap https://www.vikatan.com/news_sitemap.xml
sitemap https://www.vikatan.com/others-sitemap.xml
sitemap https://www.vikatan.com/loksabha-election-sitemap.xml
sitemap https://www.vikatan.com/sitemap/sitemap-ampstories.xml
sitemap https://www.vikatan.com/deals-sitemap.xml