anandavikatan.com
robots.txt

Robots Exclusion Standard data for anandavikatan.com

Resource Scan

Scan Details

Site Domain anandavikatan.com
Base Domain anandavikatan.com
Scan Status Ok
Last Scan2025-05-05T22:48:56+00:00
Next Scan 2025-05-12T22:48:56+00:00

Last Scan

Scanned2025-05-05T22:48:56+00:00
URL https://anandavikatan.com/robots.txt
Redirect https://www.anandavikatan.com/robots.txt
Redirect Domain www.anandavikatan.com
Redirect Base anandavikatan.com
Domain IPs 23.20.179.164
Redirect IPs 104.18.90.198, 104.18.91.198, 104.18.92.198, 104.18.93.198, 104.18.94.198, 2606:4700::6812:5ac6, 2606:4700::6812:5bc6, 2606:4700::6812:5cc6, 2606:4700::6812:5dc6, 2606:4700::6812:5ec6
Response IP 104.18.91.198
Found Yes
Hash 54b1584fad934db82ad94a3ce82990ce697fae1e375a7dfcc887b833449b9ec8
SimHash 2855180197b2

Groups

*

Rule Path
Disallow /3849069/
Disallow /api/vikatan/v1/*
Disallow /api/v1/*
Disallow /story/*/element/*
Disallow /sponsored/
Disallow /cdn-cgi/
Disallow /common-assets/
Disallow /v1/api/*
Disallow /route-data.json
Disallow /vikatan-deals/*

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow /topics/%E0%AE%9A%E0%AF%86%E0%AE%95%E0%AF%8D%E0%AE%B8%E0%AF%8D%2B%E0%AE%AA%E0%AE%9F%E0%AE%AE%E0%AF%8D
Disallow /topics/%E0%AE%9A%E0%AF%86%E0%AE%95%E0%AF%8D%E0%AE%B8%E0%AF%8D-%E0%AE%B5%E0%AF%80%E0%AE%9F%E0%AE%BF%E0%AE%AF%E0%AF%8B-%E0%AE%95%E0%AE%BE%E0%AE%9F%E0%AF%8D%E0%AE%9A%E0%AE%BF
Disallow /topics/Sex%2BVideo
Disallow /crime/gender/revenges-murders-between-rowdies-in-tiruvarur-district
Disallow /government-and-politics/today-marks-the-death-of-leelavathi-which-shocked-the-political-history
Disallow /health/sexual-wellness/

Other Records

Field Value
sitemap https://www.vikatan.com/sitemap/sitemap.xml
sitemap https://www.vikatan.com/news_sitemap.xml
sitemap https://www.vikatan.com/others-sitemap.xml
sitemap https://www.vikatan.com/loksabha-election-sitemap.xml
sitemap https://www.vikatan.com/vikatanplay-audiobook-sitemap.xml
sitemap https://www.vikatan.com/sitemap/sitemap-ampstories.xml