Log In Sign Up

karnataka.thefederal.com
robots.txt

Robots Exclusion Standard data for karnataka.thefederal.com

Resource Scan

Scan Details

Site Domain karnataka.thefederal.com
Base Domain thefederal.com
Scan Status Ok
Last Scan2026-03-18T08:50:17+00:00
Next Scan 2026-04-17T08:50:17+00:00

Last Scan

Scanned2026-03-18T08:50:17+00:00
URL https://karnataka.thefederal.com/robots.txt
Domain IPs 13.33.88.123, 13.33.88.13, 13.33.88.27, 13.33.88.60, 2600:9000:223b:2c00:19:67a1:8100:93a1, 2600:9000:223b:5400:19:67a1:8100:93a1, 2600:9000:223b:5800:19:67a1:8100:93a1, 2600:9000:223b:8400:19:67a1:8100:93a1, 2600:9000:223b:9400:19:67a1:8100:93a1, 2600:9000:223b:9800:19:67a1:8100:93a1, 2600:9000:223b:e00:19:67a1:8100:93a1, 2600:9000:223b:e800:19:67a1:8100:93a1
Response IP 13.33.88.60
Found Yes
Hash 80b437b92dd6df2acfb9447650c9da88ab6e8280f0fda228cb4f197072677ea4
SimHash 980a3e4c4fa7

Groups

*

Rule Path
Allow /
Disallow /admin/*
Disallow /search/*
Disallow /search?*
Disallow /preview/story-*
Disallow /amp/preview/story-*
Disallow /staging/*
Disallow /alfoo
Disallow /sildoo
Disallow /dutas
Disallow /metsmall
Back to top

Other Records

Field Value
sitemap https://karnataka.thefederal.com/sitemap/sitemap-index.xml
sitemap https://karnataka.thefederal.com/news-sitemap-daily.xml
sitemap https://karnataka.thefederal.com/feeds.xml
sitemap https://karnataka.thefederal.com/sitemap-daily.xml
Back to top

Comments

  • robots.txt for https://karnataka.thefederal.com
  • Commenting out XHR command below on Nov 17th 2025 while looking to fix something else
  • Disallow: /xhr/*
Back to top