ciso.economictimes.indiatimes.com
robots.txt

Robots Exclusion Standard data for ciso.economictimes.indiatimes.com

Resource Scan

Scan Details

Site Domain ciso.economictimes.indiatimes.com
Base Domain indiatimes.com
Scan Status Ok
Last Scan2024-04-19T06:28:38+00:00
Next Scan 2024-05-19T06:28:38+00:00

Last Scan

Scanned2024-04-19T06:28:38+00:00
URL https://ciso.economictimes.indiatimes.com/robots.txt
Domain IPs 118.215.80.183, 2600:1413:b000:284::3126, 2600:1413:b000:28e::3126, 2600:1413:b000:293::3126, 2600:1413:b000:29a::3126, 2600:1413:b000:29c::3126
Response IP 104.69.46.109
Found Yes
Hash b1e405ce0fbcf44961117f996e6b0418473b6056a54360b938eeb2061655e6f6
SimHash ca1cc9d34bd3

Groups

*

Rule Path
Allow /
Disallow /web/Themes/Release/templates/
Disallow /l.php*
Disallow /pl.php*
Disallow /7176/
Disallow /web/Themes/Beta/
Disallow /opt/
Disallow *//
Disallow /whatsapp%3A//*
Disallow /*unsubscribelink
Disallow /search/*
Disallow /news/topics/*
Disallow /news/topic/*
Disallow /sport-brand-stories
Disallow /ajax_files/*
Disallow /tag/*/photos
Disallow /tag/*/videos
Disallow /tag/*/blogs
Disallow /tag/*/news
Disallow /subscription_strip.php

googlebot-news

Rule Path
Disallow /jobs/
Disallow /widget/
Disallow /author/
Disallow /*/author/
Disallow /videos/
Disallow /events/
Disallow /etanalytics/

Other Records

Field Value
sitemap https://ciso.economictimes.indiatimes.com/files/sitemaps/ciso_sitemap_index.xml
sitemap https://ciso.economictimes.indiatimes.com/files/sitemaps/ciso_sitemap_news.xml
sitemap https://ciso.economictimes.indiatimes.com/files/sitemaps/ciso_sitemap_weekly.xml