tamil.timesnownews.com
robots.txt

Robots Exclusion Standard data for tamil.timesnownews.com

Resource Scan

Scan Details

Site Domain tamil.timesnownews.com
Base Domain timesnownews.com
Scan Status Ok
Last Scan2024-09-19T10:20:34+00:00
Next Scan 2024-09-26T10:20:34+00:00

Last Scan

Scanned2024-09-19T10:20:34+00:00
URL https://tamil.timesnownews.com/robots.txt
Domain IPs 23.49.60.112, 23.49.60.97, 2600:1413:b000:1e::17d1:2e4f, 2600:1413:b000:1e::17d1:2e51
Response IP 96.17.72.18
Found Yes
Hash 92df368f0489ad3e54215525f1ec9a8f687d8424f05339606a94b6e6a093ff32
SimHash 5941d1c4e029

Groups

*

Rule Path
Disallow /wapi/
Disallow /?nbck=1
Disallow /?nexthome=1
Disallow /presite
Disallow /story/*
Disallow /test-section/
Disallow /embed/
Disallow /search-result/

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

facebookexternalhit/1.1

Rule Path
Disallow

dataforseobot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://tamil.timesnownews.com/feeds/google-news-sitemap-ta.xml
sitemap https://tamil.timesnownews.com/feeds/ta-yesterday-sitemap.xml
sitemap https://tamil.timesnownews.com/feeds/ta-today-sitemap.xml
sitemap https://tamil.timesnownews.com/staticsitemap/timesnowtamilslideshow/sitemap-index.xml
sitemap https://tamil.timesnownews.com/staticsitemap/timesnowtamil/sitemap-index.xml
sitemap https://tamil.timesnownews.com/staticsitemap/timesnowtamilphotos/sitemap-index.xml

Comments

  • Sitemaps
  • Baiduspider
  • Yandex
  • Facebook