itln.in
robots.txt

Robots Exclusion Standard data for itln.in

Resource Scan

Scan Details

Site Domain itln.in
Base Domain itln.in
Scan Status Ok
Last Scan2024-10-03T06:13:24+00:00
Next Scan 2024-10-10T06:13:24+00:00

Last Scan

Scanned2024-10-03T06:13:24+00:00
URL https://itln.in/robots.txt
Redirect https://www.itln.in/robots.txt
Redirect Domain www.itln.in
Redirect Base itln.in
Domain IPs 101.53.133.15
Redirect IPs 108.156.133.111, 108.156.133.32, 108.156.133.7, 108.156.133.73, 2600:9000:2755:2a00:4:65b9:b280:93a1, 2600:9000:2755:3400:4:65b9:b280:93a1, 2600:9000:2755:4a00:4:65b9:b280:93a1, 2600:9000:2755:6e00:4:65b9:b280:93a1, 2600:9000:2755:7c00:4:65b9:b280:93a1, 2600:9000:2755:ce00:4:65b9:b280:93a1, 2600:9000:2755:d200:4:65b9:b280:93a1, 2600:9000:2755:e800:4:65b9:b280:93a1
Response IP 108.156.133.32
Found Yes
Hash 1f53f634b4b171a53c388924953adab5630fbe47d57a49f5bb051a605fd84789
SimHash 81101e43cf97

Groups

*

Rule Path
Allow /
Disallow /admin/*
Disallow /search/*
Disallow /search?*
Disallow /xhr/*
Disallow /preview/story-*
Disallow /amp/preview/story-*
Disallow /alfoo
Disallow /sildoo
Disallow /dutas
Disallow /video-only-for-doctors-72491
Disallow /introducing-medical-dialogues-medical-and-health-news-portal-74410
Disallow /metsmall
Allow /xhr/getNewsMixin*
Allow /content/servlet/RDESController?*

Other Records

Field Value
sitemap https://www.itln.in/sitemap/sitemap-index.xml
sitemap https://www.itln.in/news-sitemap-daily.xml
sitemap https://www.itln.in/feeds.xml

Comments

  • robots.txt for https://www.itln.in/