stattimes.com
robots.txt

Robots Exclusion Standard data for stattimes.com

Resource Scan

Scan Details

Site Domain stattimes.com
Base Domain stattimes.com
Scan Status Ok
Last Scan2024-10-03T15:39:44+00:00
Next Scan 2024-10-10T15:39:44+00:00

Last Scan

Scanned2024-10-03T15:39:44+00:00
URL https://www.stattimes.com/robots.txt
Domain IPs 108.157.254.19, 108.157.254.34, 108.157.254.74, 108.157.254.89, 2600:9000:2753:2800:12:c529:f700:93a1, 2600:9000:2753:5800:12:c529:f700:93a1, 2600:9000:2753:5a00:12:c529:f700:93a1, 2600:9000:2753:8800:12:c529:f700:93a1, 2600:9000:2753:8e00:12:c529:f700:93a1, 2600:9000:2753:a800:12:c529:f700:93a1, 2600:9000:2753:c000:12:c529:f700:93a1, 2600:9000:2753:ca00:12:c529:f700:93a1
Response IP 108.157.254.34
Found Yes
Hash e502d10f327a86f501a1b06d05aefa7771deb3d5a62d4ade672ff327e373be9e
SimHash c9021e43cfc7

Groups

*

Rule Path
Allow /
Disallow /admin/*
Disallow /search/*
Disallow /search?*
Disallow /xhr/*
Disallow /preview/story-*
Disallow /amp/preview/story-*
Disallow /alfoo
Disallow /sildoo
Disallow /dutas
Disallow /video-only-for-doctors-72491
Disallow /introducing-medical-dialogues-medical-and-health-news-portal-74410
Disallow /metsmall
Allow /content/servlet/RDESController?*

Other Records

Field Value
sitemap https://www.stattimes.com/sitemap/sitemap-index.xml
sitemap https://www.stattimes.com/news-sitemap-daily.xml
sitemap https://www.stattimes.com/feeds.xml

Comments

  • robots.txt for https://www.stattimes.com/