stattimes.com
robots.txt
Robots Exclusion Standard data for stattimes.com
Resource Scan
Scan Details
Site Domain | stattimes.com |
Base Domain | stattimes.com |
Scan Status | Ok |
Last Scan | 2024-10-03T15:39:44+00:00 |
Next Scan | 2024-10-10T15:39:44+00:00 |
Last Scan
Scanned | 2024-10-03T15:39:44+00:00 |
URL | https://www.stattimes.com/robots.txt |
Domain IPs | 108.157.254.19, 108.157.254.34, 108.157.254.74, 108.157.254.89, 2600:9000:2753:2800:12:c529:f700:93a1, 2600:9000:2753:5800:12:c529:f700:93a1, 2600:9000:2753:5a00:12:c529:f700:93a1, 2600:9000:2753:8800:12:c529:f700:93a1, 2600:9000:2753:8e00:12:c529:f700:93a1, 2600:9000:2753:a800:12:c529:f700:93a1, 2600:9000:2753:c000:12:c529:f700:93a1, 2600:9000:2753:ca00:12:c529:f700:93a1 |
Response IP | 108.157.254.34 |
Found | Yes |
Hash | e502d10f327a86f501a1b06d05aefa7771deb3d5a62d4ade672ff327e373be9e |
SimHash | c9021e43cfc7 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /admin/* |
Disallow | /search/* |
Disallow | /search?* |
Disallow | /xhr/* |
Disallow | /preview/story-* |
Disallow | /amp/preview/story-* |
Disallow | /alfoo |
Disallow | /sildoo |
Disallow | /dutas |
Disallow | /video-only-for-doctors-72491 |
Disallow | /introducing-medical-dialogues-medical-and-health-news-portal-74410 |
Disallow | /metsmall |
Allow | /content/servlet/RDESController?* |
Other Records
Field | Value |
---|---|
sitemap | https://www.stattimes.com/sitemap/sitemap-index.xml |
sitemap | https://www.stattimes.com/news-sitemap-daily.xml |
sitemap | https://www.stattimes.com/feeds.xml |
Comments