tamilnewsnetwork.com
robots.txt
Robots Exclusion Standard data for tamilnewsnetwork.com
Resource Scan
Scan Details
Site Domain | tamilnewsnetwork.com |
Base Domain | tamilnewsnetwork.com |
Scan Status | Ok |
Last Scan | 2025-04-16T17:27:31+00:00 |
Next Scan | 2025-04-23T17:27:31+00:00 |
Last Scan
Scanned | 2025-04-16T17:27:31+00:00 |
URL | https://tamilnewsnetwork.com/robots.txt |
Domain IPs | 104.21.18.77, 172.67.180.241, 2606:4700:3031::6815:124d, 2606:4700:3033::ac43:b4f1 |
Response IP | 104.21.18.77 |
Found | Yes |
Hash | a69df96cd7a2e5954aa7cafeb0b2f47e4de6803433ec33fd7a48eab28fcb640b |
SimHash | 6a115d1dc6f0 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-content/ |
Disallow | /wp-content/plugins/ |
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Disallow | /wp- |
Disallow | /feed/ |
Disallow | /trackback/ |
Disallow | /cgi-bin/ |
Disallow | /page/ |
Disallow | /contact/ |
Disallow | /wp-login.php |
Disallow | */comment-* |
Allow | /wp-content/uploads/ |
Allow | /news-in-tamil/ |
googlebot
Rule | Path |
---|---|
Disallow | /*.pdf$ |
Disallow | /*.php$ |
Disallow | /*.js$ |
Disallow | /*.cgi$ |
Disallow | /*.xhtml$ |
Disallow | /*.php* |
Disallow | /*.inc$ |
Disallow | /*?* |
Disallow | /wp-* |
Disallow | */feed/ |
Disallow | */trackback/ |
Disallow | /cgi-bin/ |
Disallow | /page/ |
Disallow | /contact/ |
Disallow | /go/ |
Disallow | */comment-* |
Disallow | /category/cine-news/*%26* |
Allow | /wp-content/uploads/ |
Allow | /news-in-tamil/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.tamilnewsnetwork.com/sitemap.xml |
Comments