rajasthantak.com
robots.txt
Robots Exclusion Standard data for rajasthantak.com
Resource Scan
Scan Details
| Site Domain | rajasthantak.com |
| Base Domain | rajasthantak.com |
| Scan Status | Ok |
| Last Scan | 2024-05-22T07:25:17+00:00 |
| Next Scan | 2024-05-29T07:25:17+00:00 |
Last Scan
| Scanned | 2024-05-22T07:25:17+00:00 |
| URL | https://rajasthantak.com/robots.txt |
| Redirect | https://www.rajasthantak.com:443/robots.txt |
| Redirect Domain | www.rajasthantak.com |
| Redirect Base | rajasthantak.com |
| Domain IPs | 13.126.39.152, 3.109.10.114, 52.66.100.161 |
| Redirect IPs | 2600:1413:b000:13::b857:c188, 2600:1413:b000:13::b857:c18c, 72.247.127.193, 72.247.127.209 |
| Response IP | 23.52.171.160 |
| Found | Yes |
| Hash | f06326a950b8125eabba2c20c643f04c87cceb31b48c2bf6b271b36827efa088 |
| SimHash | 89509824e047 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | /vs/header_rajasthantak |
| Disallow | /vs/footer_rajasthantak |
| Disallow | /vs/leftsidebar_rajasthantak |
| Disallow | /visualstories/preview/* |
| Disallow | */feed |
| Disallow | */feed?* |
| Disallow | /%5B%5Ea-zA-Z0-9%5D |
| Disallow | /tag/* |
| Disallow | /article/ampstories/* |
| Disallow | /article/uncategorized/* |
| Disallow | /cms-admin/ |
| Disallow | /wp-content/plugins/* |
| Disallow | /sortd-service/* |
| Disallow | /node/* |
| Disallow | /?p=* |
| Disallow | /search/* |
| Disallow | /*?p* |
| Disallow | /ajax/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.rajasthantak.com/rssfeeds/sitemap.xml |
| sitemap | https://www.rajasthantak.com/rssfeeds/news-sitemap.xml |
| sitemap | https://www.rajasthantak.com/rssfeeds/videos-sitemap.xml |
| sitemap | https://www.rajasthantak.com/rssfeeds/date-wise-stories-sitemap.xml |
| sitemap | https://www.rajasthantak.com/rssfeeds/date-wise-videos-sitemap.xml |
| sitemap | https://www.rajasthantak.com/visualstories/webstories-sitemap.xml |
| sitemap | https://www.rajasthantak.com/visualstories/webstories-sitemap-v1.xml |
| sitemap | https://www.rajasthantak.com/visualstories/webstories-sitemap-v1-1.xml |
| sitemap | https://www.rajasthantak.com/visualstories/webstories-sitemap-v1-2.xml |