vrsamachar.com
robots.txt
Robots Exclusion Standard data for vrsamachar.com
Resource Scan
Scan Details
Site Domain | vrsamachar.com |
Base Domain | vrsamachar.com |
Scan Status | Ok |
Last Scan | 2024-06-26T12:37:40+00:00 |
Next Scan | 2024-07-03T12:37:40+00:00 |
Last Scan
Scanned | 2024-06-26T12:37:40+00:00 |
URL | https://vrsamachar.com/robots.txt |
Domain IPs | 18.155.68.100, 18.155.68.20, 18.155.68.49, 18.155.68.66, 2600:9000:23d2:200:12:ca88:cec0:93a1, 2600:9000:23d2:3200:12:ca88:cec0:93a1, 2600:9000:23d2:3400:12:ca88:cec0:93a1, 2600:9000:23d2:3a00:12:ca88:cec0:93a1, 2600:9000:23d2:6a00:12:ca88:cec0:93a1, 2600:9000:23d2:d600:12:ca88:cec0:93a1, 2600:9000:23d2:da00:12:ca88:cec0:93a1, 2600:9000:23d2:ee00:12:ca88:cec0:93a1 |
Response IP | 18.155.68.100 |
Found | Yes |
Hash | a1838f59fd20030b037a6d530757d463930f2a504fe75b68d1c94e949d787e64 |
SimHash | e20a1e5fcfc7 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /admin/* |
Disallow | /search/* |
Disallow | /search?* |
Disallow | /xhr/* |
Disallow | /preview/story-* |
Disallow | /amp/preview/story-* |
Disallow | /staging/* |
Disallow | /alfoo |
Disallow | /sildoo |
Disallow | /dutas |
Disallow | /metsmall |
Allow | /xhr/getNewsMixin* |
Allow | /content/servlet/RDESController?* |
Other Records
Field | Value |
---|---|
sitemap | https://vrsamachar.com/sitemap/sitemap-index.xml |
sitemap | https://vrsamachar.com/news-sitemap-daily.xml |
sitemap | https://vrsamachar.com/feeds.xml |
Comments