boomlive.in
robots.txt
Robots Exclusion Standard data for boomlive.in
Resource Scan
Scan Details
Site Domain | boomlive.in |
Base Domain | boomlive.in |
Scan Status | Ok |
Last Scan | 2024-09-25T06:55:43+00:00 |
Next Scan | 2024-10-02T06:55:43+00:00 |
Last Scan
Scanned | 2024-09-25T06:55:43+00:00 |
URL | https://boomlive.in/robots.txt |
Redirect | https://www.boomlive.in/robots.txt |
Redirect Domain | www.boomlive.in |
Redirect Base | boomlive.in |
Domain IPs | 104.21.20.137, 172.67.192.240, 2606:4700:3030::6815:1489, 2606:4700:3033::ac43:c0f0 |
Redirect IPs | 2600:9000:20c7:2000:17:bca7:b600:93a1, 2600:9000:20c7:5000:17:bca7:b600:93a1, 2600:9000:20c7:8000:17:bca7:b600:93a1, 2600:9000:20c7:a600:17:bca7:b600:93a1, 2600:9000:20c7:dc00:17:bca7:b600:93a1, 2600:9000:20c7:f400:17:bca7:b600:93a1, 2600:9000:20c7:f600:17:bca7:b600:93a1, 2600:9000:20c7:f800:17:bca7:b600:93a1, 54.230.71.12, 54.230.71.120, 54.230.71.5, 54.230.71.8 |
Response IP | 13.35.18.45 |
Found | Yes |
Hash | 1fbc745eb312bce6db71cfbce5451440cb729b63a5b5be784046246b147b4f43 |
SimHash | c8421e43cd87 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /admin/* |
Disallow | /search/* |
Disallow | /search?* |
Disallow | /xhr/* |
Disallow | /preview/story-* |
Disallow | /amp/preview/story-* |
Disallow | /staging/* |
Disallow | /alfoo |
Disallow | /sildoo |
Disallow | /dutas |
Disallow | /metsmall |
Allow | /xhr/getNewsMixin* |
Allow | /content/servlet/RDESController?* |
Other Records
Field | Value |
---|---|
sitemap | https://www.boomlive.in/sitemap/sitemap-index.xml |
sitemap | https://www.boomlive.in/news-sitemap-daily.xml |
sitemap | https://www.boomlive.in/feeds.xml |
sitemap | https://www.boomlive.in/sitemap-daily.xml |
Warnings
- 1 invalid line.
Comments