mail.rediff.com
robots.txt
Robots Exclusion Standard data for mail.rediff.com
Resource Scan
Scan Details
| Site Domain | mail.rediff.com |
| Base Domain | rediff.com |
| Scan Status | Ok |
| Last Scan | 2024-06-06T16:30:26+00:00 |
| Next Scan | 2024-07-06T16:30:26+00:00 |
Last Scan
| Scanned | 2024-06-06T16:30:26+00:00 |
| URL | https://mail.rediff.com/robots.txt |
| Domain IPs | 202.137.234.37 |
| Response IP | 202.137.234.37 |
| Found | Yes |
| Hash | aa4306e3ef8641fca5535f536b48462c03c3ff7042f68705835e109d218e797d |
| SimHash | 6b00cdf5cd9d |
Groups
*
| Rule | Path |
|---|---|
| Allow | /index.html |
| Allow | /ads.txt |
| Allow | /cgi-bin/login.cgi |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 600 |
Warnings
- 1 invalid line.