gujaratsamachar.com
robots.txt
Robots Exclusion Standard data for gujaratsamachar.com
Resource Scan
Scan Details
| Site Domain | gujaratsamachar.com |
| Base Domain | gujaratsamachar.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-27T16:46:43+00:00 |
| Next Scan | 2024-11-03T16:46:43+00:00 |
Last Successful Scan
| Scanned | 2024-06-23T16:44:31+00:00 |
| URL | https://gujaratsamachar.com/robots.txt |
| Redirect | https://www.gujaratsamachar.com/robots.txt |
| Redirect Domain | www.gujaratsamachar.com |
| Redirect Base | gujaratsamachar.com |
| Domain IPs | 108.156.133.120, 108.156.133.64, 108.156.133.80, 108.156.133.91 |
| Redirect IPs | 108.156.133.102, 108.156.133.113, 108.156.133.22, 108.156.133.64, 2600:9000:2755:1200:2:a990:2d00:93a1, 2600:9000:2755:1800:2:a990:2d00:93a1, 2600:9000:2755:5e00:2:a990:2d00:93a1, 2600:9000:2755:6600:2:a990:2d00:93a1, 2600:9000:2755:6a00:2:a990:2d00:93a1, 2600:9000:2755:8000:2:a990:2d00:93a1, 2600:9000:2755:a000:2:a990:2d00:93a1, 2600:9000:2755:dc00:2:a990:2d00:93a1 |
| Response IP | 108.156.133.22 |
| Found | Yes |
| Hash | 385210da0675058e0d789deb578b7ab19f82d2bdef1a8d3d2894fdb8c54ffef5 |
| SimHash | aa489c621123 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /photo/* |
| Disallow | /photo_slide_show/* |
| Disallow | /gs_photo/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.gujaratsamachar.com/sitemap.xml |
Comments