deshgujarat.com
robots.txt
Robots Exclusion Standard data for deshgujarat.com
Resource Scan
Scan Details
| Site Domain | deshgujarat.com |
| Base Domain | deshgujarat.com |
| Scan Status | Ok |
| Last Scan | 2024-11-11T03:08:52+00:00 |
| Next Scan | 2024-11-18T03:08:52+00:00 |
Last Scan
| Scanned | 2024-11-11T03:08:52+00:00 |
| URL | https://deshgujarat.com/robots.txt |
| Domain IPs | 164.52.206.3 |
| Response IP | 164.52.206.3 |
| Found | Yes |
| Hash | e6e821c8a815146212b87ffce496b45907f102d6f3406b0f2733a0ffdb7d3dfb |
| SimHash | 26495c52b5c3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /staging/* |
| Disallow | /category/gujarat-2/ |
| Disallow | /category/extras/others/audiobook/ |
| Disallow | /category/audiobook/ |
| Disallow | /2015/05/17/chaalo-gujarat-aiana-members-raise-serious-questions-in-letter-to-sunil-nayak/ |
| Disallow | /2008/01/27/gujarati-calendar-2008-vikram-samvat-year-2064/?preview=true&preview_id=804&preview_nonce=80ec0c9515&wpmp_switcher=mobile |
| Disallow | /2008/01/27/gujarati-calendar-2008-vikram-samvat-year-2064/?preview=true&preview_id=804&preview_nonce=80ec0c9515 |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 300 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://cdn.attracta.com/sitemap/1053493.xml.gz |
Comments