hindustanjobs.net
robots.txt
Robots Exclusion Standard data for hindustanjobs.net
Resource Scan
Scan Details
| Site Domain | hindustanjobs.net |
| Base Domain | hindustanjobs.net |
| Scan Status | Ok |
| Last Scan | 2024-05-12T22:45:54+00:00 |
| Next Scan | 2024-05-19T22:45:54+00:00 |
Last Scan
| Scanned | 2024-05-12T22:45:54+00:00 |
| URL | https://hindustanjobs.net/robots.txt |
| Domain IPs | 2a02:4780:38:ad88:775c:40a6:ed5:9113, 84.32.84.13 |
| Response IP | 179.61.189.7 |
| Found | Yes |
| Hash | 653e2ece2ce91ea73681bdd29947d408d463607510fb211d90a09890589f01c3 |
| SimHash | 6b8848c08ab3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /wp-content/uploads/ |
| Disallow | /wp-content/plugins/ |
| Disallow | /wp-admin/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://hindustanjobs.net/sitemap_index.xml |