naukri.com
robots.txt
Robots Exclusion Standard data for naukri.com
Resource Scan
Scan Details
| Site Domain | naukri.com |
| Base Domain | naukri.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-11-08T04:02:13+00:00 |
| Next Scan | 2025-02-06T04:02:13+00:00 |
Last Successful Scan
| Scanned | 2024-04-13T02:38:00+00:00 |
| URL | https://naukri.com/robots.txt |
| Redirect | https://www.naukri.com/robots.txt |
| Redirect Domain | www.naukri.com |
| Redirect Base | naukri.com |
| Domain IPs | 184.27.122.155, 184.27.122.80 |
| Redirect IPs | 23.52.113.232, 2600:1413:b000:380::23ed, 2600:1413:b000:389::23ed |
| Response IP | 96.16.118.43 |
| Found | Yes |
| Hash | f5d56e33944026fb4cc8674364396276200c0a54bb33eb646f3baffd84dfe13d |
| SimHash | 63045881ef14 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /advertiser/ |
| Disallow | /preview/ |
| Disallow | /photo/ |
| Disallow | /Photo/ |
| Disallow | /profilePic/ |
| Disallow | /manager/checkEmail.php |
| Disallow | /ni/manager/Check/email |
| Disallow | /gpw/ |
| Disallow | /jg/ |
| Disallow | /lls/tm/ |
| Disallow | /alljobs/job/ |
| Disallow | /om.php |
| Disallow | /j2.php |
| Disallow | /recruiters/open-jobs-* |
| Disallow | /recruiters/closed-jobs-* |
| Disallow | /recruiters/follow-with-count-* |
| Disallow | /recruiters/unfollow-with-count-* |
| Disallow | /recruiters/rp-follower-count-* |
| Disallow | /code360-staging |
| Disallow | /code360-staging/ |
| Disallow | /code360-staging/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.naukri.com/sitemap/sitemap.xml |
| sitemap | https://www.naukri.com/sitemap/webstories-1.xml |
Comments