corp.naukri.com
robots.txt

Robots Exclusion Standard data for corp.naukri.com

Resource Scan

Scan Details

Site Domain corp.naukri.com
Base Domain naukri.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonRequest timed out.
Last Scan2024-05-17T08:42:42+00:00
Next Scan 2024-06-16T08:42:42+00:00

Last Successful Scan

Scanned2024-03-26T08:41:36+00:00
URL https://corp.naukri.com/robots.txt
Redirect https://www.naukri.com/robots.txt
Redirect Domain www.naukri.com
Redirect Base naukri.com
Domain IPs 23.52.113.232, 2600:1413:b000:380::23ed, 2600:1413:b000:399::23ed
Redirect IPs 23.52.113.232, 2600:1413:b000:380::23ed, 2600:1413:b000:399::23ed
Response IP 23.54.58.48
Found Yes
Hash e64c1a714d8c351502c91ea232e79227ff3e3ac6b9b79e255a16e6c8e0cf6f8e
SimHash 632c5881ec16

Groups

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

chatgpt

Rule Path
Disallow /

openai

Rule Path
Disallow /

*

Rule Path
Disallow /advertiser/
Disallow /preview/
Disallow /photo/
Disallow /Photo/
Disallow /profilePic/
Disallow /manager/checkEmail.php
Disallow /ni/manager/Check/email
Disallow /gpw/
Disallow /jg/
Disallow /lls/tm/
Disallow /alljobs/job/
Disallow /om.php
Disallow /j2.php
Disallow /recruiters/open-jobs-*
Disallow /recruiters/closed-jobs-*
Disallow /recruiters/follow-with-count-*
Disallow /recruiters/unfollow-with-count-*
Disallow /recruiters/rp-follower-count-*
Disallow /code360-staging
Disallow /code360-staging/
Disallow /code360-staging/*
Disallow /code360
Disallow /code360/
Disallow /code360/*

Other Records

Field Value
sitemap https://www.naukri.com/sitemap.xml
sitemap https://www.naukri.com/sitemap/webstories-1.xml

Comments

  • Created September, 01, 2006.
  • Author: Jai P Sharma
  • Email : jai.sharma[at]naukri.com
  • Edited : Feb 10, 2022
  • Edited : Mar 04, 2022 (sitemaps added)
  • Edited : Apr 25, 2023 (Block ChatGPT)
  • Edited : May 15, 2023 (Add webstories sitemap)
  • Edited : Jun 7, 2023 (Added 3 recruiter url's)
  • Edited : Sept 22, 2023 (Block GPTBot)
  • Edited : Dec 22, 2023 (Block Google-Extended)