Log In Sign Up

kumarijob.com
robots.txt

Robots Exclusion Standard data for kumarijob.com

Resource Scan

Scan Details

Site Domain kumarijob.com
Base Domain kumarijob.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-01T20:42:02+00:00
Next Scan 2026-01-30T20:42:02+00:00

Last Successful Scan

Scanned2025-09-12T09:26:52+00:00
URL https://kumarijob.com/robots.txt
Redirect https://www.kumarijob.com/robots.txt
Redirect Domain www.kumarijob.com
Redirect Base kumarijob.com
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Redirect IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.48.1
Found Yes
Hash 9ad59050dd96e3d7b80a024346bf2c5ace501015d00c2e938f74f281e958af80
SimHash f50c2aa2e704

Groups

*

Rule Path
Allow /sitemap.xml
Allow /jobseeker$
Allow /search$
Disallow /admin/
Disallow /api/
Disallow /kumari-job/
Disallow /index.php
Disallow /choose-verification-option
Disallow /reset-password
Disallow /reset-password-mobile
Disallow /login/facebook
Disallow /login/facebook/callback
Disallow /login/google
Disallow /login/google/callback
Disallow /login/linkedin
Disallow /login/linkedin/callback
Disallow /jobseeker*
Disallow /jobseeker?
Disallow /employer/*
Disallow /employer?
Disallow /public/**/*.zip
Disallow /new-assets/
Disallow /images/
Disallow /public/assets/
Back to top

Other Records

Field Value
sitemap https://www.kumarijob.com/sitemap.xml
Back to top

Comments

  • Main website configuration
  • Allow specific pages
  • Block admin and system paths
  • Block auth-related paths
  • Block dynamic pages
  • Block asset directories
  • Specify preferred host
  • Sitemap declaration
Back to top

Warnings

  • `host` is not a known field.
Back to top