careerbuilder.co.in
robots.txt
Robots Exclusion Standard data for careerbuilder.co.in
Resource Scan
Scan Details
| Site Domain | careerbuilder.co.in |
| Base Domain | careerbuilder.co.in |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Request timed out. |
| Last Scan | 2025-11-23T07:52:34+00:00 |
| Next Scan | 2026-02-21T07:52:34+00:00 |
Last Successful Scan
| Scanned | 2024-12-16T18:40:54+00:00 |
| URL | https://www.careerbuilder.co.in/robots.txt |
| Domain IPs | 104.18.14.150, 104.18.15.150, 2606:4700::6812:e96, 2606:4700::6812:f96 |
| Response IP | 104.18.15.150 |
| Found | Yes |
| Hash | 3e3b4dd2470703aa093366bd6a90d25eb545911d6acb0d03f92a424481b0e5c3 |
| SimHash | e848d841e993 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /apply |
| Disallow | /user |
| Disallow | /recommended |
| Disallow | /share |
| Disallow | /ecommerce |
| Disallow | /ECommerce |
| Disallow | /jobsearch? |
| Disallow | /jobsearch?q |
| Disallow | /jobsearch?pg |
| Disallow | /resume/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.careerbuilder.co.in/sitemapindex.xml |
Comments