pipelineaz.com
robots.txt
Robots Exclusion Standard data for pipelineaz.com
Resource Scan
Scan Details
| Site Domain | pipelineaz.com |
| Base Domain | pipelineaz.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2026-02-01T12:58:21+00:00 |
| Next Scan | 2026-05-02T12:58:21+00:00 |
Last Successful Scan
| Scanned | 2023-09-23T06:08:51+00:00 |
| URL | https://pipelineaz.com/robots.txt |
| Domain IPs | 104.26.4.29, 104.26.5.29, 172.67.72.124, 2606:4700:20::681a:41d, 2606:4700:20::681a:51d, 2606:4700:20::ac43:487c |
| Response IP | 172.67.72.124 |
| Found | Yes |
| Hash | d5e2060b8b616ef7822037d0089c70e1d4d1590c399da8ce71a656b914a644a2 |
| SimHash | 1b1c7b048180 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /candidates/result |
| Disallow | /careers/result |
| Disallow | /companies/search |
| Disallow | /jobs/*/track_view |
| Disallow | /jobs/*/track_application |
| Disallow | /jobs/search |
| Disallow | /programs/search |
| Disallow | /schools/search |