signalhire.com
robots.txt
Robots Exclusion Standard data for signalhire.com
Resource Scan
Scan Details
Site Domain | signalhire.com |
Base Domain | signalhire.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-10T16:03:27+00:00 |
Next Scan | 2025-01-08T16:03:27+00:00 |
Last Successful Scan
Scanned | 2024-05-21T16:01:53+00:00 |
URL | https://signalhire.com/robots.txt |
Redirect | https://www.signalhire.com/robots.txt |
Redirect Domain | www.signalhire.com |
Redirect Base | signalhire.com |
Domain IPs | 88.85.73.100 |
Redirect IPs | 104.18.8.59, 104.18.9.59, 2606:4700::6812:83b, 2606:4700::6812:93b |
Response IP | 104.18.9.59 |
Found | Yes |
Hash | c9f1be89967a2b881eaa8ba18ff5805fca28f99eaa84b430b6d76f9cf402e36c |
SimHash | 0904b2127b10 |
Groups
*
Rule | Path |
---|---|
Disallow | |
Disallow | /file/*/download |
Allow | /jobs/ |
Disallow | /jobs/*/ |
Disallow | /jobs/?job_search |
Disallow | /*search?q |
Disallow | /*profiles-search?q |
Disallow | /*companies-search?q |
Disallow | /requestDemo |
Disallow | /opt-out/ |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Warnings
- 2 invalid lines.
- `host` is not a known field.