signalhire.com
robots.txt

Robots Exclusion Standard data for signalhire.com

Resource Scan

Scan Details

Site Domain signalhire.com
Base Domain signalhire.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-11T16:03:10+00:00
Next Scan 2024-10-10T16:03:10+00:00

Last Successful Scan

Scanned2024-05-21T16:01:53+00:00
URL https://signalhire.com/robots.txt
Redirect https://www.signalhire.com/robots.txt
Redirect Domain www.signalhire.com
Redirect Base signalhire.com
Domain IPs 88.85.73.100
Redirect IPs 104.18.8.59, 104.18.9.59, 2606:4700::6812:83b, 2606:4700::6812:93b
Response IP 104.18.9.59
Found Yes
Hash c9f1be89967a2b881eaa8ba18ff5805fca28f99eaa84b430b6d76f9cf402e36c
SimHash 0904b2127b10

Groups

*

Rule Path
Disallow /*.pdf
Disallow /file/*/download
Allow /jobs/
Disallow /jobs/*/
Disallow /jobs/?job_search
Disallow /*search?q
Disallow /*profiles-search?q
Disallow /*companies-search?q
Disallow /requestDemo
Disallow /opt-out/

Other Records

Field Value
crawl-delay 1

charlotte

Rule Path
Disallow /

speedy

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

riddlerbot

Rule Path
Disallow /

linguatools

Rule Path
Disallow /

www.integromedb.org/crawler

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

Warnings

  • 2 invalid lines.
  • `host` is not a known field.