talentin.com
robots.txt
Robots Exclusion Standard data for talentin.com
Resource Scan
Scan Details
Site Domain | talentin.com |
Base Domain | talentin.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-07T23:52:50+00:00 |
Next Scan | 2024-12-06T23:52:50+00:00 |
Last Successful Scan
Scanned | 2024-08-09T23:49:44+00:00 |
URL | https://talentin.com/robots.txt |
Redirect | https://uk.talentin.com/robots.txt |
Redirect Domain | uk.talentin.com |
Redirect Base | talentin.com |
Domain IPs | 104.26.10.163, 104.26.11.163, 172.67.73.132, 2606:4700:20::681a:aa3, 2606:4700:20::681a:ba3, 2606:4700:20::ac43:4984 |
Redirect IPs | 104.26.10.163, 104.26.11.163, 172.67.73.132, 2606:4700:20::681a:aa3, 2606:4700:20::681a:ba3, 2606:4700:20::ac43:4984 |
Response IP | 172.67.73.132 |
Found | Yes |
Hash | 005745969c52bf3a0880e1791c0d12e6cded808d3331a058a99680d3abc0a24e |
SimHash | 8455d7f26611 |
Groups
*
Rule | Path |
---|---|
Allow | /static/ |
Allow | /*?start |
Allow | /*?location |
Disallow | /vacancy-search/ |
Disallow | /account/ |
Disallow | /*? |
Disallow | /bookmarks$ |
Disallow | /user/ |
Disallow | /employer/ |