torre.ai
robots.txt
Robots Exclusion Standard data for torre.ai
Resource Scan
Scan Details
Site Domain | torre.ai |
Base Domain | torre.ai |
Scan Status | Ok |
Last Scan | 2024-09-10T11:53:16+00:00 |
Next Scan | 2024-09-24T11:53:16+00:00 |
Last Scan
Scanned | 2024-09-10T11:53:16+00:00 |
URL | https://torre.ai/robots.txt |
Domain IPs | 34.210.205.130, 34.223.148.179, 54.189.161.116, 54.213.97.206 |
Response IP | 54.213.97.206 |
Found | Yes |
Hash | 0e0b0708a901bf9f90c72fd338ff7fd2b4e39fd737ec05f0507446a7efc51302 |
SimHash | ce51b55c7034 |
Groups
*
Rule | Path |
---|---|
Allow | /search/people$ |
Allow | /search/jobs$ |
Allow | /*/search/people$ |
Allow | /*/search/jobs$ |
Disallow | /search/people?* |
Disallow | /search/jobs?* |
Disallow | /*/search/people?* |
Disallow | /*/search/jobs?* |
Disallow | /messenger |
Disallow | /*/messenger |
Disallow | /messenger/* |
Disallow | /*/messenger/* |
Disallow | /jobalerts |
Disallow | /jobalerts/* |
Disallow | /*/jobalerts |
Disallow | /*/jobalerts/* |