careers.tbr.edu
robots.txt
Robots Exclusion Standard data for careers.tbr.edu
Resource Scan
Scan Details
Site Domain | careers.tbr.edu |
Base Domain | tbr.edu |
Scan Status | Ok |
Last Scan | 2025-02-18T00:45:18+00:00 |
Next Scan | 2025-03-20T00:45:18+00:00 |
Last Scan
Scanned | 2025-02-18T00:45:18+00:00 |
URL | https://careers.tbr.edu/robots.txt |
Domain IPs | 13.227.254.115, 13.227.254.15, 13.227.254.96, 13.227.254.98, 2600:9000:200a:5800:4:9eed:5f40:93a1, 2600:9000:200a:7000:4:9eed:5f40:93a1, 2600:9000:200a:bc00:4:9eed:5f40:93a1, 2600:9000:200a:d200:4:9eed:5f40:93a1, 2600:9000:200a:e00:4:9eed:5f40:93a1, 2600:9000:200a:ec00:4:9eed:5f40:93a1, 2600:9000:200a:ee00:4:9eed:5f40:93a1, 2600:9000:200a:f800:4:9eed:5f40:93a1 |
Response IP | 13.227.254.98 |
Found | Yes |
Hash | 2ed5399d5d7eeea05ab90d7da1c7cf7b60814526bdda412501d0d19eec36e985 |
SimHash | 2d2d1c664151 |
Groups
*
Rule | Path |
---|---|
Disallow | |
Disallow | /v1/candidate_details |
Disallow | /me/ |
Disallow | /api/ |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | https://careers.tbr.edu/sitemap.xml |
Comments