t-birdconnect.com
robots.txt
Robots Exclusion Standard data for t-birdconnect.com
Resource Scan
Scan Details
Site Domain | t-birdconnect.com |
Base Domain | t-birdconnect.com |
Scan Status | Ok |
Last Scan | 2024-11-07T07:59:39+00:00 |
Next Scan | 2024-11-21T07:59:39+00:00 |
Last Scan
Scanned | 2024-11-07T07:59:39+00:00 |
URL | https://t-birdconnect.com/robots.txt |
Domain IPs | 104.17.59.185 |
Response IP | 104.17.59.185 |
Found | Yes |
Hash | 3656999fc6ea56712894fffc64d400030d384a8e6bb562ca2ad5c2b2ffe6fea1 |
SimHash | 0d55d80169db |
Groups
*
Rule | Path |
---|---|
Disallow | /pick-institution |
Disallow | /terms |
Disallow | /privacy-policy |
Disallow | /legal |
Disallow | /backoffice |
Disallow | /networks/*/recruiter/jobs |
Other Records
Field | Value |
---|---|
sitemap | https://t-birdconnect.com/sitemap.xml |