barrattgalvin.com
robots.txt
Robots Exclusion Standard data for barrattgalvin.com
Resource Scan
Scan Details
Site Domain | barrattgalvin.com |
Base Domain | barrattgalvin.com |
Scan Status | Ok |
Last Scan | 2024-10-05T07:56:58+00:00 |
Next Scan | 2024-11-04T07:56:58+00:00 |
Last Scan
Scanned | 2024-10-05T07:56:58+00:00 |
URL | https://www.barrattgalvin.com/robots.txt |
Domain IPs | 18.155.68.122, 18.155.68.36, 18.155.68.92, 18.155.68.98, 2600:9000:23d2:1000:a:8fe2:c840:93a1, 2600:9000:23d2:4400:a:8fe2:c840:93a1, 2600:9000:23d2:6200:a:8fe2:c840:93a1, 2600:9000:23d2:7200:a:8fe2:c840:93a1, 2600:9000:23d2:ae00:a:8fe2:c840:93a1, 2600:9000:23d2:bc00:a:8fe2:c840:93a1, 2600:9000:23d2:f600:a:8fe2:c840:93a1, 2600:9000:23d2:fa00:a:8fe2:c840:93a1 |
Response IP | 18.155.68.92 |
Found | Yes |
Hash | e0537ef3fd65d750bb6555765e1d734b109b6f78b2d5e41ed507fac8dbe5022b |
SimHash | 6311414c4f94 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin$ |
Disallow | /admin/* |
Disallow | /sa$ |
Disallow | /sa/* |
Disallow | /api/* |
Disallow | /users/auth/* |
Disallow | /sso/* |
Disallow | /*?* |
Disallow | /templates/* |
Allow | /db_assets/production*?t=* |
Disallow | /job/*/apply |
Disallow | /job/*/save_job |
Disallow | /job/*/unsave_job |
Disallow | /jobs/*/*/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.barrattgalvin.com/sitemap.xml |