aswift.com
robots.txt
Robots Exclusion Standard data for aswift.com
Resource Scan
Scan Details
Site Domain | aswift.com |
Base Domain | aswift.com |
Scan Status | Ok |
Last Scan | 2024-09-17T05:50:53+00:00 |
Next Scan | 2024-10-17T05:50:53+00:00 |
Last Scan
Scanned | 2024-09-17T05:50:53+00:00 |
URL | https://www.aswift.com/robots.txt |
Domain IPs | 13.227.254.100, 13.227.254.46, 13.227.254.7, 13.227.254.97, 2600:9000:200a:1200:c:cb6f:ee80:93a1, 2600:9000:200a:1e00:c:cb6f:ee80:93a1, 2600:9000:200a:2800:c:cb6f:ee80:93a1, 2600:9000:200a:6a00:c:cb6f:ee80:93a1, 2600:9000:200a:7200:c:cb6f:ee80:93a1, 2600:9000:200a:7600:c:cb6f:ee80:93a1, 2600:9000:200a:9200:c:cb6f:ee80:93a1, 2600:9000:200a:e400:c:cb6f:ee80:93a1 |
Response IP | 13.227.254.7 |
Found | Yes |
Hash | 56d7fc23baa9836cc4df5aac697fb79477be67a0d15bc0142545bd45bf154416 |
SimHash | 630141404f94 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin$ |
Disallow | /admin/* |
Disallow | /sa$ |
Disallow | /sa/* |
Disallow | /api/* |
Disallow | /users/auth/* |
Disallow | /sso/* |
Disallow | /*?* |
Disallow | /templates/* |
Allow | /db_assets/production*?t=* |
Disallow | /job/*/apply |
Disallow | /job/*/save_job |
Disallow | /job/*/unsave_job |
Disallow | /jobs/*/*/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.aswift.com/sitemap.xml |