larsonmaddox.com
robots.txt
Robots Exclusion Standard data for larsonmaddox.com
Resource Scan
Scan Details
Site Domain | larsonmaddox.com |
Base Domain | larsonmaddox.com |
Scan Status | Ok |
Last Scan | 2024-11-16T07:48:31+00:00 |
Next Scan | 2024-12-16T07:48:31+00:00 |
Last Scan
Scanned | 2024-11-16T07:48:31+00:00 |
URL | https://www.larsonmaddox.com/robots.txt |
Domain IPs | 18.155.68.102, 18.155.68.39, 18.155.68.67, 18.155.68.92, 2600:9000:23d2:1400:1:455b:3180:93a1, 2600:9000:23d2:1e00:1:455b:3180:93a1, 2600:9000:23d2:3400:1:455b:3180:93a1, 2600:9000:23d2:6e00:1:455b:3180:93a1, 2600:9000:23d2:a000:1:455b:3180:93a1, 2600:9000:23d2:a400:1:455b:3180:93a1, 2600:9000:23d2:c00:1:455b:3180:93a1, 2600:9000:23d2:e200:1:455b:3180:93a1 |
Response IP | 18.155.68.92 |
Found | Yes |
Hash | 687893bd936121815aff264ecf1aa9f3aad11e9e2e6f1b0195785580d37f3140 |
SimHash | 631141484f94 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin$ |
Disallow | /admin/* |
Disallow | /sa$ |
Disallow | /sa/* |
Disallow | /api/* |
Disallow | /users/auth/* |
Disallow | /sso/* |
Disallow | /*?* |
Disallow | /templates/* |
Allow | /db_assets/production*?t=* |
Disallow | /job/*/apply |
Disallow | /job/*/save_job |
Disallow | /job/*/unsave_job |
Disallow | /jobs/*/*/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.larsonmaddox.com/sitemap.xml |