dentalpost.net
robots.txt
Robots Exclusion Standard data for dentalpost.net
Resource Scan
Scan Details
Site Domain | dentalpost.net |
Base Domain | dentalpost.net |
Scan Status | Ok |
Last Scan | 2025-03-08T12:22:25+00:00 |
Next Scan | 2025-03-22T12:22:25+00:00 |
Last Scan
Scanned | 2025-03-08T12:22:25+00:00 |
URL | https://dentalpost.net/robots.txt |
Redirect | https://www.dentalpost.net/robots.txt |
Redirect Domain | www.dentalpost.net |
Redirect Base | dentalpost.net |
Domain IPs | 18.161.111.13, 18.161.111.25, 18.161.111.29, 18.161.111.87 |
Redirect IPs | 18.161.97.105, 18.161.97.106, 18.161.97.20, 18.161.97.28 |
Response IP | 3.164.68.22 |
Found | Yes |
Hash | 35cc80d2ba2baea67ab23c6c14f20d49c4a88635b581f6ee0156451978e8bdfe |
SimHash | 29401644cf13 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /app/ |
Disallow | /dental-jobs/job-post/*a*/*/$ |
Disallow | /dental-jobs/job-post/*b*/*/$ |
Disallow | /dental-jobs/job-post/*c*/*/$ |
Disallow | /dental-jobs/job-post/*d*/*/$ |
Disallow | /dental-jobs/job-post/*e*/*/$ |
Disallow | /dental-jobs/job-post/*f*/*/$ |
Other Records
Field | Value |
---|---|
sitemap | https://www.dentalpost.net/sitemap-index.xml |
Warnings
- `host` is not a known field.