milwaukeetool.jobs
robots.txt
Robots Exclusion Standard data for milwaukeetool.jobs
Resource Scan
Scan Details
| Site Domain | milwaukeetool.jobs |
| Base Domain | milwaukeetool.jobs |
| Scan Status | Ok |
| Last Scan | 2024-10-18T00:26:10+00:00 |
| Next Scan | 2024-11-17T00:26:10+00:00 |
Last Scan
| Scanned | 2024-10-18T00:26:10+00:00 |
| URL | https://milwaukeetool.jobs/robots.txt |
| Redirect | https://www.milwaukeetool.jobs/robots.txt |
| Redirect Domain | www.milwaukeetool.jobs |
| Redirect Base | milwaukeetool.jobs |
| Domain IPs | 20.84.197.99 |
| Redirect IPs | 152.199.39.108, 2606:2800:247:1cb7:261b:1f9c:2074:3c |
| Response IP | 152.199.39.108 |
| Found | Yes |
| Hash | 504f2e5f0b18bc9ef7a03dc65563de6adfe7dc7af3855b17b9694ee395d274d5 |
| SimHash | b94915564f55 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /_DEV/ |
| Disallow | /App_Browsers/ |
| Disallow | /App_config/ |
| Disallow | /App_Data/ |
| Disallow | /App_LocalResources/ |
| Disallow | /Areas |
| Disallow | /bin |
| Disallow | /Coveo/ |
| Disallow | /coveo/ |
| Disallow | /DataAccess/ |
| Disallow | /externals/ |
| Disallow | /fedex/ |
| Disallow | /jscript/ |
| Disallow | /layouts/ |
| Disallow | /library/ |
| Disallow | /scripts/ |
| Disallow | /sitecore/ |
| Disallow | /sitecore-modules/ |
| Disallow | /sitecore_files/ |
| Disallow | /sql/ |
| Disallow | /temp/ |
| Disallow | /upload/ |
| Disallow | /Views/ |
| Disallow | /xsl/ |
| Disallow | /*.aspx |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.milwaukeetool.jobs/sitemap.xml |
Warnings
- 1 invalid line.