urbanmilwaukee.com
robots.txt
Robots Exclusion Standard data for urbanmilwaukee.com
Resource Scan
Scan Details
| Site Domain | urbanmilwaukee.com |
| Base Domain | urbanmilwaukee.com |
| Scan Status | Ok |
| Last Scan | 2024-11-13T14:23:43+00:00 |
| Next Scan | 2024-11-20T14:23:43+00:00 |
Last Scan
| Scanned | 2024-11-13T14:23:43+00:00 |
| URL | https://urbanmilwaukee.com/robots.txt |
| Domain IPs | 50.116.60.60 |
| Response IP | 50.116.60.60 |
| Found | Yes |
| Hash | 09823f84b9ca6784f03b949e8d4f8813fef465bb1929273195c7b0ef7efdf976 |
| SimHash | 681e4e027959 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/calendar/ |
| Disallow | /*/*/calendar/ |
| Disallow | /*/*/*/calendar/ |
| Disallow | /*/*/*/*/calendar/ |
| Disallow | /*/about/advertise/ |
| Disallow | /*/*/about/advertise/ |
| Disallow | /*/*/*/about/advertise/ |
| Disallow | /*/*/*/*/about/advertise/ |
| Disallow | /tag/ |
| Disallow | /tag/*/ |
| Disallow | /wp-includes/*/ |
| Disallow | /wp-admin/*/ |
| Disallow | /building/*/feed/ |
| Disallow | /release/*/feed/ |
| Disallow | /people/*/feed/ |
| Disallow | /government/*/feed/ |
| Disallow | /business/*/feed/ |
| Disallow | /*/*/*/feed |
| Disallow | /*/*/*/*/feed |
| Disallow | /2017/12/21/court-watch-federal-judge-slams-lawyers-in-jail-suit/ |
| Disallow | /2015/03/27/review-getting-high-on-brit-floyd/ |
Other Records
| Field | Value |
|---|---|
| sitemap | http://urbanmilwaukee.com/sitemap.xml.gz |