citywire.com
robots.txt
Robots Exclusion Standard data for citywire.com
Resource Scan
Scan Details
Site Domain | citywire.com |
Base Domain | citywire.com |
Scan Status | Ok |
Last Scan | 2024-06-04T05:07:49+00:00 |
Next Scan | 2024-06-18T05:07:49+00:00 |
Last Scan
Scanned | 2024-06-04T05:07:49+00:00 |
URL | https://citywire.com/robots.txt |
Domain IPs | 45.60.242.95, 45.60.248.95 |
Response IP | 45.60.242.95 |
Found | Yes |
Hash | b42fea0cc15ee5f92e566d2c4ea036cb336e88b6f39c7e03ef66c4313009510f |
SimHash | 08524341f014 |
Groups
*
Rule | Path |
---|---|
Disallow | /search$ |
Disallow | /*/search$ |
Disallow | /search? |
Disallow | /*/search? |
Disallow | /sign-in$ |
Disallow | /*/sign-in$ |
Disallow | /sign-in? |
Disallow | /*/sign-in? |
Disallow | /register$ |
Disallow | /*/register$ |
Disallow | /register? |
Disallow | /*/register? |
Disallow | /GetCommentsCount |
Disallow | /*/GetCommentsCount |
Disallow | /GetCommentsCount? |
Disallow | /*/GetCommentsCount? |