citywireselector.com
robots.txt
Robots Exclusion Standard data for citywireselector.com
Resource Scan
Scan Details
Site Domain | citywireselector.com |
Base Domain | citywireselector.com |
Scan Status | Ok |
Last Scan | 2024-05-21T08:23:07+00:00 |
Next Scan | 2024-06-20T08:23:07+00:00 |
Last Scan
Scanned | 2024-05-21T08:23:07+00:00 |
URL | https://citywireselector.com/robots.txt |
Redirect | https://citywire.com:443/selector/robots.txt |
Redirect Domain | citywire.com |
Redirect Base | citywire.com |
Domain IPs | 52.18.31.128, 54.72.80.182, 54.74.75.111 |
Redirect IPs | 45.60.242.95, 45.60.248.95 |
Response IP | 45.60.248.95 |
Found | Yes |
Hash | b42fea0cc15ee5f92e566d2c4ea036cb336e88b6f39c7e03ef66c4313009510f |
SimHash | 08524341f014 |
Groups
*
Rule | Path |
---|---|
Disallow | /search$ |
Disallow | /*/search$ |
Disallow | /search? |
Disallow | /*/search? |
Disallow | /sign-in$ |
Disallow | /*/sign-in$ |
Disallow | /sign-in? |
Disallow | /*/sign-in? |
Disallow | /register$ |
Disallow | /*/register$ |
Disallow | /register? |
Disallow | /*/register? |
Disallow | /GetCommentsCount |
Disallow | /*/GetCommentsCount |
Disallow | /GetCommentsCount? |
Disallow | /*/GetCommentsCount? |