citywireselector.com
robots.txt
Robots Exclusion Standard data for citywireselector.com
Resource Scan
Scan Details
Site Domain | citywireselector.com |
Base Domain | citywireselector.com |
Scan Status | Ok |
Last Scan | 2024-06-20T08:23:32+00:00 |
Next Scan | 2024-07-20T08:23:32+00:00 |
Last Scan
Scanned | 2024-06-20T08:23:32+00:00 |
URL | https://citywireselector.com/robots.txt |
Redirect | https://citywire.com:443/selector/robots.txt |
Redirect Domain | citywire.com |
Redirect Base | citywire.com |
Domain IPs | 18.200.175.190, 52.209.253.55, 52.48.84.33 |
Redirect IPs | 45.60.242.95, 45.60.248.95 |
Response IP | 45.60.242.95 |
Found | Yes |
Hash | b42fea0cc15ee5f92e566d2c4ea036cb336e88b6f39c7e03ef66c4313009510f |
SimHash | 08524341f014 |
Groups
*
Rule | Path |
---|---|
Disallow | /search$ |
Disallow | /*/search$ |
Disallow | /search? |
Disallow | /*/search? |
Disallow | /sign-in$ |
Disallow | /*/sign-in$ |
Disallow | /sign-in? |
Disallow | /*/sign-in? |
Disallow | /register$ |
Disallow | /*/register$ |
Disallow | /register? |
Disallow | /*/register? |
Disallow | /GetCommentsCount |
Disallow | /*/GetCommentsCount |
Disallow | /GetCommentsCount? |
Disallow | /*/GetCommentsCount? |