city-cost.com
robots.txt
Robots Exclusion Standard data for city-cost.com
Resource Scan
Scan Details
Site Domain | city-cost.com |
Base Domain | city-cost.com |
Scan Status | Ok |
Last Scan | 2024-06-30T18:13:29+00:00 |
Next Scan | 2024-07-07T18:13:29+00:00 |
Last Scan
Scanned | 2024-06-30T18:13:29+00:00 |
URL | https://city-cost.com/robots.txt |
Redirect | https://www.city-cost.com:443/robots.txt |
Redirect Domain | www.city-cost.com |
Redirect Base | city-cost.com |
Domain IPs | 52.194.139.85, 54.250.17.167 |
Redirect IPs | 13.33.88.26, 13.33.88.47, 13.33.88.51, 13.33.88.55 |
Response IP | 13.33.88.51 |
Found | Yes |
Hash | e27245b567e26b0d72041f0b8ac45d2b0dfc198df80a7814885c666de242f070 |
SimHash | 2f3d987b4811 |
Groups
*
Rule | Path |
---|---|
Disallow | /mypage |
Disallow | /mypage/* |
Disallow | /*/mypage |
Disallow | /*/mypage/* |
Disallow | /search |
Disallow | /search/* |
Disallow | /*/search |
Disallow | /*/search/* |
Disallow | /users |
Disallow | /users/* |
Disallow | /*/users |
Disallow | /*/users/* |
Disallow | /pages |
Disallow | /pages/* |
Disallow | /*/pages |
Disallow | /*/pages/* |
Disallow | /forms |
Disallow | /forms/* |
Disallow | /*/forms |
Disallow | /*/forms/* |
Allow | /pages/lp_survey |
Allow | /pages/lp_themes |
Allow | /pages/about_us |
Allow | /pages/lp_* |
Other Records
Field | Value |
---|---|
sitemap | https://www.city-cost.com/sitemap.xml |