city-cost.com
robots.txt

Robots Exclusion Standard data for city-cost.com

Resource Scan

Scan Details

Site Domain city-cost.com
Base Domain city-cost.com
Scan Status Ok
Last Scan2024-06-30T18:13:29+00:00
Next Scan 2024-07-07T18:13:29+00:00

Last Scan

Scanned2024-06-30T18:13:29+00:00
URL https://city-cost.com/robots.txt
Redirect https://www.city-cost.com:443/robots.txt
Redirect Domain www.city-cost.com
Redirect Base city-cost.com
Domain IPs 52.194.139.85, 54.250.17.167
Redirect IPs 13.33.88.26, 13.33.88.47, 13.33.88.51, 13.33.88.55
Response IP 13.33.88.51
Found Yes
Hash e27245b567e26b0d72041f0b8ac45d2b0dfc198df80a7814885c666de242f070
SimHash 2f3d987b4811

Groups

*

Rule Path
Disallow /mypage
Disallow /mypage/*
Disallow /*/mypage
Disallow /*/mypage/*
Disallow /search
Disallow /search/*
Disallow /*/search
Disallow /*/search/*
Disallow /users
Disallow /users/*
Disallow /*/users
Disallow /*/users/*
Disallow /pages
Disallow /pages/*
Disallow /*/pages
Disallow /*/pages/*
Disallow /forms
Disallow /forms/*
Disallow /*/forms
Disallow /*/forms/*
Allow /pages/lp_survey
Allow /pages/lp_themes
Allow /pages/about_us
Allow /pages/lp_*

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.city-cost.com/sitemap.xml