Log In Sign Up

casasyterrenos.com
robots.txt

Robots Exclusion Standard data for casasyterrenos.com

Resource Scan

Scan Details

Site Domain casasyterrenos.com
Base Domain casasyterrenos.com
Scan Status Ok
Last Scan2024-05-28T15:24:14+00:00
Next Scan 2024-06-27T15:24:14+00:00

Last Scan

Scanned2024-05-28T15:24:14+00:00
URL https://casasyterrenos.com/robots.txt
Redirect https://www.casasyterrenos.com:443/robots.txt
Redirect Domain www.casasyterrenos.com
Redirect Base casasyterrenos.com
Domain IPs 44.228.16.225, 44.236.158.146, 54.201.246.183
Redirect IPs 108.157.254.104, 108.157.254.26, 108.157.254.64, 108.157.254.79
Response IP 108.157.254.64
Found Yes
Hash ebe73f664005a0d0b50052b648867f54eba0764933f5f4fd878600187faeef20
SimHash 0468bb61cfb3

Groups

trovitbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /*?*
Disallow /inc/
Disallow /2015/
Disallow /assets/
Disallow /residencial/
Back to top

Other Records

Field Value
sitemap https://www.casasyterrenos.com/sitemaps/busquedas_sitemap.xml
sitemap https://www.casasyterrenos.com/sitemaps/colonias_activas_sitemap.xml
sitemap https://www.casasyterrenos.com/sitemaps/colonias_sitemap.xml
sitemap https://www.casasyterrenos.com/sitemaps/inmobiliarias_sitemap.xml
sitemap https://www.casasyterrenos.com/sitemaps/sitemap_index.xml
sitemap https://www.casasyterrenos.com/sitemaps/nuevos_desarrollos_sitemap.xml
Back to top

Comments

  • sitemaps
  • User Agents Not for crawling
  • Bots crawling
  • rogerbot (ryte)
Back to top