civitatis.com
robots.txt

Robots Exclusion Standard data for civitatis.com

Resource Scan

Scan Details

Site Domain civitatis.com
Base Domain civitatis.com
Scan Status Ok
Last Scan2024-10-05T18:10:31+00:00
Next Scan 2024-10-19T18:10:31+00:00

Last Scan

Scanned2024-10-05T18:10:31+00:00
URL https://civitatis.com/robots.txt
Redirect https://www.civitatis.com/robots.txt
Redirect Domain www.civitatis.com
Redirect Base civitatis.com
Domain IPs 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91, 2a04:4e42:200::347, 2a04:4e42:400::347, 2a04:4e42:600::347, 2a04:4e42:800::347, 2a04:4e42::347, 2a04:4e42:a00::347, 2a04:4e42:c00::347, 2a04:4e42:e00::347
Redirect IPs 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91, 2a04:4e42:200::347, 2a04:4e42:400::347, 2a04:4e42:600::347, 2a04:4e42::347
Response IP 199.232.45.91
Found Yes
Hash 30051970312de45d14df83b4cbcfadc5335aff074205f5a7f5ebcd8209344fe5
SimHash ac5350418839

Groups

*

Rule Path
Disallow */include/
Disallow */vendor
Disallow */lib/
Disallow */cron/
Disallow */actividades/voucher
Disallow */actividades/reserva_confirmada
Disallow */traslados/reserva_confirmada
Disallow */add-activity-to-cart
Disallow */add-transfer-to-cart
Disallow /*?cart*
Disallow /foro
Disallow /blog/tag/
Disallow /blog/author/
Disallow /blog/category/
Disallow /blog/2008/
Disallow /blog/2009/
Disallow /blog/2010/
Disallow /blog/2011/
Disallow /blog/2012/
Disallow /blog/2013/
Disallow /blog/2014/
Disallow /blog/2015/
Disallow /blog/2016/
Disallow /blog/2017/
Disallow /blog/2018/
Disallow /blog/2019/
Disallow /blog/2020/
Disallow /blog/2021/
Disallow /blog/2022/
Disallow */buscar
Disallow */search
Disallow */rechercher
Disallow */procurar
Disallow */cerca
Disallow */invoices
Disallow */didomi/
Disallow */gtm/
Allow /

mj12bot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.civitatis.com/sitemap.xml