viajaporcolombia.com
robots.txt

Robots Exclusion Standard data for viajaporcolombia.com

Resource Scan

Scan Details

Site Domain viajaporcolombia.com
Base Domain viajaporcolombia.com
Scan Status Ok
Last Scan2024-11-12T00:17:31+00:00
Next Scan 2024-11-19T00:17:31+00:00

Last Scan

Scanned2024-11-12T00:17:31+00:00
URL https://viajaporcolombia.com/robots.txt
Domain IPs 104.21.21.98, 172.67.197.169, 2606:4700:3031::6815:1562, 2606:4700:3035::ac43:c5a9
Response IP 172.67.197.169
Found Yes
Hash 4f806263a16615cc7b94880ba4e10efa3d8722a6b67420025d5c9fe5228c273a
SimHash 810dc00380fb

Groups

ahrefsbot

Rule Path
Disallow /

newspaper/0.2.8

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

curl

Rule Path
Disallow /

dalvik/2.1.0

Rule Path
Disallow /

*

Rule Path
Disallow /pdf/
Disallow /en/
Disallow /banners/
Disallow /ads/
Disallow /mail/
Disallow /includes/
Disallow /links/
Disallow /livezilla/
Disallow /1079662/
Disallow /transporte/
Disallow /concursos/
Disallow /rating/
Disallow /*.swf$
Disallow /*.pdf$
Disallow /eyeblaster
Disallow /addineyeV2.html
Disallow /addineyeV2-secure.html
Disallow /plugins/feedback.php
Disallow /empresa/galeria.php
Allow /

Other Records

Field Value
sitemap https://www.viajaporcolombia.com/xml/urllist.txt