carta-natal.es
robots.txt

Robots Exclusion Standard data for carta-natal.es

Resource Scan

Scan Details

Site Domain carta-natal.es
Base Domain carta-natal.es
Scan Status Ok
Last Scan2024-11-12T21:15:03+00:00
Next Scan 2024-11-19T21:15:03+00:00

Last Scan

Scanned2024-11-12T21:15:03+00:00
URL https://carta-natal.es/robots.txt
Domain IPs 188.164.197.49
Response IP 188.164.197.49
Found Yes
Hash 26126aea0888daed7eda1c979f48242b571fca8ab080792f3b954e7dcb10bfd6
SimHash e30ed0f2cb31

Groups

*

Rule Path
Allow /
Disallow /archivos/cartas/pdf/
Disallow /archivos/ciudades/

mediapartners-google

Rule Path
Disallow

google-display-ads-bot

Rule Path
Disallow

criteobot/0.1

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

amazonadbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://carta-natal.es/sitemap.xml