descuentos.elpais.com
robots.txt

Robots Exclusion Standard data for descuentos.elpais.com

Resource Scan

Scan Details

Site Domain descuentos.elpais.com
Base Domain elpais.com
Scan Status Ok
Last Scan2025-03-03T08:15:23+00:00
Next Scan 2025-04-02T08:15:23+00:00

Last Scan

Scanned2025-03-03T08:15:23+00:00
URL https://descuentos.elpais.com/robots.txt
Domain IPs 3.165.75.12, 3.165.75.38, 3.165.75.54, 3.165.75.58
Response IP 3.165.75.12
Found Yes
Hash aa6732e04ab9a90dc26db77fa105ac4d39a5720d154103e4162a120211f1943b
SimHash 5904514762a6

Groups

*

Rule Path
Allow /
Disallow /api/*
Disallow /loading/*
Disallow /mercury/out*
Disallow /clickout/*
Disallow /user/submit
Disallow /*?preview

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

seekr

Rule Path
Disallow /

seekbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://descuentos.elpais.com/sitemap.xml