descuentos.elmundo.es
robots.txt

Robots Exclusion Standard data for descuentos.elmundo.es

Resource Scan

Scan Details

Site Domain descuentos.elmundo.es
Base Domain elmundo.es
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-03-11T10:58:02+00:00
Next Scan 2025-03-25T10:58:02+00:00

Last Successful Scan

Scanned2025-02-01T10:52:07+00:00
URL https://descuentos.elmundo.es/robots.txt
Domain IPs 3.170.229.51, 3.170.229.53, 3.170.229.66, 3.170.229.96
Response IP 3.170.229.51
Found Yes
Hash 264fd68da4f72d6c34fb8e91617201096976b68dd9214ea321542d0e22c18512
SimHash 590c514766b7

Groups

*

Rule Path
Allow /
Disallow /api/*
Disallow /loading/*
Disallow /mercury/out*
Disallow /clickout/*
Disallow /user/submit
Disallow /*?preview

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

seekr

Rule Path
Disallow /

seekbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://descuentos.elmundo.es/sitemap.xml