blogdesuperheroes.es
robots.txt

Robots Exclusion Standard data for blogdesuperheroes.es

Resource Scan

Scan Details

Site Domain blogdesuperheroes.es
Base Domain blogdesuperheroes.es
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-09-23T07:32:43+00:00
Next Scan 2024-12-22T07:32:43+00:00

Last Successful Scan

Scanned2023-05-30T19:07:46+00:00
URL https://blogdesuperheroes.es/robots.txt
Domain IPs 104.21.19.112, 172.67.186.2, 2606:4700:3032::6815:1370, 2606:4700:3036::ac43:ba02
Response IP 172.67.186.2
Found Yes
Hash 1dc48472272c533188e8a53a318c5c94e44ca7f477657349d3d7cf017b86f0a8
SimHash 0b089ec015f3

Groups

mediapartners-google
*

Rule Path
Disallow /wp-admin/
Disallow /foros/
Disallow /foros
Disallow /politica-de-privacidad
Disallow /politica-de-cookies
Disallow /mas-informacion-sobre-las-cookies
Disallow /*preview%3Dtrue*
Allow /

msnbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://blogdesuperheroes.es/sitemap.xml

Warnings

  • 1 invalid line.