es.calcuworld.com
robots.txt

Robots Exclusion Standard data for es.calcuworld.com

Resource Scan

Scan Details

Site Domain es.calcuworld.com
Base Domain calcuworld.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-17T11:11:53+00:00
Next Scan 2024-07-16T11:11:53+00:00

Last Successful Scan

Scanned2024-02-25T11:09:10+00:00
URL https://es.calcuworld.com/robots.txt
Domain IPs 104.21.4.130, 172.67.132.25, 2606:4700:3030::ac43:8419, 2606:4700:3037::6815:482
Response IP 172.67.132.25
Found Yes
Hash 3caa0a806f43c3720e50b5e7bdb3c17124b0a4719f01dd899eb6f0ee972f1572
SimHash e844ddc00922

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /13837015/
Disallow /resources/

*

Rule Path
Disallow /?s=
Disallow /search

*

Rule Path
Allow /feed/$
Disallow /feed/
Disallow /comments/feed/
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$

Comments

  • Bloqueo de busquedas
  • Bloqueo de feeds para crawlers