calcuworld.com
robots.txt

Robots Exclusion Standard data for calcuworld.com

Resource Scan

Scan Details

Site Domain calcuworld.com
Base Domain calcuworld.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-22T21:55:25+00:00
Next Scan 2025-09-20T21:55:25+00:00

Last Successful Scan

Scanned2024-02-29T21:34:02+00:00
URL https://calcuworld.com/robots.txt
Domain IPs 104.21.4.130, 172.67.132.25, 2606:4700:3030::ac43:8419, 2606:4700:3037::6815:482
Response IP 104.21.4.130
Found Yes
Hash 3caa0a806f43c3720e50b5e7bdb3c17124b0a4719f01dd899eb6f0ee972f1572
SimHash e844ddc00922

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /13837015/
Disallow /resources/

*

Rule Path
Disallow /?s=
Disallow /search

*

Rule Path
Allow /feed/$
Disallow /feed/
Disallow /comments/feed/
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$

Comments

  • Bloqueo de busquedas
  • Bloqueo de feeds para crawlers