Log In Sign Up

credit.fr
robots.txt

Robots Exclusion Standard data for credit.fr

Resource Scan

Scan Details

Site Domain credit.fr
Base Domain credit.fr
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan3/22/2025, 10:26:15 AM
Next Scan 6/20/2025, 10:26:15 AM

Last Successful Scan

Scanned5/4/2024, 9:18:31 AM
URL https://credit.fr/robots.txt
Domain IPs 104.26.0.71, 104.26.1.71, 172.67.70.57, 2606:4700:20::681a:147, 2606:4700:20::681a:47, 2606:4700:20::ac43:4639
Response IP 104.26.0.71
Found Yes
Hash 1f5672d68895a2098e5f2dbe46d76c7d211db88571f76e22e0ab28a1daa2702f
SimHash b28d0c8d7d54

Groups

petalbot

Rule Path
Disallow /

*

Rule Path
Disallow /users
Disallow /cgu-smoney
Disallow /documents/projets*
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
Back to top