credible.com
robots.txt

Robots Exclusion Standard data for credible.com

Resource Scan

Scan Details

Site Domain credible.com
Base Domain credible.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-05-19T19:51:35+00:00
Next Scan 2025-08-17T19:51:35+00:00

Last Successful Scan

Scanned2023-01-04T20:04:36+00:00
URL https://credible.com/robots.txt
Redirect https://www.credible.com/robots.txt
Redirect Domain www.credible.com
Redirect Base credible.com
Domain IPs 54.230.112.38, 54.230.112.39, 54.230.112.42, 54.230.112.78
Redirect IPs 54.192.111.30, 54.192.111.5, 54.192.111.64, 54.192.111.99
Response IP 54.192.111.64
Found Yes
Hash 3ba57bc4a5d93b846f018140a678ce51887baa98aa1583b2cbbcc1e2d747e5a0
SimHash b093d16e269d

Groups

*

Rule Path
Disallow /embed
Disallow /compare
Disallow /ama
Disallow /refinance-student-loans/refi1
Disallow /*?*relatedposts=1
Disallow /*tag/
Disallow /student-loans/borrower/
Disallow /student-loans/cosigner-prequal/
Disallow /undefined
Disallow /credit-cards/review
Disallow /credit-cards/apply-now
Disallow /dashboard*
Disallow /refi/borrower/
Disallow /refi/prequal/
Disallow /refi/cosigner/
Disallow /user/
Disallow /home$
Disallow /author/
Disallow /search/
Disallow /*?s=*
Disallow /xmlrpc.php
Disallow /cgi-bin
Disallow /share/
Disallow /refinance-student-loans/ama
Disallow /student-loans/ama
Disallow /a/invalid-referral-link
Disallow /student-loans/invited-cosigner-prequal
Disallow /a/category/uncategorized/
Disallow /a/$
Allow /blog/wp-content/themes/credible/

Other Records

Field Value
sitemap https://www.credible.com/sitemap.xml

Comments

  • Disallow individual pages