rubikloan.com
robots.txt

Robots Exclusion Standard data for rubikloan.com

Resource Scan

Scan Details

Site Domain rubikloan.com
Base Domain rubikloan.com
Scan Status Ok
Last Scan3/16/2025, 11:04:25 PM
Next Scan 4/15/2025, 11:04:25 PM

Last Scan

Scanned3/16/2025, 11:04:25 PM
URL https://rubikloan.com/robots.txt
Redirect https://www.rubikloan.com/robots.txt
Redirect Domain www.rubikloan.com
Redirect Base rubikloan.com
Domain IPs 104.21.90.116, 172.67.200.101, 2606:4700:3033::ac43:c865, 2606:4700:3035::6815:5a74
Redirect IPs 104.21.90.116, 172.67.200.101, 2606:4700:3033::ac43:c865, 2606:4700:3035::6815:5a74
Response IP 104.21.90.116
Found Yes
Hash dab6db9c1b74e18cf1c074fc737e9d41108eb135411c75dd2d0d2fc6b9478dc1
SimHash 595480645132

Groups

*

Rule Path
Allow /index
Allow /indexEn
Allow /indexEs
Allow /$
Allow /images/favicons/
Disallow /

ia_archiver

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /