rubixe.com
robots.txt
Robots Exclusion Standard data for rubixe.com
Resource Scan
Scan Details
| Site Domain | rubixe.com |
| Base Domain | rubixe.com |
| Scan Status | Ok |
| Last Scan | 2025-10-24T07:44:38+00:00 |
| Next Scan | 2025-11-23T07:44:38+00:00 |
Last Scan
| Scanned | 2025-10-24T07:44:38+00:00 |
| URL | https://rubixe.com/robots.txt |
| Domain IPs | 104.21.44.65, 172.67.196.113, 2606:4700:3034::6815:2c41, 2606:4700:3035::ac43:c471 |
| Response IP | 104.21.44.65 |
| Found | Yes |
| Hash | 7a987dbe303ec3915868ecaae9cda9daea9a9063becbebaf4b0819baa97f2d85 |
| SimHash | 60d81051c4a1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
google-hoteladsverifier
mediapartners-google
adsbot-google
adsbot-google-mobile
oai-searchbot
chatgpt-user
perplexitybot
firecrawlagent
andibot
exabot
phindbot
youbot
claudebot
duckassistbot
apple-extended
baiduspider
yandex
googlebot
| Rule | Path |
|---|---|
| Allow | /*.js$ |
| Allow | /*.css$ |
*
| Rule | Path |
|---|---|
| Disallow | /*?utm_* |
| Disallow | /.git/ |
| Disallow | /.git* |
| Disallow | /login/ |
| Disallow | /signup/ |
| Disallow | /?s=* |
| Disallow | /search/ |
| Disallow | /blog/search/* |
| Disallow | /schedules |
| Disallow | /payment/ |
| Disallow | /blog/tag/* |
| Disallow | /compare?* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://rubixe.com/sitemap.xml |
Warnings
- 1 invalid line.
Comments