by.me
robots.txt
Robots Exclusion Standard data for by.me
Resource Scan
Scan Details
| Site Domain | by.me |
| Base Domain | by.me |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-05-31T01:55:26+00:00 |
| Next Scan | 2024-08-29T01:55:26+00:00 |
Last Successful Scan
| Scanned | 2022-10-15T12:03:27+00:00 |
| URL | http://by.me/robots.txt |
| Redirect | https://home.by.me/robots.txt |
| Redirect Domain | home.by.me |
| Redirect Base | by.me |
| Response IP | 54.228.128.94, 34.248.233.12, 54.154.158.228 |
| Found | Yes |
| Hash | fe6348c3d3d14d9adc15c61c67684cbaeff581a700d477b408a45c3733d285ca |
| SimHash | 6f5d3945e93c |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ajax/ |
| Allow | /ajax/feed |
| Disallow | /mailing/ |
| Disallow | /signup |
| Disallow | /login |
| Disallow | /de/profil/* |
| Disallow | /en/profile/* |
| Disallow | /es/perfile/* |
| Disallow | /fr/profil/* |
| Disallow | /de/mein-konto/private-informationen |
| Disallow | /en/my-account/private-details |
| Disallow | /es/mi-cuenta/informacion-privada |
| Disallow | /fr/mon-compte/informations-personnelles |
| Disallow | /de/meine-Sammlungen |
| Disallow | /en/my-collections |
| Disallow | /es/mis-colecciones |
| Disallow | /fr/mes-collections |
| Disallow | /de/collections/* |
| Disallow | /en/collections/* |
| Disallow | /es/collections/* |
| Disallow | /fr/collections/* |
| Disallow | /de/meine-projekte |
| Disallow | /en/my-projects |
| Disallow | /es/mis-proyectos |
| Disallow | /fr/mes-projets |
| Disallow | /de/planner/try |
| Disallow | /en/planner/try |
| Disallow | /es/planner/try |
| Disallow | /fr/planner/try |
| Disallow | /en/not-supported-browser |
| Disallow | /fr/navigateur-non-pris-en-charge |
| Disallow | /es/navegador-no-compatible |
| Disallow | /de/nicht-unterstutzter-Browser |
| Disallow | /it/inspiration |
Other Records
| Field | Value |
|---|---|
| sitemap | https://home.by.me/sitemap.xml |
Warnings
- 1 invalid line.