bigbike-magazine.com
robots.txt
Robots Exclusion Standard data for bigbike-magazine.com
Resource Scan
Scan Details
Site Domain | bigbike-magazine.com |
Base Domain | bigbike-magazine.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-06T05:46:15+00:00 |
Next Scan | 2024-05-13T05:46:15+00:00 |
Last Successful Scan
Scanned | 2024-04-27T23:51:24+00:00 |
URL | https://bigbike-magazine.com/robots.txt |
Redirect | https://www.bigbike-magazine.com/robots.txt |
Redirect Domain | www.bigbike-magazine.com |
Redirect Base | bigbike-magazine.com |
Domain IPs | 104.21.93.189, 172.67.214.3, 2606:4700:3031::6815:5dbd, 2606:4700:3035::ac43:d603 |
Redirect IPs | 104.21.93.189, 172.67.214.3, 2606:4700:3031::6815:5dbd, 2606:4700:3035::ac43:d603 |
Response IP | 104.21.93.189 |
Found | Yes |
Hash | 58e8be90083f1232d7a1e57d8dcc1759ab780abdf2af9384a0e41757b1c204f0 |
SimHash | cc837bc58d47 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /widget/ |
Disallow | /xwidget/ |
Disallow | *sort%3D* |
Disallow | *resultat-recherche* |
Disallow | *resultats-recherche* |
Disallow | /contact |
Disallow | /mentions-legales |
Disallow | /resultats-recherche |
Disallow | /vtt-resultat-recherche |
Disallow | /partenaire-alltricks |
Disallow | /partenaire-worden |
Disallow | /partenaire-precision-ski |
Disallow | /partenaire-montagne-vacances |
Disallow | /partenaire-just-ebike |
Disallow | /partenaire-barooders |
Disallow | /guide-peripheriques |
Disallow | /gammes-peripheriques |
Disallow | /marques-peripheriques |
Disallow | /types-peripheriques |
Disallow | /resultats-recherche-2 |
Disallow | /comparateur-peripheriques |
Disallow | /suspensions-vtt-resultats-recherche |
Disallow | /tests-peripheriques |
Disallow | /guide-equipement-pilote |
Disallow | /comparateur-equipement-pilote |
Disallow | /gammes-equipement-pilote |
Disallow | /marques-equipement-pilote |
Disallow | /resultats-recherche-4 |
Disallow | /tests-equipement-pilote |
Disallow | /types-equipement-pilote |
Disallow | /pneus-vtt-resultats-recherche |
Disallow | /roues-vtt-resultats-recherche |
Disallow | /maintenance |
Disallow | /app-store |
Other Records
Field | Value |
---|---|
sitemap | https://www.bigbike-magazine.com/sitemap.xml |
Comments