grimper.com
robots.txt

Robots Exclusion Standard data for grimper.com

Resource Scan

Scan Details

Site Domain grimper.com
Base Domain grimper.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-07T13:01:29+00:00
Next Scan 2024-05-14T13:01:29+00:00

Last Successful Scan

Scanned2024-04-29T13:01:05+00:00
URL https://grimper.com/robots.txt
Redirect https://www.grimper.com/robots.txt
Redirect Domain www.grimper.com
Redirect Base grimper.com
Domain IPs 104.21.1.61, 172.67.128.181, 2606:4700:3035::6815:13d, 2606:4700:3036::ac43:80b5
Redirect IPs 104.21.1.61, 172.67.128.181, 2606:4700:3035::6815:13d, 2606:4700:3036::ac43:80b5
Response IP 172.67.128.181
Found Yes
Hash 447cdb669c8503b99760bb9ca1190bbea230b5232c0f94f8359745075b532bfb
SimHash 6d792e71a7d5

Groups

*

Rule Path
Disallow /admin/
Disallow /widget/
Disallow /xwidget/
Disallow *sort%3D*
Disallow *resultat-recherche*
Disallow *resultats-recherche*
Disallow /resultats-recherche
Disallow /chausson-escalade-resultats-recherche
Disallow /abonnement
Disallow /snowleader
Disallow /achat-ski
Disallow /freeride-attitude
Disallow /glisshop
Disallow /montagne-nature-style
Disallow /montaz
Disallow /reve-cime
Disallow /ridealer
Disallow /riderstreet
Disallow /ski-clinic
Disallow /speck-sport
Disallow /expe
Disallow /maintenance
Disallow /resultats-recherche-equipement-escalade
Disallow /hardloop
Disallow /millet
Disallow /alpiniste-fr
Disallow /site-escalade-regions
Disallow /partenaire-alpinstore
Disallow /partenaire-chullanka
Disallow /partenaire-ekosport
Disallow /app-store
Disallow /partenaire-au-vieux-campeur

nutch

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.grimper.com/sitemap.xml

Comments

  • User rules