Log In Sign Up

geometrygeeks.bike
robots.txt

Robots Exclusion Standard data for geometrygeeks.bike

Resource Scan

Scan Details

Site Domain geometrygeeks.bike
Base Domain geometrygeeks.bike
Scan Status Ok
Last Scan2024-09-21T08:58:37+00:00
Next Scan 2024-09-28T08:58:37+00:00

Last Scan

Scanned2024-09-21T08:58:37+00:00
URL https://geometrygeeks.bike/robots.txt
Domain IPs 2001:4860:4802:32::15, 2001:4860:4802:34::15, 2001:4860:4802:36::15, 2001:4860:4802:38::15, 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Response IP 216.239.34.21
Found Yes
Hash 8280dd052629e13d5436c4bc2b7aaa4ea85bfced86823bb8982ecc3ff3be3fff
SimHash 9c10c780e743

Groups

petalbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

*

Rule Path
Allow /

*

Rule Path
Disallow /add-bike
Disallow /add-image-to-bike/*
Disallow /edit-bike
Disallow /edit-bike/*
Disallow /edit-geometry
Disallow /edit-geometry/*
Disallow /login
Disallow /bike/*/flag
Disallow /fitter/*/flag
Disallow /*/?prove-human=human
Back to top

Comments

  • Petal bot disallowed for (crappy) url handling, resulting in 404s.
  • Blex bot disallowed for attempting to access /catalog?car=GMC {GMC, Ford, Fiat ... }
Back to top