cairo.de
robots.txt

Robots Exclusion Standard data for cairo.de

Resource Scan

Scan Details

Site Domain cairo.de
Base Domain cairo.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-09-08T17:10:38+00:00
Next Scan 2025-12-07T17:10:38+00:00

Last Successful Scan

Scanned2022-10-30T01:03:13+00:00
URL https://cairo.de/robots.txt
Redirect https://www.cairo.de/robots.txt
Redirect Domain www.cairo.de
Redirect Base cairo.de
Response IP 77.75.250.79
Found Yes
Hash 28e75b4e4c7c7c3bf0999d8bd1dc42f1f2e7e294c8d46a49bb0a5b7a09272be5
SimHash ad128d405bfc

Groups

*

Rule Path
Disallow /admin/
Disallow /Core/
Disallow /tmp/
Disallow /views/
Disallow /Setup/
Disallow /log/
Disallow /newsletter/
Disallow /en/newsletter/
Disallow /index.php?cl=newsletter
Disallow /AGB/
Disallow /en/Terms-and-Conditions/
Disallow /warenkorb/
Disallow /en/cart/
Disallow /index.php?cl=basket
Disallow /mein-merkzettel/
Disallow /en/my-wishlist/
Disallow /index.php?cl=account_noticelist
Disallow /mein-wunschzettel/
Disallow /en/my-gift-registry/
Disallow /index.php?cl=account_wishlist
Disallow /konto-eroeffnen/
Disallow /en/open-account/
Disallow /index.php?cl=register
Disallow /passwort-vergessen/
Disallow /en/forgot-password/
Disallow /index.php?cl=forgotpwd
Disallow /index.php?cl=moredetails
Disallow /index.php?cl=review
Disallow /EXCEPTION_LOG.txt
Disallow /*?cl=newsletter
Disallow /*%26cl%3Dnewsletter
Disallow /*?cl=basket
Disallow /*%26cl%3Dbasket
Disallow /*?cl=account_noticelist
Disallow /*%26cl%3Daccount_noticelist
Disallow /*?cl=account_wishlist
Disallow /*%26cl%3Daccount_wishlist
Disallow /*?cl=register
Disallow /*%26cl%3Dregister
Disallow /*?cl=forgotpwd
Disallow /*%26cl%3Dforgotpwd
Disallow /*?cl=moredetails
Disallow /*%26cl%3Dmoredetails
Disallow /*?cl=review
Disallow /*%26cl%3Dreview
Disallow /*%26fnc%3Dtobasket
Disallow /*%26fnc%3Dtocomparelist
Disallow /*%26addcompare%3D
Disallow /*%26fnc%3Dexecutefilter
Disallow /*/sid/
Disallow /*?sid=
Disallow /*%26sid%3D
Disallow /*?cur=
Disallow /*%26cur
Disallow /*?force_sid=
Disallow /*%26force_sid%3D

Comments

  • Disallow: /mein-konto/
  • Disallow: /en/my-account/
  • Disallow: /index.php?cl=account
  • Disallow: /index.php?cl=search
  • wildcards at the end, because of some crawlers see it as errors
  • Disallow: /*?cl=account
  • Disallow: /*&cl=account
  • Disallow: /*?cl=search
  • Disallow: /*&cl=search