bertelshofer.com
robots.txt

Robots Exclusion Standard data for bertelshofer.com

Resource Scan

Scan Details

Site Domain bertelshofer.com
Base Domain bertelshofer.com
Scan Status Ok
Last Scan2025-05-18T08:45:11+00:00
Next Scan 2025-06-17T08:45:11+00:00

Last Scan

Scanned2025-05-18T08:45:11+00:00
URL https://bertelshofer.com/robots.txt
Domain IPs 159.69.77.193, 159.69.96.138, 195.201.179.93
Response IP 195.201.179.93
Found Yes
Hash 6081d6c7d3aeeacbf826efe9f4b8f147d2047420ef492fd01b282a9c3a00aaee
SimHash 28100d4642fc

Groups

*

Rule Path
Disallow /admin/
Disallow /core/
Disallow /tmp/
Disallow /views/
Disallow /setup/
Disallow /log/
Disallow /dokumente/
Disallow /out/downloads/
Disallow /index.php?cl=newsletter
Disallow /index.php?cl=basket
Disallow /index.php?cl=account
Disallow /index.php?cl=account_noticelist
Disallow /index.php?cl=account_wishlist
Disallow /index.php?cl=register
Disallow /index.php?cl=forgotpwd
Disallow /index.php?cl=moredetails
Disallow /index.php?cl=review
Disallow /EXCEPTION_LOG.txt
Disallow /*?cl=newsletter
Disallow /*%26cl%3Dnewsletter
Disallow /*?cl=basket
Disallow /*%26cl%3Dbasket
Disallow /*?cl=account
Disallow /*%26cl%3Daccount
Disallow /*?cl=account_noticelist
Disallow /*%26cl%3Daccount_noticelist
Disallow /*?cl=account_wishlist
Disallow /*%26cl%3Daccount_wishlist
Disallow /*?cl=register
Disallow /*%26cl%3Dregister
Disallow /*?cl=forgotpwd
Disallow /*%26cl%3Dforgotpwd
Disallow /*?cl=moredetails
Disallow /*%26cl%3Dmoredetails
Disallow /*?cl=review
Disallow /*%26cl%3Dreview
Disallow /*?cl=search
Disallow /*%26cl%3Dsearch
Disallow /*%26fnc%3Dtobasket
Disallow /*%26fnc%3Dtocomparelist
Disallow /*%26addcompare%3D
Disallow /*/sid/
Disallow /*?sid=
Disallow /*%26sid%3D
Disallow /*?cur=
Disallow /*%26cur

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.bertelshofer.com/export/sitemap.xml

Comments

  • XML Sitemap
  • wildcards at the end, because of some crawlers see it as errors