git.daimler.com
robots.txt

Robots Exclusion Standard data for git.daimler.com

Resource Scan

Scan Details

Site Domain git.daimler.com
Base Domain daimler.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan6/14/2025, 12:45:49 PM
Next Scan 9/12/2025, 12:45:49 PM

Last Successful Scan

Scanned8/17/2023, 5:52:13 PM
URL https://git.daimler.com/robots.txt
Domain IPs 141.113.8.105
Response IP 141.113.8.105
Found Yes
Hash 5d5bef586bb9292ef186589211cfdec8c193a820058f5b93a81a6ca1ca2fc335
SimHash ee260bb11d95

Groups

baidu

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /*/pulse
Disallow /*/tree/
Disallow /gist/
Disallow /*/forks
Disallow /*/stars
Disallow /*/download
Disallow /*/revisions
Disallow /*/issues/new
Disallow /*/issues/search
Disallow /*/commits/
Disallow /*/commits/*?author
Disallow /*/commits/*?path
Disallow /*/branches
Disallow /*/tags
Disallow /*/contributors
Disallow /*/comments
Disallow /*/stargazers
Disallow /*/archive/
Disallow /*/blame/
Disallow /*/watchers
Disallow /*/network
Disallow /*/graphs
Disallow /*/raw/
Disallow /*/compare/
Disallow /*/cache/
Disallow /.git/
Disallow */.git/
Disallow /*.git$
Disallow /search/advanced
Disallow /search
Disallow */search
Disallow /*q%3D
Disallow /*.atom
Disallow /ekansa/Open-Context-Data
Disallow /ekansa/opencontext-*
Disallow */tarball/
Disallow */zipball/
Disallow /*source%3D*
Disallow /*ref_cta%3D*
Disallow /*plan%3D*
Disallow /*return_to%3D*
Disallow /*ref_loc%3D*
Disallow /*setup_organization%3D*
Disallow /*source_repo%3D*
Disallow /*ref_page%3D*
Disallow /*source%3D*
Disallow /*referrer%3D*
Disallow /*report%3D*
Disallow /*author%3D*
Disallow /*since%3D*
Disallow /*until%3D*
Disallow /*commits?author=*
Disallow /*report-abuse?report=*
Disallow /*tab%3D*
Allow /*?tab=achievements&achievement=*
Disallow /account-login
Disallow /Explodingstuff/
Disallow /setup/*

Comments

  • If you would like to crawl GitHub contact us via https://support.github.com?tags=dotcom-robots
  • We also provide an extensive API: https://docs.github.com/enterprise-server@unknown