assets.gitee.com
robots.txt

Robots Exclusion Standard data for assets.gitee.com

Resource Scan

Scan Details

Site Domain assets.gitee.com
Base Domain gitee.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-05-26T02:08:27+00:00
Next Scan 2025-06-25T02:08:27+00:00

Last Successful Scan

Scanned2025-04-20T01:03:46+00:00
URL https://assets.gitee.com/robots.txt
Domain IPs 2607:a400:2:b::4, 2a0d:5300:10::2, 2a0d:5300:10::3, 69.28.62.188
Response IP 129.227.137.253
Found Yes
Hash e9f085dfb2d3e2a6743818f3df229d680555bbabcd93e145d945f3cc5815608c
SimHash 698c4470ca93

Groups

*

Rule Path
Disallow /admin/
Disallow /api/v*
Disallow /*/*/commit/*
Disallow /*/*/commits/*
Disallow /*/*/compare/*
Disallow /*/*/contributors
Disallow /*/*/graph/*
Disallow /*/*/tree/*
Disallow /*/*/blame/*
Disallow /*/*/raw/*

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://gitee.com/sitemaps/sitemap.xml.gz

Comments

  • BEGIN FILE
  • allow-all
  • END FILE