test-m.3u.com
robots.txt

Robots Exclusion Standard data for test-m.3u.com

Resource Scan

Scan Details

Site Domain test-m.3u.com
Base Domain 3u.com
Scan Status Ok
Last Scan2025-06-07T22:29:20+00:00
Next Scan 2025-07-07T22:29:20+00:00

Last Scan

Scanned2025-06-07T22:29:20+00:00
URL https://test-m.3u.com/robots.txt
Domain IPs 8.222.170.207
Response IP 8.222.170.207
Found Yes
Hash 8bc68a444c58a30ac8ad8e540697f251869cc597a4d65407d7a5a641283e33c4
SimHash ec5c59428334

Groups

*

Rule Path
Disallow /

Comments

  • -----------------------------------------------------------------------------
  • 禁止爬虫爬取无效URL,提升网站核心静态资源抓取及索引效率。
  • 无效URLåŒ
  • 等各种无需被SE收录的URL。
  • -----------------------------------------------------------------------------

Warnings

  • 1 invalid line.
  • `含` is not a known field.