Log In Sign Up

vetshankar.com
robots.txt

Robots Exclusion Standard data for vetshankar.com

Resource Scan

Scan Details

Site Domain vetshankar.com
Base Domain vetshankar.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-18T18:24:35+00:00
Next Scan 2026-01-16T18:24:35+00:00

Last Successful Scan

Scanned2025-06-20T22:56:43+00:00
URL https://www.vetshankar.com/robots.txt
Domain IPs 104.21.75.43, 172.67.213.82, 2606:4700:3032::ac43:d552, 2606:4700:3035::6815:4b2b
Response IP 104.21.75.43
Found Yes
Hash 9c0f6e647a2fef0a618f61bf5b983a421a5916d0f4ed891895a804769aa5a57f
SimHash a905c0e686b1

Groups

*

Rule Path
Allow /
Disallow /*refer_code%3D
Disallow /*?rc=
Disallow /*%26rc%3D
Back to top

Other Records

Field Value
sitemap https://www.coinex.com/sitemap-ar.xml
sitemap https://www.coinex.com/sitemap-de.xml
sitemap https://www.coinex.com/sitemap-en.xml
sitemap https://www.coinex.com/sitemap-es.xml
sitemap https://www.coinex.com/sitemap-fa.xml
sitemap https://www.coinex.com/sitemap-fr.xml
sitemap https://www.coinex.com/sitemap-id.xml
sitemap https://www.coinex.com/sitemap-ja.xml
sitemap https://www.coinex.com/sitemap-ko.xml
sitemap https://www.coinex.com/sitemap-pt.xml
sitemap https://www.coinex.com/sitemap-ru.xml
sitemap https://www.coinex.com/sitemap-th.xml
sitemap https://www.coinex.com/sitemap-tr.xml
sitemap https://www.coinex.com/sitemap-vi.xml
sitemap https://www.coinex.com/sitemap-zh.xml
sitemap https://www.coinex.com/sitemap-zh-hans.xml
Back to top

Comments

  • 用于爬虫概括项目的关键词和引导到二级页面的配置
  • 映射至更目录访问
  • 例如https://xxx.com/robots.txt
  • 配置内容根据推广运营需要
  • 参考币安的
  • The Global Cryptocurrency Exchange
Back to top

Warnings

  • `host` is not a known field.
Back to top