Log In Sign Up

vocaloid.com
robots.txt

Robots Exclusion Standard data for vocaloid.com

Resource Scan

Scan Details

Site Domain vocaloid.com
Base Domain vocaloid.com
Scan Status Ok
Last Scan2024-05-02T06:27:36+00:00
Next Scan 2024-06-01T06:27:36+00:00

Last Scan

Scanned2024-05-02T06:27:36+00:00
URL https://vocaloid.com/robots.txt
Redirect https://www.vocaloid.com/robots.txt
Redirect Domain www.vocaloid.com
Redirect Base vocaloid.com
Domain IPs 3.113.229.200, 57.180.126.111
Redirect IPs 13.35.18.13, 13.35.18.55, 13.35.18.74, 13.35.18.84, 2600:9000:20c7:3600:1c:2895:ea40:93a1, 2600:9000:20c7:5400:1c:2895:ea40:93a1, 2600:9000:20c7:6400:1c:2895:ea40:93a1, 2600:9000:20c7:7c00:1c:2895:ea40:93a1, 2600:9000:20c7:9000:1c:2895:ea40:93a1, 2600:9000:20c7:b600:1c:2895:ea40:93a1, 2600:9000:20c7:ea00:1c:2895:ea40:93a1, 2600:9000:20c7:f400:1c:2895:ea40:93a1
Response IP 13.35.18.55
Found Yes
Hash 71c477b4b4891765e001aa649c33a40eb643ebfd52867e14bd3046842d98c47f
SimHash a2842b0de450

Groups

baiduspider

Rule Path
Disallow /songs/

baiduimagespider

Rule Path
Disallow /songs/

baidumobaider

Rule Path
Disallow /songs/

*

Rule Path
Disallow /articles/vomas1507
Back to top

Other Records

Field Value
sitemap https://www.vocaloid.com/sitemap-index.xml
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-Agent: *
  • Disallow: /
Back to top