Log In Sign Up

vdg.jp
robots.txt

Robots Exclusion Standard data for vdg.jp

Resource Scan

Scan Details

Site Domain vdg.jp
Base Domain vdg.jp
Scan Status Ok
Last Scan2026-01-09T00:45:59+00:00
Next Scan 2026-02-08T00:45:59+00:00

Last Scan

Scanned2026-01-09T00:45:59+00:00
URL https://vdg.jp/robots.txt
Domain IPs 211.133.131.100
Response IP 211.133.131.100
Found Yes
Hash 28a399a88a1c1d715f15296b50e7acc7045ef38f0b68d2acd75fca5f2d986b2a
SimHash f8949713cbf5

Groups

*

Rule Path
Allow /business/
Disallow /*?
Disallow /sy
Disallow /us
Disallow /me

twitterbot

Rule Path
Allow /business/
Disallow /*?
Disallow /sy
Disallow /us
Allow /media/*.jpg$
Disallow /me
Back to top

Comments

  • Twitter somehow uses their "bot" to make a "card" and thumbnail access have to be allowed
  • NOTE: "Allow" and "Disallow" above are conflicting and the result is "undefined" according to Google.
  • As far as we tested, Twitter seems to take this as we intended.
Back to top