vman.dk
robots.txt

Robots Exclusion Standard data for vman.dk

Resource Scan

Scan Details

Site Domain vman.dk
Base Domain vman.dk
Scan Status Ok
Last Scan2024-09-19T19:05:27+00:00
Next Scan 2024-09-26T19:05:27+00:00

Last Scan

Scanned2024-09-19T19:05:27+00:00
URL https://vman.dk/robots.txt
Redirect https://www.virtualmanager.com/robots.txt
Redirect Domain www.virtualmanager.com
Redirect Base virtualmanager.com
Domain IPs 104.21.57.131, 172.67.163.222, 2606:4700:3033::6815:3983, 2606:4700:3035::ac43:a3de
Redirect IPs 104.26.8.241, 104.26.9.241, 172.67.73.158, 2606:4700:20::681a:8f1, 2606:4700:20::681a:9f1, 2606:4700:20::ac43:499e
Response IP 172.67.73.158
Found Yes
Hash 31fe3b884c0d08eb18c23dbd043fe30e8e4f76ca307c03c94c5c03888db9a7ea
SimHash f31d2909e950

Groups

*

Rule Path
Disallow /players
Disallow /*/players
Disallow /*?ref_url=*
Disallow /clubs/*/press
Disallow /forums/user_forums
Disallow /forums/my_*
Disallow /friends
Disallow /you_as_friend
Disallow /player_transfers
Disallow /mail
Disallow /auctions
Disallow /overview
Disallow /logged_js_exceptions
Disallow /team_overview
Disallow /training
Disallow /transactions
Disallow /youth_squad
Disallow /transfer_listings
Disallow /contracts
Disallow /login
Disallow /*/login

mj12bot
imagesiftbot

Rule Path
Disallow /

amazonbot
gptbot
claudebot
claude-web
anthropic-ai

Rule Path
Disallow /players
Disallow /*/players
Disallow /clubs
Disallow /*/clubs
Disallow /*?ref_url=*
Disallow /clubs/*/press
Disallow /forums
Disallow /friends
Disallow /you_as_friend
Disallow /player_transfers
Disallow /mail
Disallow /auctions
Disallow /overview
Disallow /logged_js_exceptions
Disallow /team_overview
Disallow /training
Disallow /transactions
Disallow /youth_squad
Disallow /transfer_listings
Disallow /contracts
Disallow /login
Disallow /*/login

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-Agent: *
  • Disallow: /