virtualmanager.dk
robots.txt

Robots Exclusion Standard data for virtualmanager.dk

Resource Scan

Scan Details

Site Domain virtualmanager.dk
Base Domain virtualmanager.dk
Scan Status Ok
Last Scan2024-06-16T09:57:37+00:00
Next Scan 2024-06-23T09:57:37+00:00

Last Scan

Scanned2024-06-16T09:57:37+00:00
URL https://virtualmanager.dk/robots.txt
Redirect https://www.virtualmanager.com/robots.txt
Redirect Domain www.virtualmanager.com
Redirect Base virtualmanager.com
Domain IPs 104.21.24.115, 172.67.218.94, 2606:4700:3031::ac43:da5e, 2606:4700:3035::6815:1873
Redirect IPs 104.26.8.241, 104.26.9.241, 172.67.73.158, 2606:4700:20::681a:8f1, 2606:4700:20::681a:9f1, 2606:4700:20::ac43:499e
Response IP 104.26.9.241
Found Yes
Hash fecd3d03b4e599f222fb24309dc73a61cab2279f372091b1c52ec1ca760c031c
SimHash f39d2909e8d0

Groups

*

Rule Path
Disallow /players
Disallow /*/players
Disallow /*?ref_url=*
Disallow /clubs/*/press
Disallow /forums/user_forums
Disallow /forums/my_*
Disallow /friends
Disallow /you_as_friend
Disallow /player_transfers
Disallow /mail
Disallow /auctions
Disallow /overview
Disallow /logged_js_exceptions
Disallow /team_overview
Disallow /training
Disallow /transactions
Disallow /youth_squad
Disallow /transfer_listings
Disallow /contracts
Disallow /login
Disallow /*/login

mj12bot
claudebot
claude-web
imagesiftbot
anthropic-ai

Rule Path
Disallow /

amazonbot
gptbot

Rule Path
Disallow /players
Disallow /*/players
Disallow /clubs
Disallow /*/clubs
Disallow /*?ref_url=*
Disallow /clubs/*/press
Disallow /forums/user_forums
Disallow /forums/my_*
Disallow /friends
Disallow /you_as_friend
Disallow /player_transfers
Disallow /mail
Disallow /auctions
Disallow /overview
Disallow /logged_js_exceptions
Disallow /team_overview
Disallow /training
Disallow /transactions
Disallow /youth_squad
Disallow /transfer_listings
Disallow /contracts
Disallow /login
Disallow /*/login

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-Agent: *
  • Disallow: /