maxroll.gg
robots.txt

Robots Exclusion Standard data for maxroll.gg

Resource Scan

Scan Details

Site Domain maxroll.gg
Base Domain maxroll.gg
Scan Status Ok
Last Scan2025-11-26T03:58:44+00:00
Next Scan 2025-12-03T03:58:44+00:00

Last Scan

Scanned2025-11-26T03:58:44+00:00
URL https://maxroll.gg/robots.txt
Domain IPs 104.18.24.68, 104.18.25.68, 2606:4700::6812:1844, 2606:4700::6812:1944
Response IP 104.18.24.68
Found Yes
Hash 2429a9d901240041a825ba6f6baa61a7d2a2a2584d00c1b894af19c9eebefad5
SimHash f4563351c3b7

Groups

addsearchbot
ai2bot
ai2bot-dolma
ai2bot-deepresearcheval
amazonbot
anchor browser
anthropic-ai
applebot
applebot-extended
atlassian-bot
autorag
awariosmartbot
bigsur.ai
big sur ai
brandwatch
bravebot
bytespider
ccbot
chatglm-spider
chatgpt-user
claude-searchbot
claude-user
claude-web
claudebot
cohere-ai
cohere-training-data-crawler
cotoyogi
datenbank crawler
ddm*
ddm-dcipher*
ddm-dcipher/1.0.7
deepseekbot
devin
diffbot
direqt anomura
duckassistbot
echobot bot
facebookbot
factset_spyderbot
gptbot
httrack
iask
icc-crawler
icc crawler
imagesiftbot
kangaroo bot
klaviyoaibot
kunato
liner bot
linerbot
meta-externalagent
meta-externalfetcher
meta-webindexer
mistral.ai
mistralai-user
netestate imprint crawler
novaact
novellum ai crawl
nutch
oai-searchbot
offline explorer
omgili
pangubot
perplexity-user
perplexitybot
petalbot
qualifiedbot
scrapy
seekrbot
semrushbotswa
semrushbot-ocob
shapbot
timpibot
velen crawler
velenpublicwebcrawler
webzio-extended
wrtn
youbot
zanistabot

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /auth/*
Disallow /404/
Disallow /cdn-cgi/
Disallow /d2/d2-holy-grail/*
Disallow /d2/d2planner/*
Disallow /d3/d3planner/*
Disallow /d4/planner/*
Disallow /lost-ark/la-builder/*
Disallow /last-epoch/planner/*

Other Records

Field Value
sitemap https://maxroll.gg/sitemap.xml
sitemap https://maxroll.gg/news-sitemap.xml

Comments

  • Ziff Davis content is made available for your non-commercial use subject to our
  • Terms of Use here: https://www.ziffdavis.com/terms-of-use
  • Use of any robot, crawler, or other tool to scrape, harvest, extract, or retrieve any content on
  • this website using automated means is prohibited without written permission from Ziff Davis.
  • Prohibited uses include but are not limited to:
  • (1) text and data mining under Art. 4 of the EU Directive on Copyright in the Digital Single
  • Market;
  • (2) development or operation of artificial intelligence or machine learning software or
  • databases, including by training, fine-tuning, embedding, and retrieval-augmented generation;
  • (3) creating data sets containing our content or sharing it with others; and
  • (4) any commercial purposes.
  • Contact licensing@ziffdavis.com for assistance.

Warnings

  • 1 invalid line.