moegamer.net
robots.txt

Robots Exclusion Standard data for moegamer.net

Resource Scan

Scan Details

Site Domain moegamer.net
Base Domain moegamer.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-27T11:01:41+00:00
Next Scan 2025-09-26T11:01:41+00:00

Last Successful Scan

Scanned2025-07-29T10:58:35+00:00
URL https://moegamer.net/robots.txt
Domain IPs 185.221.63.72
Response IP 185.221.63.72
Found Yes
Hash d2f3b6e3a84c65a0ba16f2e4db2b42393e59633932cf3f5ca01ee40c249b9b94
SimHash 7a1608818045

Groups

ai2bot
ai2bot-dolma
aihitbot
amazonbot
applebot-extended
anthropic-ai
bytespider
ccbot
chatgpt-user
claudebot
claude-user
claude-searchbot
cohere-ai
cohere-training-data-crawler
cotoyogi
crawlspace
diffbot
facebookbot
factset_spyderbot
firecrawlagent
friendlycrawler
gptbot
google-extended
imagesiftbot
kangaroo bot
meta-externalagent
meta-externalfetcher
oai-searchbot
omgili
omgilibot
pangubot
petalbot
perplexitybot
perplexity‑user
scrapy
semrushbot
semrushbot-ocob
semrushbot-ft
sentibot
sentibot
timpibot
turnitinbot
youbot
webzio
webzio-extended

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://moegamer.net/sitemap.xml
sitemap https://moegamer.net/news-sitemap.xml
sitemap https://moegamer.net/sitemap_index.xml

Comments

  • Block AI Crawlers - Built-In Rules
  • End Block AI Crawlers - Built-In Rules
  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK