moegamer.net
robots.txt
Robots Exclusion Standard data for moegamer.net
Resource Scan
Scan Details
Site Domain | moegamer.net |
Base Domain | moegamer.net |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-08-27T11:01:41+00:00 |
Next Scan | 2025-09-26T11:01:41+00:00 |
Last Successful Scan
Scanned | 2025-07-29T10:58:35+00:00 |
URL | https://moegamer.net/robots.txt |
Domain IPs | 185.221.63.72 |
Response IP | 185.221.63.72 |
Found | Yes |
Hash | d2f3b6e3a84c65a0ba16f2e4db2b42393e59633932cf3f5ca01ee40c249b9b94 |
SimHash | 7a1608818045 |
Groups
ai2bot
ai2bot-dolma
aihitbot
amazonbot
applebot-extended
anthropic-ai
bytespider
ccbot
chatgpt-user
claudebot
claude-user
claude-searchbot
cohere-ai
cohere-training-data-crawler
cotoyogi
crawlspace
diffbot
facebookbot
factset_spyderbot
firecrawlagent
friendlycrawler
gptbot
google-extended
imagesiftbot
kangaroo bot
meta-externalagent
meta-externalfetcher
oai-searchbot
omgili
omgilibot
pangubot
petalbot
perplexitybot
perplexity‑user
scrapy
semrushbot
semrushbot-ocob
semrushbot-ft
sentibot
sentibot
timpibot
turnitinbot
youbot
webzio
webzio-extended
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow |
Other Records
Field | Value |
---|---|
sitemap | https://moegamer.net/sitemap.xml |
sitemap | https://moegamer.net/news-sitemap.xml |
sitemap | https://moegamer.net/sitemap_index.xml |
Comments