Log In Sign Up

android.moparisthebest.org
robots.txt

Robots Exclusion Standard data for android.moparisthebest.org

Resource Scan

Scan Details

Site Domain android.moparisthebest.org
Base Domain moparisthebest.org
Scan Status Ok
Last Scan2025-10-24T23:38:19+00:00
Next Scan 2025-11-23T23:38:19+00:00

Last Scan

Scanned2025-10-24T23:38:19+00:00
URL https://android.moparisthebest.org/robots.txt
Domain IPs 78.46.136.28
Response IP 78.46.136.28
Found Yes
Hash 745b5f81c3a30960765561e08fd2b4b0cd2f49f6a1726d915062190af323dd00
SimHash 76555840c1c4

Groups

ahrefsbot
ai2bot
ai2bot-dolma
amazonbot
anthropic-ai
anthropicai
applebot
applebot-extended
awariobot
awariorssbot
awariosmartbot
bytespider
ccbot
chatgpt-user
claudebot
claude-web
cohere-ai
cohere-training-data-crawler
crawlspace
dataforseobot
diffbot
diffbot
duckassistbot
facebookbot
facebookbot
friendlycrawler
googlebot-extended
google-cloudvertexbot
google-extended
googleother
googleother-image
googleother-video
gptbot
ia_archiver
iaskspider/2.0
icc-crawler
imagesiftbot
img2dataset
isscyberriskcrawler
kangaroo bot
meltwater
meta-externalagent
meta-externalfetcher
oai-searchbot
omgili
omgilibot
openai
pangubot
peer39_crawler
perplexitybot
petalbot
petalbot
scrapy
seekr
semrushbot
semrushbot-ocob
semrushbot-swa
sentibot
sidetrade indexer bot
sogou
timpibot
turnitinbot
velenpublicwebcrawler
webzio-extended
youbot
blexbot

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Back to top

Comments

  • combined from:
  • https://robotstxt.com/ai
  • https://github.com/ai-robots-txt/ai.robots.txt/blob/main/robots.txt
  • https://github.com/kurren/ai-bots-crawlers/blob/main/robots.txt
  • on 12-Mar-2025
  • Block any non-specified AI crawlers (e.g., new
  • or unknown bots) from using content for training
  • AI models. This directive is still experimental
  • and may not be supported by all AI crawlers.
Back to top

Warnings

  • `disallowaitraining` is not a known field.
Back to top