lmgr.bai.org
robots.txt
Robots Exclusion Standard data for lmgr.bai.org
Resource Scan
Scan Details
| Site Domain | lmgr.bai.org |
| Base Domain | bai.org |
| Scan Status | Ok |
| Last Scan | 2024-09-19T11:33:31+00:00 |
| Next Scan | 2024-10-19T11:33:31+00:00 |
Last Scan
| Scanned | 2024-09-19T11:33:31+00:00 |
| URL | https://lmgr.bai.org/robots.txt |
| Domain IPs | 52.154.240.159 |
| Response IP | 52.154.240.159 |
| Found | Yes |
| Hash | ab8d539fc8d7c9cb150b83a6016a156430f60befc52ca4a06087866aaf03923c |
| SimHash | 701a4901c2f4 |
Groups
amazonbot
anthropic-ai
applebot-extended
bytespider
ccbot
chatgpt-user
claudebot
claude-web
cohere-ai
diffbot
facebookbot
facebookexternalhit
friendlycrawler
google-extended
googleother
googleother-image
googleother-video
gptbot
icc-crawler
imagesiftbot
img2dataset
meta-externalagent
oai-searchbot
omgili
omgilibot
perplexitybot
petalbot
scrapy
timpibot
velenpublicwebcrawler
youbot
meta-externalfetcher
applebot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow |