mauiinn.com
robots.txt
Robots Exclusion Standard data for mauiinn.com
Resource Scan
Scan Details
| Site Domain | mauiinn.com |
| Base Domain | mauiinn.com |
| Scan Status | Ok |
| Last Scan | 2024-10-28T12:39:34+00:00 |
| Next Scan | 2024-11-27T12:39:34+00:00 |
Last Scan
| Scanned | 2024-10-28T12:39:34+00:00 |
| URL | http://mauiinn.com/robots.txt |
| Redirect | http://www.mauiinn.com:80/robots.txt |
| Redirect Domain | www.mauiinn.com |
| Redirect Base | mauiinn.com |
| Domain IPs | 34.235.235.52, 52.201.23.5, 52.86.46.114 |
| Redirect IPs | 18.211.163.215, 2600:1f18:2302:f01:cf9a:2ec4:b689:bd9a, 2600:1f18:2302:f02:be21:499:a07:bd09, 34.206.69.239 |
| Response IP | 18.211.163.215 |
| Found | Yes |
| Hash | 642b7e7974b26ec2bd3a0ffb218b2c859939360ca2013d6abe7b84007cc271ff |
| SimHash | d31455d23f09 |
Groups
*
| Rule | Path |
|---|---|
| Disallow |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
blexbot
mj12bot
goodzer
ahrefsbot
spbot
dotbot
dotbot
turnitinbot
seznambot
the knowledge ai
checkmarknetwork
ever accountable
seekportbot
claudebot
mauibot
houzzbot
baiduspider
baiduspider-image
serpstatbot
sogou blog
sogou inst spider
sogou news spider
sogou orion spider
sogou spider2
sogou web spider
uptimebot
yandex
yandexmobilebot
zoominfobot
megaindex.ru
alphaseobot-sa
proximic
amazonbot
petalbot
re-re studio
barkrowler
siteauditbot
awariorssbot
awariosmartbot
bytespider
dataforseobot
ioncrawl
nutch
oai-searchbot
gptbot
chatgpt-user
| Rule | Path |
|---|---|
| Disallow | / |
Warnings
- 1 invalid line.
Comments