theobahotel.com
robots.txt
Robots Exclusion Standard data for theobahotel.com
Resource Scan
Scan Details
| Site Domain | theobahotel.com |
| Base Domain | theobahotel.com |
| Scan Status | Ok |
| Last Scan | 2024-09-22T17:01:43+00:00 |
| Next Scan | 2024-10-22T17:01:43+00:00 |
Last Scan
| Scanned | 2024-09-22T17:01:43+00:00 |
| URL | https://theobahotel.com/robots.txt |
| Domain IPs | 104.21.59.171, 172.67.181.93, 2606:4700:3036::ac43:b55d, 2606:4700:3037::6815:3bab |
| Response IP | 104.21.59.171 |
| Found | Yes |
| Hash | db0c3864fb8cd1771485cf9180a285af19448f93faca7c8298c5db3f83f1d61c |
| SimHash | 6a14d407d533 |
Groups
googlebot
googlebot-video
adsbot-google
googlebot-mobile
googlebot-news
googlebot-image
googlebot-image/1.0
mediapartners-google
slurp
yahoo! slurp
yahoo-mmcrawler
msnbot
twitterbot
yandexbot
yandeximages
yandex
bingbot
applebot
ia_archiver
baiduspider
naverbot
seznambot
teoma
yeti
grapeshot
linklooker
enigmabot
ninjabot
ahrefsbot
duckduckbot
facebookexternalhit
icc-crawler
pinterest
bspider
exabot
exabot-images
ocelli
ichiro
archive.org_bot
heritrix
httrack
jakarta commons-httpclient
jbot
magpierss
mail.ru
mj12bot
nutch
phantom
python-urllib
sogou develop spider
sogou orion spider
sogou spider
sogou web spider
sohu agent
turnitinbot
web core / roots
yandexmetrika
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /resim/* |
| Allow | /resim/upload/* |
| Allow | /resim/upload/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://theobahotel.com/sitemap.asp |
Warnings
- 2 invalid lines.