eco-sun.jp
robots.txt
Robots Exclusion Standard data for eco-sun.jp
Resource Scan
Scan Details
| Site Domain | eco-sun.jp |
| Base Domain | eco-sun.jp |
| Scan Status | Ok |
| Last Scan | 2024-11-13T17:50:24+00:00 |
| Next Scan | 2024-12-13T17:50:24+00:00 |
Last Scan
| Scanned | 2024-11-13T17:50:24+00:00 |
| URL | https://eco-sun.jp/robots.txt |
| Domain IPs | 157.7.107.84 |
| Response IP | 157.7.107.84 |
| Found | Yes |
| Hash | 80cfe230dfd2200b1285e46cabc1eeb051657a2dded1a987549fe7de68f0c858 |
| SimHash | 1b5c63d3c611 |
Groups
*
| Rule | Path |
|---|---|
| Disallow |
baiduspider
baiduspider-ads
baiduspider-cpro
baiduspider-favo
baiduspider-image
baiduspider-news
baiduspider-video
yeti
daum
yandex
yandexbot
mail.ru_bot
mappy
seekport
mojeek
exabot
qwantify
netestate
seznambot
mappy
feedly
cliqzbot
pocketimagecache
startmebot
qqbrowser
proximic
blogmurabot
semrushbot
ahrefsbot
blexbot
mj12bot
smtbot
barkrowler
blexbot
sistrix crawler
woorankreview
proximic
ccbot
rogerbot
yasserg/crawler4j
go-resty/resty
python-requests
tomnomnom/meg
python-urllib/2.7
go-http-client/1.1
curl/7.58.0
vert.x-webclient/3.8.4
| Rule | Path |
|---|---|
| Disallow |
googlebot-news
googlebot-video
google favicon
feedfetcher-google
google-read-aloud
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | |
| Allow | / |
| Allow | /img |
| Allow | /image |
megalodon
ia_archiver
rogerbot
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /.htaccess |
| Disallow | /.htpasswd |
| Disallow | /bk/ |
| Disallow | /x/ |
| Disallow | /cgi-bin/ |
| Disallow | /logs/ |
| Disallow | /error_page/ |
| Disallow | /common/ |
| Disallow | /google6a10f8eee2eeb7a5.html |
| Disallow | /googlebd80130d5677692a.html |
| Disallow | /favicon.ico |
| Disallow | /eco-sunJP.txt |
| Allow | /index.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://eco-sun.jp/sitemap.xml |
Warnings
- 3 invalid lines.
Comments