autostadium.fi
robots.txt
Robots Exclusion Standard data for autostadium.fi
Resource Scan
Scan Details
Site Domain | autostadium.fi |
Base Domain | autostadium.fi |
Scan Status | Ok |
Last Scan | 2024-05-25T03:21:53+00:00 |
Next Scan | 2024-06-24T03:21:53+00:00 |
Last Scan
Scanned | 2024-05-25T03:21:53+00:00 |
URL | https://autostadium.fi/robots.txt |
Domain IPs | 5.44.245.39 |
Response IP | 5.44.245.39 |
Found | Yes |
Hash | 86934a2561455af67f9e061a0b52ba37924b4c43c9d1bbeb24d8a02ede21cce4 |
SimHash | 001bdc63ef09 |
Groups
aspiegelbot
ahrefsbot
duckduckbot
domaincrawler
dotbot
dotbot
baiduspider
baidu spider
ia_archiver
mauibot
megaindex.ru
megaindex.ru/2.0
megaindex.com
riddler
sentibot
semrushbot
semrushbot-sa
semrush
slurp
mj12bot
blexbot
petalbot
semrushbot
yandex
yandexbot
trendictionbot
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /whats-new/ |
Disallow | /account/ |
Disallow | /members/ |
Disallow | /attachments/ |
Disallow | /goto/ |
Disallow | /help/ |
Disallow | /posts/ |
Disallow | /login/ |
Disallow | /search/ |
Disallow | /admin.php |
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://www.autostadium.fi/sitemap.php |