autostadium.fi
robots.txt

Robots Exclusion Standard data for autostadium.fi

Resource Scan

Scan Details

Site Domain autostadium.fi
Base Domain autostadium.fi
Scan Status Ok
Last Scan2024-05-25T03:21:53+00:00
Next Scan 2024-06-24T03:21:53+00:00

Last Scan

Scanned2024-05-25T03:21:53+00:00
URL https://autostadium.fi/robots.txt
Domain IPs 5.44.245.39
Response IP 5.44.245.39
Found Yes
Hash 86934a2561455af67f9e061a0b52ba37924b4c43c9d1bbeb24d8a02ede21cce4
SimHash 001bdc63ef09

Groups

aspiegelbot
ahrefsbot
duckduckbot
domaincrawler
dotbot
dotbot
baiduspider
baidu spider
ia_archiver
mauibot
megaindex.ru
megaindex.ru/2.0
megaindex.com
riddler
sentibot
semrushbot
semrushbot-sa
semrush
slurp
mj12bot
blexbot
petalbot
semrushbot
yandex
yandexbot
trendictionbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /threads/*/reply

*

Rule Path
Disallow /whats-new/
Disallow /account/
Disallow /members/
Disallow /attachments/
Disallow /goto/
Disallow /help/
Disallow /posts/
Disallow /login/
Disallow /search/
Disallow /admin.php
Allow /

Other Records

Field Value
sitemap https://www.autostadium.fi/sitemap.php