finet.se
robots.txt
Robots Exclusion Standard data for finet.se
Resource Scan
Scan Details
| Site Domain | finet.se |
| Base Domain | finet.se |
| Scan Status | Ok |
| Last Scan | 2024-11-05T00:33:52+00:00 |
| Next Scan | 2024-11-19T00:33:52+00:00 |
Last Scan
| Scanned | 2024-11-05T00:33:52+00:00 |
| URL | https://finet.se/robots.txt |
| Domain IPs | 94.247.170.170 |
| Response IP | 94.247.170.170 |
| Found | Yes |
| Hash | 3c4a62475eb40d69bc3297b07476a9e40eec71a6824ed3faa78276328f578d34 |
| SimHash | 2816c602409b |
Groups
adsbot-google
googlebot
applebot
bingbot
msnbot
slurp
googlebot-image
baiduspider
seznambot
teoma
yandex
yeti
msnbot-media
googlebot-news
googlebot-video
googlebot-mobile
mediapartners-google
adsbot-google
duckduckbot
daumoa
orangebot
orangebot-collector
stackrambler
twitterbot/1.0
mail.ru_bot
naverbot
vebidoobot
mj12bot
sogou
rogerbot
deepcrawl
bytespider
cincobot
| Rule | Path |
|---|---|
| Disallow | /admin |
| Disallow | /member |
| Disallow | /bilder |
| Disallow | /u |
| Disallow | /atlas/ajax |
| Disallow | /atlas/api |
| Disallow | /atlas/banners |
| Disallow | /atlas/db |
| Disallow | /atlas/gdpr |
| Disallow | /atlas/include |
| Disallow | /atlas/interactive |
| Disallow | /atlas/media |
| Disallow | /atlas/pdf |
| Disallow | /atlas/plain |
| Disallow | /atlas/popup |
| Disallow | /atlas/rss |
| Disallow | /atlas/support |
| Disallow | /atlas/upload |
| Disallow | *.pdf$ |
| Disallow | /serviceguide/index/consumers/contact |
*
| Rule | Path |
|---|---|
| Disallow | /*start%3D* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://finet.se/atlas/sitemap.php |
Warnings
- 1 invalid line.