dethleffsclub.se
robots.txt
Robots Exclusion Standard data for dethleffsclub.se
Resource Scan
Scan Details
| Site Domain | dethleffsclub.se |
| Base Domain | dethleffsclub.se |
| Scan Status | Ok |
| Last Scan | 2024-11-16T20:12:35+00:00 |
| Next Scan | 2024-11-30T20:12:35+00:00 |
Last Scan
| Scanned | 2024-11-16T20:12:35+00:00 |
| URL | https://dethleffsclub.se/robots.txt |
| Domain IPs | 94.247.170.170 |
| Response IP | 94.247.170.170 |
| Found | Yes |
| Hash | 4e413a2dad14d7c82c944541645a9e3440e19c65a0509b243a5af02f3da3b3c1 |
| SimHash | 28164602409b |
Groups
adsbot-google
googlebot
applebot
bingbot
msnbot
slurp
googlebot-image
baiduspider
seznambot
teoma
yandex
yeti
msnbot-media
googlebot-news
googlebot-video
googlebot-mobile
mediapartners-google
adsbot-google
duckduckbot
daumoa
orangebot
orangebot-collector
stackrambler
twitterbot/1.0
mail.ru_bot
naverbot
vebidoobot
mj12bot
sogou
rogerbot
deepcrawl
bytespider
cincobot
| Rule | Path |
|---|---|
| Disallow | /admin |
| Disallow | /member |
| Disallow | /bilder |
| Disallow | /u |
| Disallow | /atlas/ajax |
| Disallow | /atlas/api |
| Disallow | /atlas/banners |
| Disallow | /atlas/db |
| Disallow | /atlas/gdpr |
| Disallow | /atlas/include |
| Disallow | /atlas/interactive |
| Disallow | /atlas/media |
| Disallow | /atlas/pdf |
| Disallow | /atlas/plain |
| Disallow | /atlas/popup |
| Disallow | /atlas/rss |
| Disallow | /atlas/support |
| Disallow | /atlas/upload |
| Disallow | *.pdf$ |
| Disallow | /serviceguide/index/consumers/contact |
*
| Rule | Path |
|---|---|
| Disallow | /*start%3D* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://dethleffsclub.se/atlas/sitemap.php |
Warnings
- 1 invalid line.