internetmedicin.se
robots.txt

Robots Exclusion Standard data for internetmedicin.se

Resource Scan

Scan Details

Site Domain internetmedicin.se
Base Domain internetmedicin.se
Scan Status Ok
Last Scan2024-09-21T16:53:03+00:00
Next Scan 2024-09-28T16:53:03+00:00

Last Scan

Scanned2024-09-21T16:53:03+00:00
URL https://internetmedicin.se/robots.txt
Redirect https://www.internetmedicin.se/robots.txt
Redirect Domain www.internetmedicin.se
Redirect Base internetmedicin.se
Domain IPs 2a09:8280:1::fcc9, 37.16.18.201
Redirect IPs 2a09:8280:1::fcc9, 37.16.18.201
Response IP 37.16.18.201
Found Yes
Hash 8c27b1985822ecee9b9d1ee3ad557f02852669f2816e8b1860c0f81f8d67feaa
SimHash 2961528154f5

Groups

applebot
applenewsbot
bingbot
bingpreview
microsoftpreview
duckduckbot
duckduckgo-favicons-bot
googlebot
googlebot-image
googlebot-mobile
googlebot-news
googlebot-video
twitterbot
mediapartners-google
adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
adidxbot
facebookcatalog
facebookexternalhit
facebookbot
msnbot
msnbot-media
pinterest
whatsapp
discordbot
linkedinbot
telegrambot

Rule Path
Disallow

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.internetmedicin.se/sitemap.xml

Comments

  • crawling rule(s) for above bots
  • disallow all other bots