gemigfiber.nu
robots.txt

Robots Exclusion Standard data for gemigfiber.nu

Resource Scan

Scan Details

Site Domain gemigfiber.nu
Base Domain gemigfiber.nu
Scan Status Ok
Last Scan2024-11-10T09:03:55+00:00
Next Scan 2024-11-24T09:03:55+00:00

Last Scan

Scanned2024-11-10T09:03:55+00:00
URL https://gemigfiber.nu/robots.txt
Response IP 94.247.170.170
Found Yes
Hash 14631646452e94d58bbb9cce66a7cfdbf37b4fe1fe1d1acc1cbe607708cb6660
SimHash 28164602409b

Groups

adsbot-google
googlebot
applebot
bingbot
msnbot
slurp
googlebot-image
baiduspider
seznambot
teoma
yandex
yeti
msnbot-media
googlebot-news
googlebot-video
googlebot-mobile
mediapartners-google
adsbot-google
duckduckbot
daumoa
orangebot
orangebot-collector
stackrambler
twitterbot/1.0
mail.ru_bot
naverbot
vebidoobot
mj12bot
sogou
rogerbot
deepcrawl
bytespider
cincobot

Rule Path
Disallow /admin
Disallow /member
Disallow /bilder
Disallow /u
Disallow /atlas/ajax
Disallow /atlas/api
Disallow /atlas/banners
Disallow /atlas/db
Disallow /atlas/gdpr
Disallow /atlas/include
Disallow /atlas/interactive
Disallow /atlas/media
Disallow /atlas/pdf
Disallow /atlas/plain
Disallow /atlas/popup
Disallow /atlas/rss
Disallow /atlas/support
Disallow /atlas/upload
Disallow *.pdf$
Disallow /serviceguide/index/consumers/contact

*

Rule Path
Disallow /*start%3D*

Other Records

Field Value
sitemap https://gemigfiber.nu/atlas/sitemap.php

Warnings

  • 1 invalid line.