femina.ch
robots.txt

Robots Exclusion Standard data for femina.ch

Resource Scan

Scan Details

Site Domain femina.ch
Base Domain femina.ch
Scan Status Ok
Last Scan2024-05-24T12:45:04+00:00
Next Scan 2024-05-31T12:45:04+00:00

Last Scan

Scanned2024-05-24T12:45:04+00:00
URL https://femina.ch/robots.txt
Redirect https://www.femina.ch/robots.txt
Redirect Domain www.femina.ch
Redirect Base femina.ch
Domain IPs 185.90.37.7
Redirect IPs 185.90.37.7
Response IP 185.90.37.7
Found Yes
Hash 7ec0bacdb0bf6d16b00c46571693a1e9fa643f35857fe7e2dd9cf40917430c42
SimHash c0ce42ba4e15

Groups

psbot
yandex
petalbot
mail.ru_bot
megaindex
baiduspider
yisouspider
bytespider
sogou web spider
sogou inst spider
proximic
admantx
seekport crawler
semrushbot
blexbot
mj12bot
dotbot
bubing
omgili
exabot
blp_bbot/0.1
blp_bbot
sentibot
meltawer
digimind
knowings
sindup
cision
talkwater
turnitinbot
converacrawler
jetbot
newsnow
kbcrawl
amisoftware
newzbin
ask n read
qwam content intelligence
zite
flipboard
youmag
synthesio
trendybuzz
spotter
scoop.it
trendybuzz
linkfluence
spotter
augure
corporama
grub-client
ia_archiver
ia_archiver-web.archive.org
k2spider
libwww
wget
adequat
adequat-systems
auramundi
coexel
ellisphere
leadbox
mention
moreover
mytwip
newsnow
newzbin
opinion-tracker
proxem
score3
trendeo
vecteurplus
verticalsearch
vsw
winello
fetch
infoseek
msiecrawler
offline explorer
sitecheck.internetseer.com
teleport
teleportpro
webcopier
webstripper
zealbot
asknread.com
ellisphere
spotter
omgilibot

Rule Path
Disallow /

*

Rule Path
Allow /

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /version.txt
Disallow /admin/
Disallow /cmsadm/
Disallow /recherche/
Disallow /api/
Disallow /comment/reply/
Disallow /filter/tips/
Disallow /node/add/
Disallow /search/
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /user/logout/
Disallow /index.php?p=admin%2Finstall
Disallow /?q=admin%2F
Disallow /?q=comment%2Freply%2F
Disallow /?q=filter%2Ftips%2F
Disallow /?q=node%2Fadd%2F
Disallow /?q=search%2F
Disallow /?q=user%2Fpassword%2F
Disallow /?q=user%2Fregister%2F
Disallow /?q=user%2Flogin%2F
Disallow /?q=user%2Flogout%2F

Other Records

Field Value
sitemap https://www.femina.ch/sitemap.xml

Comments

  • robots.txt
  • Disallow commercial bots to prevent ad fraud, see DISC-2117
  • Allow crawling for other bots
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)

Warnings

  • 3 invalid lines.