Log In Sign Up

cameraderie.org
robots.txt

Robots Exclusion Standard data for cameraderie.org

Resource Scan

Scan Details

Site Domain cameraderie.org
Base Domain cameraderie.org
Scan Status Ok
Last Scan2024-05-29T08:30:40+00:00
Next Scan 2024-06-05T08:30:40+00:00

Last Scan

Scanned2024-05-29T08:30:40+00:00
URL https://cameraderie.org/robots.txt
Domain IPs 104.26.10.14, 104.26.11.14, 172.67.68.131, 2606:4700:20::681a:a0e, 2606:4700:20::681a:b0e, 2606:4700:20::ac43:4483
Response IP 104.26.11.14
Found Yes
Hash 2fb1146641175e7c0ee51b911b5a6ff43bf0977925fb31491427d29b72b03cd9
SimHash 00164bd2cbea

Groups

mediapartners-google

Rule Path
Allow /

googlebot-image

Rule Path
Disallow /styles/

ahrefsbot
baidu
baiduspider
baiduspider-video
baiduspider-image
bytespider
boardreader
boardtracker
cliqzbot
diffbot
dotbot
easouspider
exabot
ichiro
linkdexbot
linkdexbot-mobile
magpie-crawler
meanpathbot
mj12bot
moget
naverbot
omgilibot
petalbot
proximic
rogerbot
semrushbot
semrushbot-sa
sitebot
spbot
trendictionbot
twiceler
urlappendbot
yandex
yeti
youdaobot

Rule Path
Disallow /

googlebot

Rule Path
Allow /js

*

Rule Path
Disallow /admin.php
Disallow /conversations/
Disallow /js/
Allow /
Back to top

Other Records

Field Value
sitemap https://cameraderie.org/sitemap.php
Back to top

Comments

  • robots.txt file for Cameraderie (https://cameraderie.org)
  • SiteMap
  • Twitter
  • User-agent: Twitterbot
  • Ad Partners
  • Disallow our style images from appearing in Google Images
  • Blocked crawlers/bots
  • User-agent: sogou
  • User-agent: sogou spider
  • User-agent: sogou web spider
  • Everybody else
  • User-agent: *
  • Disallow: /account/
  • Disallow: /goto/
  • Disallow: /posts/
  • Disallow: /login/
  • Disallow: /admin.php
  • Disallow: /conversations/
  • Disallow: /js/
  • Allow: /
  • GoogleBot
  • Everybody else
Back to top