bertoua.info
robots.txt

Robots Exclusion Standard data for bertoua.info

Resource Scan

Scan Details

Site Domain bertoua.info
Base Domain bertoua.info
Scan Status Ok
Last Scan2026-04-07T15:19:34+00:00
Next Scan 2026-04-14T15:19:34+00:00

Last Scan

Scanned2026-04-07T15:19:34+00:00
URL https://bertoua.info/robots.txt
Redirect https://www.bertoua.info/robots.txt
Redirect Domain www.bertoua.info
Redirect Base bertoua.info
Domain IPs 50.30.32.97
Redirect IPs 50.30.32.97
Response IP 50.30.32.97
Found Yes
Hash 70c556d65773840a1c65a5a80d0682586d9e96f2bb3147ad74db7c43f019f487
SimHash 6b5c5b750a83

Groups

*

Rule Path
Disallow /adminfr/
Disallow /loginstart/
Disallow /login2/
Disallow /logout/
Disallow /users/
Disallow /contact/
Disallow /register/
Disallow /downloads/
Disallow /communiques/
Disallow /inc/
Disallow /links/
Disallow /imgyt/
Disallow /newspics/
Disallow /profilespics/
Disallow /images/
Disallow /bildervideo/
Disallow /inc/
Disallow /img/
Disallow /documents/
Disallow /shop/
Disallow /r/
Disallow /menunew/
Disallow /fr/
Disallow /com/
Disallow /profilespics/
Disallow /chnpics/
Disallow /anpics/
Disallow /banner/
Disallow /agendapics/
Disallow /partner/
Disallow /frmproduktepics/
Disallow /galerietmp/
Disallow /fr/
Disallow /frmproduitsgaleriepics/
Disallow /frmservicesgaleriepics/
Disallow /frmservicespics/
Disallow /villes/
Disallow /bildervideo/
Disallow /chngaleriepics/
Disallow /frmpartnerspics/
Disallow /agendadocs/
Disallow /lettresdocs/
Disallow /newsagencypics/
Disallow /frmnewspics/
Disallow /frmprofilespics/
Disallow /frmdocs/
Disallow /frmpics/
Disallow /eproducts/
Disallow /avispics/
Disallow /taxesdocs/
Disallow /avisdocs/
Disallow /taxespics/
Disallow /navdocs/
Disallow /livres/
Disallow /lettrespics/
Disallow /immo/
Disallow /immopics/
Disallow /profilesbilder/
Disallow /compics/
Disallow /products/
Disallow /news2docs/
Disallow /profilesbilder/
Disallow /immopics/
Disallow /videos/
Disallow /frmequippics/
Disallow /audios/
Disallow /logo/
Disallow /agpics/
Disallow /menu/
Disallow /linkspub/
Disallow /actu/
Disallow /cgi-bin/
Allow /index.php
Allow /

Other Records

Field Value
crawl-delay 10

amazonbot
amzn-searchbot
serpstatbot
ahrefsbot
ahrefssiteaudit
baiduspider
blexbot
semrushbot
semrushbot-sa
claudebot
yandexbot
bytespider
mb2345browser
oppo
aspiegelbot
petalbot
ccbot
chatgpt-user
gptbot
omgilibot
diffbot
imagesiftbot
perplexitybot
cohere-ai
timpibot
youbot
mj12bot
dotbot
mail.ru_bot
facebookexternalhit
facebookbot
applebot
applebot-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap /sitemap.xml

Comments

  • Allow all crawlers
  • Disallow directories
  • Disallow badbots
  • Add sitemap at the end