Log In Sign Up

camerounlink.com
robots.txt

Robots Exclusion Standard data for camerounlink.com

Resource Scan

Scan Details

Site Domain camerounlink.com
Base Domain camerounlink.com
Scan Status Ok
Last Scan2024-08-27T08:19:10+00:00
Next Scan 2024-09-26T08:19:10+00:00

Last Scan

Scanned2024-08-27T08:19:10+00:00
URL https://camerounlink.com/robots.txt
Domain IPs 62.138.6.137
Response IP 62.138.6.137
Found Yes
Hash 0038bdf5dc9b12acd47275ede35f983f1d2e3c1129e36e7dcc1d8f10f3375e22
SimHash 48056185c6b1

Groups

*

Rule Path
Disallow /

applebot

Rule Path
Disallow /forbid-apple/

msnbot-media
yandex
moget
ichiro
naverbot
yeti
baiduspider
baiduspider-video
baiduspider-image
sogou spider
youdaobot
urlmetriken
petalbot

Rule Path
Disallow /

googlebot
googlebot-image
mediapartners-google
adsbot-google-mobile
googlebot-news
google-video
bingbot
adidxbot
bingpreview

Rule Path
Disallow

*

Rule Path
Disallow /admin/
Disallow /adminfr/
Disallow /bo1/
Disallow /bo2/
Disallow /languages/
Disallow /block/
Disallow /tmp/
Disallow /login/
Disallow /logout/
Disallow /user/
Disallow /contact/
Disallow /register/
Disallow /login2/
Disallow /pdf/
Disallow /multiout/
Disallow /comout/
Allow /ads.txt
Back to top

Other Records

Field Value
sitemap https://www.camerounlink.com/sitemap
Back to top

Comments

  • disallow all
  • Disallow crawler
  • but allow only important bots
  • User-agent: msnbot
  • User-agent: msnbot-media
  • User-agent: Slurp
  • User-agent: Yahoo-Blogs
  • User-agent: Yahoo-MMCrawler
  • Directories
  • Files
  • Disallow: /CHANGELOG.txt
  • Disallow: /cron.php
  • Disallow: /INSTALL.mysql.txt
  • Disallow: /update.php
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • Disallow: /?q=admin/
  • Disallow: /?q=comment/reply/
Back to top

Warnings

  • 1 invalid line.
Back to top