camlions.com
robots.txt

Robots Exclusion Standard data for camlions.com

Resource Scan

Scan Details

Site Domain camlions.com
Base Domain camlions.com
Scan Status Ok
Last Scan2026-03-31T23:51:33+00:00
Next Scan 2026-04-07T23:51:33+00:00

Last Scan

Scanned2026-03-31T23:51:33+00:00
URL https://camlions.com/robots.txt
Domain IPs 50.30.32.97
Response IP 50.30.32.97
Found Yes
Hash 7cc10d311636018579d7b630e35c2ba0b6cba7ed61d6171d21dc4b8c90b2c3f6
SimHash 731ccd51ce8b

Groups

*

Rule Path
Disallow /admin/
Disallow /blogs/
Disallow /contact/
Disallow /pub/
Disallow /scripts/
Disallow /websites/
Disallow /inc/
Disallow /links/
Disallow /imgyt/
Disallow /newspics/
Disallow /profilespics/
Disallow /images/
Disallow /bildervideo/
Disallow /img/
Disallow /navimg/
Disallow /plesk-stat/
Allow /index.php
Allow /

Other Records

Field Value
crawl-delay 10

amazonbot
ahrefsbot
ahrefssiteaudit
baiduspider
blexbot
semrushbot
semrushbot-sa
claudebot
yandexbot
bytespider
mb2345browser
oppo
aspiegelbot
petalbot
ccbot
chatgpt-user
gptbot
omgilibot
diffbot
imagesiftbot
perplexitybot
cohere-ai
timpibot
youbot
mj12bot
dotbot
mail.ru_bot
facebookexternalhit
facebookbot
applebot
applebot-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.camlions.com/sitemap.xml

Comments

  • Allow all crawlers
  • Disallow directories
  • Disallow badbots
  • Add sitemap at the end