Nov '25 • General Discussion 💬
Small Language Models
I need to build a chatbot to lead people to use an app, the app has some pretty complicated features.
I need to use local AI for privacy.
I need to use RAG for user manuals and educational videos.
Thinking of model like Llama 3.1 8B and some other local models for transcribing and embedding.
Do you think such models, particularly Llama 3.1 8B and the available small embedding models can perform well in handling conversation to lead users to configure a relatively complex app?
Would Llama 3.1 8B follow strictly a complex system prompt and make a correct usage of tools? Any other SLMs can handle this well?
What about small embedding models?
Anything about small transcribing models?
Regards
Shadi Ghaith
6
3 comments
Small Language Models
skool.com/ai-automation-society
Learn to get paid for AI solutions, regardless of your background.
Leaderboard (30-day)
1
🔥
+7538
2
🔥
+5048
3
🔥
+3581
4
+2785
5
+1464
Powered by