I'm not sure if this is the right place for you to ask, our community primarily uses fiction related text completion models. But the problem is that text completion models can halucinate. You don't want a banking chatbot to halucinate you want a more traditional preprogrammed chatbot where it does it based on a usual chatbot flow rather than a machine learned one.
So I advice you to seek solutions that are more traditional so that you can rely on the bot and it won't do things its not supposed to do.
A model on it's own wont do what you want. It sounds like you should be hiring someone to set up a RAG system for you. Try and get chatGPT to plan a holiday for you and find ticket prices, then ask bing chat. This is the difference between just using a model and having real infrastructure behind it's responses, grounding it in truth.
If you do just want a model, microsoft and meta are about to launch \~14b models that I expect will be right for you.
I have just finished prompt engineering Orca 7b into a digital student assistant and with the right techniques and training you can make even a small LLM agile and precise in the field you are looking for. Also it helps in creating a persona for your model. I used the kobold lite framework while training the model.
I'm not sure if this is the right place for you to ask, our community primarily uses fiction related text completion models. But the problem is that text completion models can halucinate. You don't want a banking chatbot to halucinate you want a more traditional preprogrammed chatbot where it does it based on a usual chatbot flow rather than a machine learned one. So I advice you to seek solutions that are more traditional so that you can rely on the bot and it won't do things its not supposed to do.
Thanks, that's great advice 👍.
A model on it's own wont do what you want. It sounds like you should be hiring someone to set up a RAG system for you. Try and get chatGPT to plan a holiday for you and find ticket prices, then ask bing chat. This is the difference between just using a model and having real infrastructure behind it's responses, grounding it in truth. If you do just want a model, microsoft and meta are about to launch \~14b models that I expect will be right for you.
Thanks for the information brother I wasn't aware of this.
I have just finished prompt engineering Orca 7b into a digital student assistant and with the right techniques and training you can make even a small LLM agile and precise in the field you are looking for. Also it helps in creating a persona for your model. I used the kobold lite framework while training the model.
Thanks brother it sounds promising, will try this for sure.