Want to run a similar model to ChatGPT on your infrastructure?
With a huge push to build open-source models, Mixtral 7B is one of the best models ...
For further actions, you may consider blocking this person and/or reporting abuse
Can you please elaborate how much effective it is with respect to chatGPT and how much computing power will be required?
Thanks for the question. On Hetzner, you can get an ARM box for around $30 pm, this is 16vCPU and 32GB RAM. This should be sufficient to run Mistral 7B. In fact, I ran it on one of the cheaper $15 pm boxes as well and the performance was okay.
This is without a GPU, I got 9-12 tokens per second. The only issue is that you can run just one task at a time.
For better performance a GPU box is advised, this can cost between $100-$200 pm. I got an NVIDIA GeForce GTX 1080 Box with 8 cores (AMD) and 64GB RAM for around 100 dollars. I am getting 5-8 tokens per second and can run multiple tasks in parallel - it does start to slow down as you run more and more tasks.
ChatGPT is a commercial offering and has loads of resources, so Mistral is not going to be as good as ChatGPT. What I found though for tasks like generating articles, code, labeling, tagging, and categorization - this model works well, so it all depends on your use case.
I have seen and perused cryptocurrency scams. It reminds me of some heart ache experience when I lost 8000k dollars to a fake online crypto investment scam when I invested a huge amount of money. I searched online and came across a recovery expert who I contacted via (santoshihacker@hotmail.com) who in a short while helped recover my scammed money, and I was pleased.
I will advise you to communicate the aforementioned email for assistance, you can also contact him via Website ( santoshihacker.godaddysites.com ) for help, he is fast and reliable.