Thank you for your comment! 😀 Yes, thinking models take time because they think more deeply. So they weren’t a good fit for my use case of simple AI chat and messaging, since I wanted fast responses. However, when you need to solve difficult problems, that extra thinking becomes an advantage and can provide more well-considered responses. So I learned that choosing the right type of AI for each situation is important.
That's actually a really interesting lesson to learn firsthand.
I think a lot of people (including me at times 😅) get caught up chasing the "smartest" model, but in practice the best model is often the one that fits the problem.
If the task is simple and speed matters, waiting 30 seconds for a deep reasoning chain is probably overkill. But for debugging something nasty at 2am or solving a complex architecture problem, that extra thinking can be worth it.
It's cool seeing how many of these tradeoffs you've had to learn while actually shipping AI Avatar instead of just theorizing about it.
Thank you for your comment! 😀 Yes, thinking models take time because they think more deeply. So they weren’t a good fit for my use case of simple AI chat and messaging, since I wanted fast responses. However, when you need to solve difficult problems, that extra thinking becomes an advantage and can provide more well-considered responses. So I learned that choosing the right type of AI for each situation is important.
That's actually a really interesting lesson to learn firsthand.
I think a lot of people (including me at times 😅) get caught up chasing the "smartest" model, but in practice the best model is often the one that fits the problem.
If the task is simple and speed matters, waiting 30 seconds for a deep reasoning chain is probably overkill. But for debugging something nasty at 2am or solving a complex architecture problem, that extra thinking can be worth it.
It's cool seeing how many of these tradeoffs you've had to learn while actually shipping AI Avatar instead of just theorizing about it.
Yes, I'm testing many AI models to find the ones that fit AI Avatar's needs. The next version will come with a new AI feature, so please stay tuned! 🫡