Running an LLM locally is quite slow, but for non-real-time applications, it’s still feasible. After all, given the current pace of chip and software development, eventually, everyone will be running AI applications on their own computers and smartphones.
Moreover, due to factors like data security, the demand for setting up local LLMs will likely increase. Therefore, I personally believe this will become a fundamental skill for software engineers in the future.
I’ve recently handled some tough work tasks, and now it’s just a matter of time. To relieve stress, I went to a bar for a few drinks and will get some rest to prepare for tomorrow’s work.
Top comments (0)