A few days ago, Andrej Karpathy told us a new story about software change in his video "Andrej Karpathy: Software Is Changing (Again)". And the story is so funny that when you listen to it, you will think - if you learn English, the world is in your hands. Is it really so? Let's take a deeper dive!
Three lives of software: 1.0, 2.0, and 3.0
Karpathy says that the world of software has changed in three stages. Let's write it with a little fun:
Software 1.0: "Daddy, I'll do whatever you say!"
It's slowly becoming like the old days. Back then (or still) programmers would sit in front of the computer, writing code line by line, just like calculating in a ledger. The computer had to say, "Look, brother, do 2+2, then put the result here." If there was a slight mistake, the poor computer would throw up its hands and legs and say, "I don't understand anything!" This was the legacy coding style—just like teachers, everything had to be taught step by step.
Software 2.0: "I'll learn it myself, you just give me the data!"
Then came the era of neural networks. Here, computers became a little smarter. Karpathy says, during this time, we programmed with the "weights" of the neural network. That is, we would give the computer a bunch of data and say, "Here, look at these and you'll figure out what to do." For example, instead of showing a picture of a bird and saying, "This is a bird," if you showed it thousands of pictures, the computer would say, "Oh, this is a bird, and that is a cat!" This was Software 2.0—a little less work, more fun.
Software 3.0: "Say it in English, I'll do it!"
Now comes the most fun part, Software 3.0. Here, Karpathy says, we are now programming with prompts. What does that mean? Now you can say to the computer in English, "Brother, write a song for me," and it will write the song immediately! This is possible thanks to the LLM or Large Language Model. Now there is no more hassle of writing code, just saying. This is a big change, because programming has now become easy and fun for everyone. I know, this will be a fight for several years, but Software 3.0 will eat everything up.
Later, some company (like Open AI) will come along and make an 'LLM' operating system and make all the operating systems in the world disappear. I don't want to say much more.
So tell me, why is this a big deal?
Answer is: "It’s big cause as it’s democratizing creation and problem solving, but LLM is new OS, how owns it is the most powerful."
Rad Sarar
Posted on
Software is changing! (AGAIN)!!
For further actions, you may consider blocking this person and/or reporting abuse
Top comments (0)