DEV Community

Introduction to Natural Language Processing, Part 1.

Jaydeep Borkar on September 09, 2018

Hello folks, I’ve just started my NLP journey and will be happy to share my learning process with you. Here’s an article regarding Introduction to ...
Collapse
 
andrewlucker profile image
Andrew Lucker • Edited

Thanks for the crash course into Parsey McParseface. Out of curiousity, can Parsey McParseface parse "Parsey McParseface"?

Also do you have any specific reasoning behind the assertion that "Computers can’t truly understand the human language". Is there a benchmark that you think would be difficult, or is this an epistemologic hurdle?

Collapse
 
jaydeepborkar profile image
Jaydeep Borkar

Hi Andrew, Interesting question. Parsey McParseface is trained with a lot of English words. If the word 'Parsey McParseface' is already labeled into it, it can parse it. But, if it's a new word, it will try guessing to its nearest meaning, but can be embarrassingly wrong few times. It has 94% accuracy, so I guess Parsey should parse it.

"Computers can’t truly understand the human language", we can train a model and it can do tasks on the basis of the data it has been fed. But it cannot understand and make a sense of sentences like we as humans can do. Human language has a lot of ambiguity, it's difficult to get the 'correct' meaning of a sentence. We as humans can figure out the variations but computers can't. Yes, making computers understand this will be difficult, but parsers like Parsey might try leveling down such ambiguities.

Collapse
 
amananandrai profile image
amananandrai

Awesome post but I would like to point out that you can use markdown heading and subheadings to make it more readable. You can divide the blog into sections. Here I am posting an example of

subheading

and
List

  • One
  • Two
Collapse
 
jaydeepborkar profile image
Jaydeep Borkar

Yes, I completely agree. Sorry, didn't take that into consideration.