DEV Community

Natural Language Processing

NLP is Natural Language Processing the technology behind Home assistants and search engines.

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
minbpe vs turboBPE: Two ways to think about tokenizer training

minbpe vs turboBPE: Two ways to think about tokenizer training

Comments
4 min read
Replacing Cross-Encoder Reranking with a Weighted Hybrid Score

Replacing Cross-Encoder Reranking with a Weighted Hybrid Score

Comments
5 min read
Part 2: Why We Built Our Own TinyBERT (and How It Beat Shiprocket's) - Indian Address Parser

Part 2: Why We Built Our Own TinyBERT (and How It Beat Shiprocket's) - Indian Address Parser

1
Comments
7 min read
When translation gives you one answer and no context

When translation gives you one answer and no context

Comments
2 min read
Moroccan Darija in NLP: Challenges and Opportunities

Moroccan Darija in NLP: Challenges and Opportunities

3
Comments
5 min read
I Built an Open-Source Dataset of 985 Dream Symbols — Here's How You Can Use It

I Built an Open-Source Dataset of 985 Dream Symbols — Here's How You Can Use It

Comments
1 min read
LLM Self-Preference Bias: How Anonymized Peer Review Fixes It

LLM Self-Preference Bias: How Anonymized Peer Review Fixes It

Comments
7 min read
Tokenization under the hood: BPE, WordPiece, SentencePiece, and Unigram compared

Tokenization under the hood: BPE, WordPiece, SentencePiece, and Unigram compared

Comments
9 min read
Fine-Tuning Large Language Models: A Practical Guide

Fine-Tuning Large Language Models: A Practical Guide

Comments
6 min read
How Transformer Architecture Works — Encoder, Decoder, Tokens, and Context

How Transformer Architecture Works — Encoder, Decoder, Tokens, and Context

Comments
6 min read
Smishi — an SMS phishing detector for Serbian/Bosnian/Croatian/Montenegrin

Smishi — an SMS phishing detector for Serbian/Bosnian/Croatian/Montenegrin

Comments
3 min read
I built an AI tool that saves 80% LLM costs & catches hallucinations (Open Source)

I built an AI tool that saves 80% LLM costs & catches hallucinations (Open Source)

Comments
2 min read
Yeni AI Modelleri ve EÄźitim

Yeni AI Modelleri ve EÄźitim

Comments
2 min read
Extracting structured data from messy text: what worked for me

Extracting structured data from messy text: what worked for me

1
Comments
3 min read
What embeddings are, explained by building one

What embeddings are, explained by building one

Comments
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.