Natural Language Processing Page 13 - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

MV2 (Munim, Inc.)

Oct 30

MMLU-Pro fixed one answer shortcut and doubled another, and its new questions are why

#machinelearning #datascience #nlp #benchmarks

4 min read

MV2 (Munim, Inc.)

Oct 29

Pick the longest answer: 52.7% on MMLU international law, below chance on public relations

#machinelearning #datascience #nlp #benchmarks

3 min read

MV2 (Munim, Inc.)

Oct 29

MMLU's 'the answer is D' is an MMLU quirk: ARC, CommonsenseQA and HellaSwag don't share it

#machinelearning #datascience #nlp #benchmarks

3 min read

Interro

Sep 26

Fixing Bedrock ToolResult Ordering Errors

#ai #aws #nlp #devops

1 min read

MV2 (Munim, Inc.)

Oct 28

"Always D" scores 46.7% on MMLU high-school statistics: where benchmark answers sit, by subject and by split

#machinelearning #datascience #nlp #benchmarks

3 min read

MV2 (Munim, Inc.)

Oct 28

MMLU's "the answer is D" tilt is mostly an "all of the above" artifact

#machinelearning #datascience #nlp #benchmarks

4 min read

Oct 26

Your Question-Level Split Can Leak the Same Answer Twice

#python #rag #machinelearning #nlp

7 min read

Ryo Suwito

Sep 23

Shadow EMA: model rationale and architecture

#architecture #deeplearning #machinelearning #nlp

7 min read

MV2 (Munim, Inc.)

Oct 27

Does OpenBookQA leak its answer? It's the longest option and the first — and neither shortcut generalizes

#machinelearning #datascience #nlp #benchmarks

3 min read

cognitalk

Sep 28

Chris Manning: Language Is the Real Unlock for Intelligence | Chris Manning播客——语言才是解锁智能的关键

#ai #llm #machinelearning #nlp

1 min read

Matthias Fahsold

Oct 16

What's new in Lixity: numbers you can compare, evidence that survives edits

#python #opensource #writing #nlp

4 min read

MV2 (Munim, Inc.)

Oct 26

Picking the longest answer scores 43% on OpenBookQA and ~chance on ARC: a per-benchmark length-shortcut census

#machinelearning #datascience #nlp #benchmarks

4 min read

S.

Sep 22

What happened to Sapling.AI?

#spellingapis #speaking #nlp

1 min read

Sep 22

Day 24: Attention Mechanism: The Core Intuition

#ai #nlp #genai #100daysofcode

4 min read

MV2 (Munim, Inc.)

Oct 26

Is 'neutral is the hardest NLI label' true in every text domain? Splitting ANLI's verifier agreement by (genre, class)

#machinelearning #datascience #nlp #benchmarks

4 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.