<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Dibyaprakash Pradhan</title>
    <description>The latest articles on DEV Community by Dibyaprakash Pradhan (@dibyaprakash_pradhan).</description>
    <link>https://dev.to/dibyaprakash_pradhan</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4084942%2F390513b9-e04f-42c8-9bc4-8dbf513fa5b1.jpg</url>
      <title>DEV Community: Dibyaprakash Pradhan</title>
      <link>https://dev.to/dibyaprakash_pradhan</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/dibyaprakash_pradhan"/>
    <language>en</language>
    <item>
      <title>We Open-Sourced 4,008 Multi-Turn Empathy Conversations for LLM Training</title>
      <dc:creator>Dibyaprakash Pradhan</dc:creator>
      <pubDate>Wed, 19 Aug 2026 11:29:55 +0000</pubDate>
      <link>https://dev.to/dibyaprakash_pradhan/we-open-sourced-4008-multi-turn-empathy-conversations-for-llm-training-3pl1</link>
      <guid>https://dev.to/dibyaprakash_pradhan/we-open-sourced-4008-multi-turn-empathy-conversations-for-llm-training-3pl1</guid>
      <description>&lt;p&gt;Building conversational AI that can generate a technically correct response is relatively straightforward. Building one that responds appropriately when a user is frustrated, grieving, exhausted, lonely, or emotionally overwhelmed is considerably harder.&lt;/p&gt;

&lt;p&gt;At AntEngage, we have been exploring this problem while developing emotionally intelligent conversational AI.&lt;/p&gt;

&lt;p&gt;As part of that work, we are releasing the &lt;strong&gt;AntEngage Empathy Conversation Dataset&lt;/strong&gt;, an open dataset containing &lt;strong&gt;4,008 AI-synthesized multi-turn conversations with 79,616 dialogue turns&lt;/strong&gt;.&lt;/p&gt;

&lt;p&gt;The dataset is intended for researchers and developers working on conversational AI, NLP, large language models, empathetic dialogue, affective computing, and instruction tuning.&lt;/p&gt;

&lt;h2&gt;
  
  
  Dataset at a glance
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;4,008&lt;/strong&gt; multi-turn conversations&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;79,616&lt;/strong&gt; user and assistant dialogue turns&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;19.9&lt;/strong&gt; average turns per conversation&lt;/li&gt;
&lt;li&gt;Up to &lt;strong&gt;20 turns&lt;/strong&gt; per conversation&lt;/li&gt;
&lt;li&gt;Language: &lt;strong&gt;English&lt;/strong&gt;
&lt;/li&gt;
&lt;li&gt;Formats: &lt;strong&gt;JSONL and CSV&lt;/strong&gt;
&lt;/li&gt;
&lt;li&gt;Data source: &lt;strong&gt;AI-synthesized&lt;/strong&gt;
&lt;/li&gt;
&lt;li&gt;Real user data: &lt;strong&gt;None&lt;/strong&gt;
&lt;/li&gt;
&lt;li&gt;Personally identifiable information: &lt;strong&gt;None&lt;/strong&gt;
&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The dataset contains conversations around situations where conversational systems often need more than a generic response.&lt;/p&gt;

&lt;p&gt;Examples include:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;grief and anticipatory loss&lt;/li&gt;
&lt;li&gt;caregiver burnout&lt;/li&gt;
&lt;li&gt;loneliness&lt;/li&gt;
&lt;li&gt;emotional exhaustion&lt;/li&gt;
&lt;li&gt;workplace stress&lt;/li&gt;
&lt;li&gt;parenting challenges&lt;/li&gt;
&lt;li&gt;social isolation&lt;/li&gt;
&lt;li&gt;guilt and emotional numbness&lt;/li&gt;
&lt;li&gt;hospital and ICU waiting&lt;/li&gt;
&lt;li&gt;end-of-life situations&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Why multi-turn empathy?
&lt;/h2&gt;

&lt;p&gt;Empathy in conversational AI is not simply a sentiment classification problem.&lt;/p&gt;

&lt;p&gt;A model may recognize that a message is negative while still producing a poor response.&lt;/p&gt;

&lt;p&gt;Consider a user saying:&lt;/p&gt;

&lt;blockquote&gt;
&lt;p&gt;I don't know how I'm supposed to go home and act normal.&lt;/p&gt;
&lt;/blockquote&gt;

&lt;p&gt;A conversational system needs to understand more than whether this sentence expresses sadness.&lt;/p&gt;

&lt;p&gt;It needs to maintain context, acknowledge the emotional state appropriately, avoid making unsupported assumptions, and continue the conversation naturally.&lt;/p&gt;

&lt;p&gt;That becomes even more challenging across 10, 15, or 20 dialogue turns.&lt;/p&gt;

&lt;p&gt;This is why the dataset focuses on &lt;strong&gt;multi-turn interactions rather than isolated prompt-response pairs&lt;/strong&gt;.&lt;/p&gt;

&lt;h2&gt;
  
  
  How the dataset was generated
&lt;/h2&gt;

&lt;p&gt;The conversations were produced using a structured synthetic data generation pipeline.&lt;/p&gt;

&lt;p&gt;The process broadly consisted of four stages.&lt;/p&gt;

&lt;h3&gt;
  
  
  1. Domain sampling
&lt;/h3&gt;

&lt;p&gt;We selected broad empathy-related domains and emotional situations to encourage diversity across conversations.&lt;/p&gt;

&lt;h3&gt;
  
  
  2. Scenario generation
&lt;/h3&gt;

&lt;p&gt;Specific situations were generated within each domain rather than repeatedly generating conversations from a small collection of generic prompts.&lt;/p&gt;

&lt;h3&gt;
  
  
  3. Multi-turn dialogue generation
&lt;/h3&gt;

&lt;p&gt;The scenarios were expanded into conversations containing alternating user and assistant turns.&lt;/p&gt;

&lt;h3&gt;
  
  
  4. Automated quality verification
&lt;/h3&gt;

&lt;p&gt;Generated conversations were passed through automated checks intended to evaluate characteristics including coherence, naturalness, diversity, and safety.&lt;/p&gt;

&lt;p&gt;The result is a collection of 4,008 conversations containing 79,616 dialogue turns.&lt;/p&gt;

&lt;h2&gt;
  
  
  Dataset structure
&lt;/h2&gt;

&lt;p&gt;The primary representation is JSONL.&lt;/p&gt;

&lt;p&gt;Each record represents an entire conversation and follows a structure similar to:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight json"&gt;&lt;code&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"id"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"empathy_000001"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"source"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"AntEngage-v2"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"language"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"en"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"domain"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"empathy"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"num_turns"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mi"&gt;10&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"conversation"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt;
      &lt;/span&gt;&lt;span class="nl"&gt;"role"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"user"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
      &lt;/span&gt;&lt;span class="nl"&gt;"content"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"..."&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="p"&gt;},&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt;
      &lt;/span&gt;&lt;span class="nl"&gt;"role"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"assistant"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
      &lt;/span&gt;&lt;span class="nl"&gt;"content"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"..."&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;A flattened CSV representation is also available for users who prefer tabular analysis.&lt;/p&gt;

&lt;p&gt;The CSV contains one row per dialogue turn with fields for the conversation identifier, turn index, role, content, and total conversation length.&lt;/p&gt;

&lt;h2&gt;
  
  
  Potential uses
&lt;/h2&gt;

&lt;p&gt;We believe the dataset can be useful for several areas of research and development:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;LLM instruction tuning&lt;/li&gt;
&lt;li&gt;empathetic dialogue generation&lt;/li&gt;
&lt;li&gt;conversational AI&lt;/li&gt;
&lt;li&gt;dialogue system evaluation&lt;/li&gt;
&lt;li&gt;affective computing&lt;/li&gt;
&lt;li&gt;human-AI interaction research&lt;/li&gt;
&lt;li&gt;response generation experiments&lt;/li&gt;
&lt;li&gt;conversational model benchmarking&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;When creating training, validation, and test sets, we recommend &lt;strong&gt;splitting at the conversation level rather than the individual dialogue-turn level&lt;/strong&gt;. Otherwise, turns from the same conversation could appear in both training and evaluation data.&lt;/p&gt;

&lt;h2&gt;
  
  
  Privacy and ethical considerations
&lt;/h2&gt;

&lt;p&gt;An important characteristic of this release is that &lt;strong&gt;the conversations are synthetic&lt;/strong&gt;.&lt;/p&gt;

&lt;p&gt;The dataset does not contain conversations collected from AntEngage customers or real users, and it does not contain personally identifiable information.&lt;/p&gt;

&lt;p&gt;Some conversations discuss emotionally sensitive subjects such as grief, loneliness, caregiver burnout, and end-of-life situations. The dataset should therefore be treated as research data for conversational AI rather than as clinical guidance.&lt;/p&gt;

&lt;p&gt;It is not intended to replace professional medical or mental health advice.&lt;/p&gt;

&lt;h2&gt;
  
  
  Where to get the dataset
&lt;/h2&gt;

&lt;p&gt;The dataset is openly available through multiple research and developer repositories.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;GitHub:&lt;/strong&gt;&lt;br&gt;
&lt;a href="https://github.com/AntEngage/datasets" rel="noopener noreferrer"&gt;https://github.com/AntEngage/datasets&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Hugging Face:&lt;/strong&gt;&lt;br&gt;
&lt;a href="https://huggingface.co/datasets/antengage/empathy-conversations" rel="noopener noreferrer"&gt;https://huggingface.co/datasets/antengage/empathy-conversations&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Zenodo:&lt;/strong&gt;&lt;br&gt;
&lt;a href="https://doi.org/10.5281/zenodo.21789317" rel="noopener noreferrer"&gt;https://doi.org/10.5281/zenodo.21789317&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Kaggle:&lt;/strong&gt;&lt;br&gt;
&lt;a href="https://doi.org/10.34740/KAGGLE/DS/11526980" rel="noopener noreferrer"&gt;https://doi.org/10.34740/KAGGLE/DS/11526980&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;AntEngage:&lt;/strong&gt;&lt;br&gt;
&lt;a href="https://antengage.com/datasets" rel="noopener noreferrer"&gt;https://antengage.com/datasets&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;The Zenodo record provides a persistent DOI for academic citation.&lt;/p&gt;
&lt;h2&gt;
  
  
  Citation
&lt;/h2&gt;

&lt;p&gt;If you use the dataset in research, benchmarks, applications, or other public work, please cite:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;Pradhan, D. (2026).
AntEngage Empathy Conversation Dataset (Version 1.0.0) [Data set].
AntEngage Technology Private Limited.
https://doi.org/10.5281/zenodo.21789317
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h2&gt;
  
  
  What's next?
&lt;/h2&gt;

&lt;p&gt;This release is part of our broader work around the &lt;strong&gt;AntEngage Language Model (AELM)&lt;/strong&gt; and emotionally intelligent conversational AI.&lt;/p&gt;

&lt;p&gt;We are interested in seeing how the community uses the dataset for fine-tuning, evaluation, benchmarking, and conversational AI research.&lt;/p&gt;

&lt;p&gt;If you experiment with the dataset, find problems in it, build something with it, or have ideas for improving future releases, we'd be interested in hearing about your results.&lt;/p&gt;

&lt;p&gt;The dataset and related resources are available through the &lt;a href="https://github.com/AntEngage/datasets" rel="noopener noreferrer"&gt;AntEngage open datasets repository&lt;/a&gt;.&lt;/p&gt;

</description>
      <category>ai</category>
      <category>llm</category>
      <category>machinelearning</category>
      <category>opensource</category>
    </item>
  </channel>
</rss>
