DEV Community

0xkoji
0xkoji

Posted on

2 1

ludwig text-classification training

uber/ludwig
https://github.com/uber/ludwig

Ludwig is a toolbox built on top of TensorFlow that allows to train and test deep learning models without the need to…
github.com

install

$ pip install ludwig
$ python -m spacy download en
Enter fullscreen mode Exit fullscreen mode

Tested text-classification

$ mkdir text-classification
$ cd text-classification
$ wget http://boston.lti.cs.cmu.edu/classes/95-865-K/HW/HW2/reuters-allcats-6.zip
$ unzip reuters-allcats-6.zip
$ vim model_definition.yaml
Enter fullscreen mode Exit fullscreen mode

model_definition.yam

input_features:
    -
        name: text
        type: text
        encoder: parallel_cnn
        level: word
output_features:
    -
        name: class
        type: category
Enter fullscreen mode Exit fullscreen mode

train.sh

#!/bin/sh

ludwig experiment \
  --data_csv reuters-allcats.csv \
  --model_definition_file model_definition.yaml
Enter fullscreen mode Exit fullscreen mode

Visualize

$ ludwig visualize --visualization learning_curves --training_statistics ./results/experiment_run_0/training_statistics.json
_         _        _      
| |_  _ __| |_ __ _(_)__ _ 
| | || / _` \ V  V / / _` |
|_|\_,_\__,_|\_/\_/|_\__, |
                     |___/ 
ludwig v0.1.0 - Experiment
Enter fullscreen mode Exit fullscreen mode

Qodo Takeover

Introducing Qodo Gen 1.0: Transform Your Workflow with Agentic AI

While many AI coding tools operate as simple command-response systems, Qodo Gen 1.0 represents the next generation: autonomous, multi-step problem-solving agents that work alongside you.

Read full post

Top comments (0)

Qodo Takeover

Introducing Qodo Gen 1.0: Transform Your Workflow with Agentic AI

Rather than just generating snippets, our agents understand your entire project context, can make decisions, use tools, and carry out tasks autonomously.

Read full post

πŸ‘‹ Kindness is contagious

Please leave a ❀️ or a friendly comment on this post if you found it helpful!

Okay