Installing Finite-State Transducer (FST) tools on Windows

Daniel W. Hieber — Sat, 04 Sep 2021 04:48:41 +0000

Finite-state transducers (FSTs) are often used in linguistics to create morphological models of a language, which can both parse words in that language and return a morphological analysis, and accept a morphological analysis and produce a grammatically correct word. While FSTs and computational models sound complex, they're actually fairly straightforward! You don't need to have advanced computational skills. The most difficult part is in fact the grammatical analysis of the language rather than implementing that analysis as an FST. Any linguist can create an FST.

In this post I'll show you how to install the two most common tools for creating FSTs—foma and hfst—on Windows. (If you're on Mac or Linux, those links also have installation instructions for those platforms.)

Download foma by going to the foma home page > Precompiled binaries for Win32, OSX, Linux > foma-X.X.X_win32.zip (where the X's are the latest version numbers).
Download hfst by going to the hfst home page > download page > win32 executables > hfst-latest.zip.
Extract the zip file for both downloads.
Rename the folder in the foma download from win32 to foma.
Move both extracted folders to C:\Program Files (x86), like so:

C:\Program Files (x86)\foma
C:\Program Files (x86)\hfst

Next you need to make the foma and hfst commands available to run from the terminal / command line. Neither foma nor hfst have a graphical user interface, so you run them by opening a command line (press the Windows key, then type "command", and open the Command Prompt program that is shown) and typing simple text commands that begin with foma or hfst. At the moment, however, if you open a command line, no foma or hfst commands are available. So let's fix that:

Press the Windows key and type "path". One of the options should be "Edit the system environment variables"—open that. (If that option doesn't appear, search for "path" or "environment variables" in Settings.)
A System Properties dialog box will open. Click Environment Variables in the lower right.
An Environment Variables dialog box will open. Under User variables for {username}, click on Path and then click Edit.
You will now add the paths to the foma and hfst executables that you placed in Program Files earlier. Do this by clicking New and adding a line for each. Note that for hfst you also need to add \bin to the path, like so:

C:\Program Files (x86)\foma
C:\Program Files (x86)\hfst\bin

The command line should now know about the existence of the foma and hfst commands and be able to run them. Let's check:

Open a terminal / command line, type foma -h and press Enter. You should see the following:

The -h flag stands for "help", and displays information about how to use foma. If you got the help text, it worked! The command line successfully recognized the foma command.

Check for the hfst command in a similar way: type hfst-info and press enter, and you should get see information about the hfst software.

You're all set! You are now ready to begin creating and using finite-state transducers!

Adding citations to GitHub repositories

Daniel W. Hieber — Sun, 15 Aug 2021 03:52:21 +0000

Tucked away in GitHub's changelog for July is a nifty new feature that should thrill academics everywhere: the ability to add citation files to your repository, telling users how to cite your software or data.

Now, if you add a CITATION.cff file to the root of your repository in Citation File Format, GitHub will automatically parse the information into APA and BibTeX formats and include a "Cite this repository" link in the About sidebar.

Check out the complete documentation on using GitHub citation files here.

Happy citing, and may your h-index always be high!

DEV Community: Digital Linguistics

Installing Finite-State Transducer (FST) tools on Windows

Adding citations to GitHub repositories