DEV Community

loading...

Need Data to write parser

Ashok Mohanakumar
INTP | Full Stack Dev
・1 min read

I want to learn writing simple parsers, it would be fun if I can do it as simple challenges or problems that need solutions. Like some chunk of raw data to take information out of. Is there a place that you guys know of or I can look for such data ?

Discussion (11)

Collapse
cathodion profile image
Dustin King • Edited

There doesn't currently appear to be a place where you can get a free, live feed of AIS (ship tracking) data, but you folks in the US can make FOIA requests for a data dump from NAVCEN. I see that you're in India, so that might not be possible. Maybe your own government has something similar. To get an idea of what's in AIS data, there's marinetraffic.com -- Basically, it's where the vessel is, its heading, and some vital stats like its name, length, etc. The pictures are sourced from somewhere else.

And here's a guide to AIS data data: catb.org/gpsd/AIVDM.html Caveat: the sentences might start with some other letters like !SAVDM instead of just !AIVDM. The hd-sf.com link on this page for a free feed for the San Francisco bay area appears to no longer work.

I used to work with this type of data, so I'm happy to answer any questions about it. If you're more interested in airplanes, do a search for "ADS-B".

Edits: missing words.

Collapse
seankilleen profile image
Sean Killeen

Hey! I've noticed that in this post you use "guys" as a reference to the entire community, which is not made up of only guys but a variety of community members.

I'm running an experiment and hope you'll participate. Would you consider changing "guys" to a more inclusive term? If you're open to that, please let me know when you've changed it and I'll delete this comment.

For more information and some alternate suggestions, see dev.to/seankilleen/a-quick-experim....

Thanks for considering!

Collapse
nektro profile image
Meghan (she/her)

Try making a JSON parser and use jsonplaceholder.typicode.com/

Collapse
ashokcodes profile image
Ashok Mohanakumar Author

Thanks a lot :)

Collapse
nektro profile image
Meghan (she/her)

Good luck :D

Collapse
anipimpale94 profile image
Anirudha Pimpale

You can try to make a Wiktionary parser and then try to save it in JSON/XML format for each word.
You can find the dump xml here: dumps.wikimedia.org/enwiktionary/l...

Collapse
rhymes profile image
rhymes

What kind of parsers are you building and what kind of data do you need?

Collapse
ashokcodes profile image
Ashok Mohanakumar Author

That I don't know. I know it sounds silly. But yeah, anything can work. Maybe weather data or something like that

Collapse
rhymes profile image
rhymes

For example you could download a dump of en.wiktionary.org/ here dumps.wikimedia.org/enwiktionary/l...

Collapse
ashokcodes profile image
Ashok Mohanakumar Author

thanks a lot :)