DEV Community

Cover image for New DSLs need great docs to survive LLMs
ironbyte-rgb for crescevo

Posted on • Originally published at ai.crescevo.com

New DSLs need great docs to survive LLMs

TL;DR

  • A new DSL can survive in the era of LLMs with great documentation, marketing, and tooling.
  • Advanced tooling around legacy languages has decreased hallucinations in LLMs.
  • A robust language server and extensive documentation are necessary for a modern language.
  • Creating an AGENTS.md file can help a new language play well with LLM agents.

A new DSL can survive in the era of LLMs by focusing on great documentation, marketing, and tooling, as stated in the article "How a new DSL may survive in the era of LLMs" by William Cotton. The article highlights the importance of advanced tooling, such as type checkers and linters, in reducing hallucinations in LLMs. According to the article, a modern language needs a robust language server and extensive documentation to be viable.

What the data shows

The data shows that the volume of source code and advanced tooling around legacy languages have contributed to the decrease in hallucinations in LLMs. As stated in the article, "it's not just the mere volume of source code to train on. It's the advanced tooling around these languages." The article also mentions that "hallucinations are caught by the type checker before the code is even run." This suggests that the use of advanced tooling has improved the accuracy of LLMs.

What this means for ai readers

For AI readers, this means that a new DSL will need to have great documentation, marketing, and tooling to be viable. The article suggests that a new language will need a robust language server and extensive documentation with a good onboarding flow. Additionally, the article proposes creating an AGENTS.md file to help a new language play well with LLM agents. For example, the article mentions that the Web Pipe language uses a "webpipe init --codex" command to create an AGENTS.md file.

What to do right now

To increase the chances of a new DSL surviving in the era of LLMs, developers can start by creating great documentation and tooling for their language. This includes developing a robust language server and extensive documentation with a good onboarding flow. Additionally, developers can create an AGENTS.md file to help their language play well with LLM agents. The article also suggests that landing pages can be used to quickly get across the purpose and use case of a new language.

Bottom line

The bottom line is that a new DSL can survive in the era of LLMs with great documentation, marketing, and tooling. By focusing on these areas, developers can increase the chances of their language being viable in the era of LLMs. As stated in the article, a modern language needs a robust language server and extensive documentation to be viable.

Frequently asked questions

Q: What is necessary for a new DSL to survive in the era of LLMs?

A new DSL needs great documentation, marketing, and tooling to survive in the era of LLMs.

Q: How can hallucinations in LLMs be reduced?

Advanced tooling, such as type checkers and linters, can reduce hallucinations in LLMs.

Q: What is the purpose of an AGENTS.md file?

An AGENTS.md file can help a new language play well with LLM agents.

Q: How can developers quickly get across the purpose and use case of a new language?

Developers can use landing pages to quickly get across the purpose and use case of a new language.

Sources

Related reading


Originally published on AI at Crescevo — subscribe free for more.

Top comments (0)