Bap

Posted on May 17 • Updated on Oct 10

5 trends in OS development

#webdev #programming #opensource #learning

Hey friends 👋

This week, we'll delve into projects that shed light on open-source trends.

The projects discussed below do not necessarily provide a holistic OS picture but rather give a snapshot of a defined part of the ecosystem.

With this in mind, let's look at 5 trending projects and what they can tell us about the underlying macro-trends in open-source.

Note: The projects below are among the top trending open-source projects for Q1 2024. For more details on trending repos, check out the daily and high-level trending list here.

1️⃣ Unsloth: automating AI Fine-tuning

AI model fine-tuning has evolved from time-consuming and resource-intensive processes to more efficient and rapid methods, thanks to advancements in transfer learning and optimised algorithms.

These improvements have significantly reduced the time and computational power required, enabling faster deployment and iteration of AI models.

With the market being at the heart of an AI-optimization race, we are seeing really neat projects being built around this space.

Unsloth is a successful example of this.

Founded in 2023, Unsloth revolutionises AI model fine-tuning with speed and efficiency.

This open-source platform allows models like Llama 3, Mistral, and Gemma to be finetuned up to five times faster using significantly less memory.

With user-friendly notebooks, beginners can easily add datasets and run models, while advanced features like 4-bit quantisation and LoRA finetuning cater to expert users.

Unsloth's focus to performance, accessibility, and community-driven development sets a new standard in AI model training, making cutting-edge tech more accessible and efficient.

Unsloth's key features:

Finetunes models like Llama 3, Mistral, and Gemma up to 5x faster with 80% less memory usage.
Beginner-friendly notebooks allow easy dataset integration and model running with a simple "Run All" click.
Supports 4-bit quantisation, LoRA finetuning, and advanced features for novice and expert users.

2️⃣ SuperDuperDB: Leveraging AI for Databases

Databases have evolved from traditional relational models to more diverse options like NoSQL, allowing greater flexibility and scalability.

A recent trend you may have seen is the integration of AI discoveries with databases' architecture. This enabled advanced data analytics, automated maintenance, and enhanced decision-making capabilities, revolutionising the space.

SuperDuperDB is an example of this.

Founded in 2023 in Berlin, SuperDuperDB is not just a database but a transformative tool that integrates AI capabilities directly with existing databases.

It allows developers to leverage AI models, APIs, and vector search engines with their data infrastructure. This integration facilitates complex AI workflows and model chaining without requiring extensive glue code or separate processing steps.

SuperDuperDB's key features:

Model outputs are automatically updated as new data arrives.
Enables AI model training and inference directly within the database environment, reducing the complexity and overhead associated with traditional AI deployments.

3️⃣ LibreChat and the focus on AI chat platforms

Chat platforms have evolved from simple text-based communication tools to sophisticated, AI-powered systems.

The emergence of GPT and open-source AI-powered chat platforms has democratised access to advanced conversational tech, enabling devs to create intelligent, customisable, and interactive user experiences.

LibreChat is an example project of the market doubling down in this space.

Founded in 2023 in New York, LibreChat is an entirely open-source AI-powered chat platform. It provides a comprehensive suite of features for creating AI-driven conversations, including support for multiple AI models and endpoints.

LibreChat is designed to be customisable, catering to novice and power users through their adaptable interface.

LibreChat's key features:

Supports interactions with images and files, and offers services in multiple languages.
Provides extensive documentation and developer APIs to customise and extend functionalities.

4️⃣ Pydantic: Democratising access to UIs

The evolution of building web application UIs has seen a shift from static HTML pages to dynamic, component-based frameworks like React and Vue.js.

This transition has empowered developers to create more interactive, responsive, and user-friendly interfaces, enhancing the overall web experience.

JavaScript and TypeScript have been the predominant languages developers use to create and implement beautiful user interfaces.

However, the market is trying to democratise the access of UIs across more languages.

Pydantic and their repo, fastUI, is an excellent example of that.

Based in London and founded in 2022, Pydantic has emerged as a robust framework for data validation.

With its declarative Python codebase, Pydantic allows developers to build responsive web applications without needing to write JavaScript or manage npm packages.

By integrating Pydantic models with TypeScript interfaces, the framework ensures that user interfaces are validated both at build time and runtime, offering a seamless development experience.

Pydantic/fastUI's key features:

Enables backend developers to define the entire application, freeing frontend developers to focus solely on the user interface.
Ensures strong type checking and consistent data validation across the front and back-end.

5️⃣ Bruno: the ascension of API exploration

APIs have evolved significantly in recent years, shifting from simple, monolithic designs to more flexible and scalable microservices architectures.

This evolution has enabled developers to create more efficient, modular, and interoperable applications, driving innovation in the open-source community.

With Bruno, we are seeing further advancements in the space.

Bruno, being an IDE specifically designed for API testing and exploration.

Founded in 2021 in Bangalore, Bruno has quickly distinguished itself from competitors like Postman by offering an offline-only user experience prioritising data privacy.

Unlike cloud-based alternatives, Bruno stores API collections directly on the user's filesystem using a plain text markup language, Bru, allowing easy version control integration with tools like Git. This approach enhances security and improves collaboration among devs.

Bruno's key features:

Ensures that all data remains on your device, with no plans for cloud syncing.
Facilitates collaboration through Git or other version control systems.
Accessible in numerous languages, making it a global tool.

As we conclude this week's exploration of OS gems, we believe these five projects offer a glimpse into the potential directions of open-source trends.

While they do not paint a complete picture of the 2024 landscape, they provide valuable insights into the macro-trends within the ecosystem.

I hope you enjoyed discovering these projects. If you enjoyed reading this piece, please feel free to share it with your friends and colleagues!

Also, please consider staring the above repos. We are not associated with them, we simply think great projects deserve great recognition!