With “first mile observability”, Calyptia helps companies collect and analyze system data at the source

0

Join today’s top leaders online at the Data Summit on March 9. Register here.


Leave him OSS Enterprise Newsletter guide your open source journey! register here.

“Observability” describes the ability to measure the internal state of a software system by analyzing raw outputs. The result metrics, logs and traces help developers and engineers understand what can impact an application’s performance, by analyzing data such as response time, memory consumption, availability, and more.

Although there are countless tools designed to iron out problems before a software update is pushed in nature, observability is about the production stage – i.e. software that is already in the public domain. Thus, it is important to get insights as soon as possible, because even a slight lag in the system could result in increased churn and lost revenue – this is where the so-called “observability of the first mile” comes into play.

First-mile observability is about drawing immediate insights from observability data at the source where the data is created, rather than having to first aggregate it into a centralized “last-mile” conduit that takes more time and consumes more resources. But more than that, first-mile observability recognizes the more modern distributed computing stack, with IoT and edge applications spread across disparate public and private infrastructures.

“First-mile observability is about developers and practitioners being able to get information about their systems as soon as possible,” explained Anurag Gupta, CEO and co-founder of Calyptia, an enterprise-focused first-mile observability platform. “The faster an organization can diagnose, troubleshoot and respond to any problem, the better its systems will perform – and the business as a whole will benefit.”

That’s not to say that first-mile observability tools seek to supplant the more traditional observability products of long-established incumbents such as New Relic, Datadog, and Splunk – rather it’s to supplement them with insights. faster.

Founded in 2020, Calyptia is the work of the creators and maintainers of open source projects Not very fluid and Running, which are billed as “fast, lightweight, and highly scalable” log and metrics data collectors that support widely used cloud and container technologies such as Kubernetes and Red Hat OpenShift. Fluent Bit and Fluentd are now hosted by the Cloud Native Computing Foundation (CNCF).

To help propel its mission to bring “immediate perception of systems” deeper into the enterprise, Calyptia announced this week that it has raised $5 million in a seed funding round led by Sierra Ventures and Carbide Ventures.

Calyptia founders Eduardo Silva and Anurag Gupta

Faster observability

Calyptia relies primarily on Fluent Bit and Fluentd, offering a cloud hosted solution that collects and aggregates logs and metrics closer to their source for faster observability and security analysis – it is deployed where the data is first generated, be it a node Kubernetes, virtual machine (VM), bare-metal server, or IoT Device. From there, Calyptia can analyze the data in real time and also route it to other cloud services or on-premises databases for longer term data analysis.

Elsewhere, Calyptia Fluent Bit Enterprise – which recently entered public beta – is touted as its flagship product, one that enables enterprises to deploy first-mile observability intelligences in their own environment “…to facilitate operations, reduce the cost of observability and managing large-scale observability,” according to Gupta. “Fluent Bit is the engine for first-mile observability, and Calyptia Enterprise for Fluent Bit ensures that any organization can reap all the benefits.”

But how does Calyptia save on observability costs, exactly? Well, a lot of that comes down to reducing back-end costs and so-called “egress” fees, which are often “hidden” fees charged by cloud providers whenever a company wants to retrieve data. data from one place and move it elsewhere. By analyzing the data at the source, it saves at least some of these costs. Additionally, users can minimize the amount of raw or “poorly filtered” data they route to expensive backend storage services – with Calyptia, they can choose the backends best suited for a particular log data stream, and even eliminate “bad” or irrelevant data before it consumes too many backend resources.

“Because you can route to multiple backends, users can choose the right cost/value for their observability data,” Gupta explained. “Additionally, we asked users to simply filter out logs they knew weren’t useful. For example, we saw users save 78% on data egress and backend costs when users exclude noisy logs at the firewall notice.”

Calyptia Cloud
Calyptia Cloud

The open source factor

As with almost every other commercial company built on an open source foundation, one of Calyptia’s main selling points is that it’s vendor-neutral and will generally work well with any other technology put in place by a business. And since Fluent Bit and Fluentd are regulated by the CNCF, it gives (potential) customers peace of mind from a licensing perspective.

“Users who have multiple backends or tools don’t need to worry that their data might be privileged to one endpoint over another,” Gupta said. “Furthermore, being part of the CNCF means users can adopt and integrate this technology into their own solutions without having to worry about proprietary licensing or any potential licensing changes.”

In terms of customers and revenue, Calyptia keeps its cards pretty close to its chest, but it said it has a “growing number of enterprise customers across a diverse set of verticals,” spanning cloud providers, financial services, banking, courier services, and more.

Additionally, Gupta said they’re seeing some interest from organizations that have used the Fluent Bit open-source project before and are now looking to scale things up with the enterprise edition.

“What we’ve done with Calyptia Enterprise is take the most powerful open-source tool for first-mile observability — Fluent Bit — and make it fully accessible for the enterprise,” Gupta said. “The faster an organization can diagnose, troubleshoot and respond, the better its systems will perform – and the business as a whole will benefit.”

VentureBeat’s mission is to be a digital public square for technical decision makers to learn about transformative enterprise technology and conduct transactions. Learn more

Share.

Comments are closed.