Grafana Labs announced two new open source projects: Grafana Phlare, a horizontally scalable continuous profiling database, and Grafana Faro, a web SDK that enables frontend application observability.
Grafana Phlare – which brings Grafana Labs’ horizontally scalable, object-storage-based database design to profiling data – joins Mimir, Loki, and Tempo in the Grafana open source observability stack. Phlare natively integrates with Grafana, allowing you to visualize your profiling data alongside your metrics, logs, and traces as well as data from any of the hundreds of disparate data sources that can be visualized in Grafana.
Grafana Faro is an open source project that enables you to collect data about the health of the frontend of your web applications. A highly configurable web SDK instruments web applications to capture observability signals.This frontend telemetry can then be correlated with backend and infrastructure data in the LGTM stack for a seamless, full-stack, open source observability solution.
Feature highlights include:
- Setup in seconds with just two lines of code
- Automatic instrumentation that captures errors, logs, and performance metrics
- Pre-configured tracing system based on OpenTelemetry with automatic instrumentations
- Easy-to-use API for manual instrumentation
The easiest way to get started observing your application frontend with Grafana Faro is with the fully managed Grafana Cloud observability offering. The new Frontend Application Observability service, now in private beta, will be available for all Grafana Cloud users.
Grafana Labs also announced the latest developments across the LGTM Stack, which has surpassed 1 million instances, including OSS and Grafana Cloud:
- A backend for all metrics formats: Grafana Mimir, which was launched in March 2022 with native support for Prometheus metrics, now also supports ingestion of Influx, Datadog, Graphite, and OpenTelemetry metrics. With this development, Grafana Labs leans into the “big tent” philosophy by providing a data format-agnostic backend that allows organizations to ingest data from as many sources as possible while leveraging a single query language, PromQL. Just as Grafana is the one tool that enables you to visualize all your data, no matter where it lives, Mimir is being built to enable you to store all your metrics, no matter the format.
- A new index in Loki 2.7: Loki’s index has been redesigned, replacing a bespoke format with a design based on Prometheus’s TSDB. This new format, which will be GA in the upcoming 2.7 release, takes up 75 percent less space on disk, can be accessed more efficiently, and enables further parallelized query execution. Loki can now scan log lines at up to 400GB/second at peak (4x faster than before).
- Export logs from Grafana Cloud: Some Grafana Cloud users need to keep logs for years after they’re generated, often for compliance reasons. This feature in Grafana Cloud allows you to ship your logs to an object storage bucket you own in AWS, Azure, or GCP for long-term storage, and query it using LogCLI or by running your own Loki, with no additional cost to re-ingest the data to Grafana Cloud. This feature is now in private beta.
- k6 x Tempo: An industry first, this integration brings together observability and performance testing, allowing you to troubleshoot k6 test runs with server-side tracing data from Tempo. Metrics are generated in real time by aggregating your internal tracing data and correlated with k6’s test run data. You can then query these metrics with Prometheus APIs and PromQL or use the attached exemplars to quickly spot if your database was struggling, if the cache hit rate decreased, or if an internal service was taking too much time to respond at some point of the test run. This integration is now in private beta.
- Introducing TraceQL: Originally, Grafana Tempo could only look up traces by ID; metrics or logs were required to surface the right trace ID. Then search was introduced, allowing you to find traces by fields like service name. And now, coming soon to Tempo 2.0 is TraceQL, a language designed from the ground up for querying trace data, modeled on PromQL and LogQL to make it easier to learn if you’re already familiar with those languages. With TraceQL, you’ll have a more powerful, flexible way to pinpoint the traces you need to answer questions about your system.
“These days, companies really care that they are able to be online, that their applications are performing fast, that their users aren’t getting annoyed and switching to a competitor. The experience and the quality of that online experience is of paramount importance to everybody. So making sure all the software and infrastructure is running, and running properly, is top of mind for every company,” said co-founder and CEO at Grafana Labs, Raj Dutt. “To support these organizations, we’re launching two brand new open source projects and numerous updates to our Grafana LGTM stack. The team has been innovating a lot the last few quarters, and we’re really looking forward to sharing these latest projects and updates with our community.”
The Latest
The journey of maturing observability practices for users entails navigating peaks and valleys. Users have clearly witnessed the maturation of their monitoring capabilities, embraced DevOps practices, and adopted cloud and cloud-native technologies. Notwithstanding that, we witness the gradual increase of the Mean Time To Recovery (MTTR) for production issues year over year ...
Optimizing existing use of cloud is the top initiative — for the seventh year in a row, reported by 62% of respondents in the Flexera 2023 State of the Cloud Report ...
Gartner highlighted four trends impacting cloud, data center and edge infrastructure in 2023, as infrastructure and operations teams pivot to support new technologies and ways of working during a year of economic uncertainty ...
Developers need a tool that can be portable and vendor agnostic, given the advent of microservices. It may be clear an issue is occurring; what may not be clear is if it's part of a distributed system or the app itself. Enter OpenTelemetry, commonly referred to as OTel, an open-source framework that provides a standardized way of collecting and exporting telemetry data (logs, metrics, and traces) from cloud-native software ...
As SLOs grow in popularity their usage is becoming more mature. For example, 82% of respondents intend to increase their use of SLOs, and 96% have mapped SLOs directly to their business operations or already have a plan to, according to The State of Service Level Objectives 2023 from Nobl9 ...
Observability has matured beyond its early adopter position and is now foundational for modern enterprises to achieve full visibility into today's complex technology environments, according to The State of Observability 2023, a report released by Splunk in collaboration with Enterprise Strategy Group ...
Before network engineers even begin the automation process, they tend to start with preconceived notions that oftentimes, if acted upon, can hinder the process. To prevent that from happening, it's important to identify and dispel a few common misconceptions currently out there and how networking teams can overcome them. So, let's address the three most common network automation myths ...
Many IT organizations apply AI/ML and AIOps technology across domains, correlating insights from the various layers of IT infrastructure and operations. However, Enterprise Management Associates (EMA) has observed significant interest in applying these AI technologies narrowly to network management, according to a new research report, titled AI-Driven Networks: Leveling Up Network Management with AI/ML and AIOps ...
When it comes to system outages, AIOps solutions with the right foundation can help reduce the blame game so the right teams can spend valuable time restoring the impacted services rather than improving their MTTI score (mean time to innocence). In fact, much of today's innovation around ChatGPT-style algorithms can be used to significantly improve the triage process and user experience ...
Gartner identified the top 10 data and analytics (D&A) trends for 2023 that can guide D&A leaders to create new sources of value by anticipating change and transforming extreme uncertainty into new business opportunities ...