New Loggly Derived Fields Automatically Inject Intelligence and Structure into Any Log
June 16, 2015
Share this

Loggly announced Loggly Derived Fields, a new capability within Loggly Pro and Enterprise that allows users to specify custom parsing rules that generate derived fields as metadata during the ingestion process.

The derived fields provide intelligence and structure that is then used by Loggly Dynamic Field Explorer; to automatically catalog and summarize logs for one-click navigation and analysis. With derived fields and Field Explorer, development and DevOps teams can troubleshoot problems faster, more effectively monitor their log data for emerging issues, and do sanity checks after code releases without relying on cumbersome, manual queries.

A significant proportion of logs in organizations today are unstructured; the data is not separated into discrete data elements that allow for focused searching or aggregate metrics. Unstructured logs create considerable manual effort for DevOps professionals who traditionally have had to create one-off regular expressions and custom analyses. Many log management solutions require users to develop queries from scratch for each analysis, which is time consuming and inhibits sharing with less technical team members. Derived fields are different because once users create their rules, Loggly automatically applies those rules to all log data it receives, for all users of the account. Any user is then able to use Field Explorer to navigate by field names and values and to create sophisticated analyses without doing any additional work.

Derived fields expand the functionality of the flagship interface of Loggly, Loggly Dynamic Field Explorer. While most traditional log management solutions are designed with the search box as the primary interface, Field Explorer generates navigable lists and summaries to deliver a guided search experience. With Field Explorer, users get a bird’s-eye view of what’s happening, can quickly spot anomalies, understand the magnitude of issues, and search their logs with greater precision. Loggly Derived Fields extend the capabilities of Field Explorer to virtually any log type, structured or unstructured.

Derived fields are metadata, allowing for the original log data to stay intact so that logs can be analyzed in multiple ways. A user may create as many derived fields as needed from the same log events. Derived fields and Dynamic Field Explorer together help DevOps and IT professionals identify and resolve systems issues faster through more flexible and efficient log analytics.

“Unstructured logs are a reality for most cloud-centric companies, yet being able to efficiently mine those logs is critical for troubleshooting and delivering high application responsiveness to the business and end customers,” says Hector Angulo, Head of Product at Loggly. “Derived fields are another step in our unique ‘summarize first’ strategy. Customers can now gain insight even faster and spend more of their time solving or preventing IT issues rather than finding them.”

Loggly Derived Fields are currently in beta and will be generally available by the end of June 2015. Derived fields are a feature of the Loggly Pro and Enterprise subscription plans.

Share this

The Latest

July 24, 2017

Optimizing online web performance is critical to keep and convert customers and achieve success for the holidays and the entire retail year. Recent research from Akamai indicates that website slowdowns as small as 100 milliseconds can significantly impact revenues ...

July 21, 2017

Public sector organizations undergoing digital transformation are losing confidence in IT Operations' ability to manage the influx of new technologies and evolving expectations, according to the 2017 Splunk Public Sector IT Operations Survey ...

July 20, 2017

It's no surprise that web application quality is incredibly important for businesses; 99 percent of those surveyed by Sencha are in agreement. But despite technological advances in testing, including automation, problems with web application quality remain an issue for most businesses ...

July 19, 2017

Market hype and growing interest in artificial intelligence (AI) are pushing established software vendors to introduce AI into their product strategy, creating considerable confusion in the process, according to Gartner. Analysts predict that by 2020, AI technologies will be virtually pervasive in almost every new software product and service ...

July 18, 2017

Organizations are encountering user, revenue or customer-impacting digital performance problems once every five days, according a new study by Dynatrace. Furthermore, the study reveals that individuals are losing a quarter of their working lives battling to address these problems ...

July 17, 2017
Mobile devices account for more than 60 percent of all digital minutes in all 9 markets profiled in comScore's report: Mobile’s Hierarchy of Needs ...
July 14, 2017

Cloud adoption is still the most vexing factor in increased network complexity, ahead of the internet of things (IoT), software-defined networking (SDN), and network functions virtualization (NFV), according to a new survey conducted by Kentik ...

July 13, 2017

Gigabit speeds and new technologies are driving new capabilities and even more opportunities to innovate and differentiate. Faster compute, new applications and more storage are all working together to enable greater efficiency and greater power. Yet with opportunity comes complexity ...

July 12, 2017

Achieving broad competence in event-driven IT will be a top three priority for the majority of global enterprise CIOs by 2020, according to Gartner, Inc. Defining an event-centric digital business strategy will be key to delivering on the growth agenda that many CEOs see as their highest business priority ...

July 11, 2017

It's not especially surprising that a new IT survey shows that cloud use for business and government poses challenges. In significant numbers across the board, respondents cited cloud complexity, compliance and security, cost control, speed of delivery, and domain expertise as the cloud problems their organizations were working to overcome this year ...