Comet announced its newest product, Comet Model Production Monitoring (MPM), which enables organizations to track and monitor the quality of models after they have been deployed in production.
When used in tandem with Comet Enterprise, data scientists will have visibility into model quality and performance throughout the model’s lifecycle - from creation and experimentation, to production and iteration. This innovation has been supported by the acquisition of Stakion, a model production monitoring company based in the U.K., that took place earlier this year. As part of the acquisition, the Stakion team will be joining Comet and will continue innovating with production monitoring.
Comet MPM is a key innovation, as data science teams do not have full visibility across a model’s entire lifecycle. That means even if a model is successfully deployed to production, it can still struggle to meet its business KPIs once it’s live. The core issue is a gap in model development and monitoring tooling - today’s tools are either focused on training or on getting models into production, making it extremely difficult, if not impossible, to get full visibility.
“If you’re only focused on the training or the production performance, you’re missing a key feedback loop for your data science teams to continue iterating,” continued Mendels. “By combining knowledge on the model from both training and production environments, you can unlock significant value in areas such as concept drift and out-of-distribution detection.”
Comet MPM is available to existing Comet customers today.
Comet also raised $13M in Series A funding led by Scale Venture Partners and existing investors including Trilogy Equity Partners and Two Sigma Ventures.
The Latest
Over the last 20 years Digital Employee Experience has become a necessity for companies committed to digital transformation and improving IT experiences. In fact, by 2025, more than 50% of IT organizations will use digital employee experience to prioritize and measure digital initiative success ...
While most companies are now deploying cloud-based technologies, the 2024 Secure Cloud Networking Field Report from Aviatrix found that there is a silent struggle to maximize value from those investments. Many of the challenges organizations have faced over the past several years have evolved, but continue today ...
In our latest research, Cisco's The App Attention Index 2023: Beware the Application Generation, 62% of consumers report their expectations for digital experiences are far higher than they were two years ago, and 64% state they are less forgiving of poor digital services than they were just 12 months ago ...
In MEAN TIME TO INSIGHT Episode 5, Shamus McGillicuddy, VP of Research, Network Infrastructure and Operations, at EMA discusses the network source of truth ...
A vast majority (89%) of organizations have rapidly expanded their technology in the past few years and three quarters (76%) say it's brought with it increased "chaos" that they have to manage, according to Situation Report 2024: Managing Technology Chaos from Software AG ...
In 2024 the number one challenge facing IT teams is a lack of skilled workers, and many are turning to automation as an answer, according to IT Trends: 2024 Industry Report ...
Organizations are continuing to embrace multicloud environments and cloud-native architectures to enable rapid transformation and deliver secure innovation. However, despite the speed, scale, and agility enabled by these modern cloud ecosystems, organizations are struggling to manage the explosion of data they create, according to The state of observability 2024: Overcoming complexity through AI-driven analytics and automation strategies, a report from Dynatrace ...
Organizations recognize the value of observability, but only 10% of them are actually practicing full observability of their applications and infrastructure. This is among the key findings from the recently completed Logz.io 2024 Observability Pulse Survey and Report ...
Businesses must adopt a comprehensive Internet Performance Monitoring (IPM) strategy, says Enterprise Management Associates (EMA), a leading IT analyst research firm. This strategy is crucial to bridge the significant observability gap within today's complex IT infrastructures. The recommendation is particularly timely, given that 99% of enterprises are expanding their use of the Internet as a primary connectivity conduit while facing challenges due to the inefficiency of multiple, disjointed monitoring tools, according to Modern Enterprises Must Boost Observability with Internet Performance Monitoring, a new report from EMA and Catchpoint ...
Choosing the right approach is critical with cloud monitoring in hybrid environments. Otherwise, you may drive up costs with features you don’t need and risk diminishing the visibility of your on-premises IT ...
