Skip to main content

StarTree ThirdEye

StarTree ThirdEye is an anomaly detection platform that allows organizations to monitor critical Business KPIs in a real-time fashion, and detect any anomalies automatically. This allows key stakeholders to take corrective action in a timely manner and helps businesses to save several million dollars.

Using StarTree ThirdEye Discover hidden issues before they become business-impacting problems Proactive monitoring for your business-critical metrics/KPIs (single/multiple time series) Real-time alerts for unusual behavior

The unique features are Connect and onboard a wide range of data sources (real-time and offline) with point and click self-serve experience Support for multiple types of anomalies with applied data science algorithms Recommends which top contributors to monitor in a massive data Interactive root-cause analysis in real-time to take corrective actions

This product is intended for Data Engineers Data Scientists Product Analysts Data Platform Engineers Business operations

Current featured customers/users of StarTree ThirdEye

  • JustEat TakeAway.com
  • Walmart
  • LinkedIn
  • Confluent

Quote from Central Analytics Team at JET (JustEat Takeaway.com) “StarTree ThirdEye allows us to be on top of our core metrics and instantly find out the root cause of data anomalies due to its strong Root Cause Analysis feature.”

Tim Berglund explains ThirdEye

StartTree ThirdEye - Quick How to Video (Onboarding KPIs to alerting and troubleshooting)StartTree ThirdEye - quick how-to from configuration to alert creation to investigation

Why ThirdEye?

Unexpected deviations in critical metrics result in a materialistic impact on business, such as exponential growth in user activity on user facing applcications, revenue loss, drop in user engagement, and increased operational cost. In addition, with rapid growth, change of data, and the measurement of millions of metrics, monitoring and problem-solving are becoming extremely challenging and expensive.

StarTree ThirdEye is built on top of the Open-source Thirdeye, developed at LinkedIn in [2015]. StarTree ThirdEye is an anomaly detection platform that allows organizations to monitor Business KPIs in a real-time fashion, and detect any anomalies automatically. This allows key stakeholders to take corrective action in a timely manner.

It is uniquely positioned to solve these challenges with "all-in-one" detection, monitoring and root-cause analysis solution for monitoring critical business and user facing metrics and KPIs.

Some of the examples are:

  • Monitoring business KPIs such as # of booked orders help to ensure you correctly handle order fulfillment and logistics.
  • Monitoring business KPIs such as order sales helps experiment with different food prices to ensure the pricing is correct and well adopted.
  • Monitoring user-facing KPIs such as popular food items, delivery time, and delivery distance will help you understand customer behavior so that you can take the necessary measures to drive engagement and retention.
  • Monitoring business KPIs such as booked orders and advertising campaigns will help to decide the correct advertising plan to define marketing strategies, suitable social media platforms, and their target audience.

What is StarTree ThirdEye?

StarTree ThirdEye is an anomaly detection, monitoring, and interactive root-cause analysis "all-in-one" platform. It comes with a self-serve UI experience. It empowers insights producers and consumers to unleash the power of actionable insights from anomalous events in a self-serve interactive way to act on it in real-time.

image

StarTree ThirdEye has unique advantages to fast-track problem solving with applied Anomaly Detection on time series data at scale.

  • Reduced time for detection with the ability to easily connect to real-time + historical data sources at scale and detect anomalies with point-and-click experience.
  • The type of data it can analyze: StarTree ThirdEye can analyse timeseries data at scale with dimension level granularity. It is built on top of Apache PinotTM, enabling it to run aggregated queries such as Sum/Avg/Count and simple/advanced statistical methods to detect outliers at scale in sub-second response time.
  • Applied science: It runs anomaly detection models to time-series data and fine-tune detection models with low-code/no-code experience without needing to write code and maintain data pipelines.
  • Reduced time to resolution with an interactive UI to perform root cause analysis in case of an incident unlocks actionable insights such as top contributors and heatmap of dimensions contributing to the spike or drop in the critical metrics in an easy-to-use interface.
  • Accuracy: StarTree ThirdEye has configurable "Anomaly filters" that allows users to achieve detection accuracy based on business context.
  • The user interface: It has a user-friendly interface that makes it easy to set up and use with point and click, low code/no-code experience.
  • The level of customization and flexibility: It allows users to customize the algorithms, parameters and build custom apps using APIs to solve custom business use cases.
  • The level of support and documentation provided: It comes with comprehensive documentation and support.

It has the following key features:

  • Self-serve UI (low-code/no-code) UX
    • Monitor, detect, and resolve outliers in massive real-time data at ease
    • Interactive root-cause analysis helps to fast-track problem-solving
  • Statistical detection techniques helps in detecting
    • Global outliers (outliers far outside)
    • Contextual outliers (ex: seasonal data patterns)
    • Collective outliers (significant deviation from other data points)
  • Advanced anomaly detection configurations and intelligent alerts
    • Metrics and dimension level anomaly monitoring (single/multiple timeseries): Identify anomalies in massive and rapidly changing data by configuring one-time intelligent alerts for critical metrics
    • Anomaly filters: More control in the hands of the user to catch true anomalies and minimize false alarms
    • Create (no code) aggregated metrics (ex: sum/count) in ThirdEye for outlier identification
      • Generate metrics at different granularities
      • Generate different metrics (count,sum,distinct count, percentile etc)
      • Group metrics by different sets of dimensions
  • Cohort recommender
    • Recommends top contributors of cohorts (group of dimensions/metrics in a dataset) having significant deviation on a given KPI/metrics in a massive scale of data which is hard to find manually. Using point and click experience one can easily start monitoring these cohorts in no time.
  • Fast track problem solving (using root cause analysis)
    • Self-serve interactive UI
    • Identify key dimensions contributing to the outlier
    • Find the correlation with related metrics contributing to the outlier
    • Find the events contributing to the outlier
  • Modular architecture
    • Flexible architecture enables easy plug-in of time series data stores such as Apache Pinot and allows plug-ins with anomaly detection models/libraries

Key use-cases

Automated monitoring and root-cause analysis of User facing KPIs

  • Monitor, detect, and resolve outliers in user-facing insights/KPIs such as detecting outliers in product catalogs so that merchants can ensure the product catalog is stocked, priced, and marketed well for their products.

Automated monitoring and root-cause analysis of Business KPIs

  • Monitor, detect and resolve outliers in business-critical KPIs and identify key drivers impacting the business KPIs
    Example: a new successful marketing campaign that increased leads or a promotional discount that drove up sales, or a price glitch impacting revenue

Automated monitoring and root-cause analysis of Product KPIs

  • Monitor, detect, and resolve outliers related to KPIs used for improving Product experience or driving growth for the product Example: A new feature release or launch or software bugs or increase in # of active users that caused a sudden drop/increase in the user engagement KPIs (ex: # of views or # of monthly active users or paid users)
  • Monitor, detect, and resolve outliers in KPIs used to monitor overall data health and quality, such as the drop in data completeness, accuracy, freshness, and compliance stats

Automated monitoring and root-cause analysis of Systems KPIs

  • Monitor, detect, and resolve outliers related to KPIs used for ensuring system health of a platform or product, such as the spike in Cloud Costs, Cloud Failure, Infra performance
  • Monitor, detect, and resolve outliers related to KPIs for ensuring IoT system health, such as the spike in performance, data volumes, and uptime

What ThirdEye is not used for?

ThirdEye maintains a dedicated meta-data store to capture data sources, anomalies, and relationships between entities but does not store raw time series data. It relies on systems such as Pinot to obtain both realtime and historic time series data. You can use Data Manager to ingest data from various data sources to Pinot (Such as batch, real-time, CSV etc) ThirdEye does not replace your issue tracker - it integrates with it. ThirdEye supports collaboration but focuses on the data-integration aspect of anomaly detection and root-cause analysis. After all, your organization probably already has a well-oiled issue resolution process that we don't want to disrupt.
ThirdEye is not a generic dashboard builder toolkit. ThirdEye attempts to bring overview data from different sources into one single place on-demand. In-depth data about events, such as A/B experiments and deployments, should be kept in their respective systems. ThirdEye can link to these directly.