Metrics Community Benchmarks

Metrics Community Benchmarks

The LinearB Engineering Metrics Benchmarks were created from a study of 3,694,690 pull requests from 2,022 dev organizations, spanning over 103,807 active contributors. For the first time since DORA published their research in 2014, engineering teams are able to benchmark their performance against data-backed industry standards. Continue reading to learn more about our data collection and metric calculations here.

We define 4 categories of quality:

What is the difference between average and 75th percentile?

Measuring your organization's cycle time from the 75th percentile is LinearB's recommendation for the most effective method of finding a balanced representation of your organization's general cycle time, while not being impacted by outliers.

Average Calculation:

(Sum of branch times or PR sizes) / (Number of branch times or PR sizes)

75th Percentile Calculation:

(75% are shorter) → 75th Percentile ← (25% are longer)

You can set your LinearB instance to report in either average, median or the 75th percentile in metrics in your account settings. Read more about this feature here: Changing your metrics from average to median or percentile

Where to see your benchmarks

Benchmark indicators are visible on team dashboards as well as in Metrics reports. The main team dashboard will show your overall cycle-time against LinearB's benchmarks. You can see benchmark performance against individual portions of cycle time as well as other metrics

Dashboard View

When enabled a benchmark icon will appear next to the cycle-time metric in a team dashboard.

Metrics Report View

Metrics reports allow you to see your team performance against benchmarks on a metric by metric level. You can even combine multiple teams in a metrics dashboard and see the average performance of the teams against LinearB benchmarks. LinearB benchmarks are available on the following metrics:

• Cycle Time
• Coding Time
• Pickup Time
• Review time
• Deploy Time
• Deploy Frequency
• Merge Frequency
• PR Size
• Rework Rate
• MTTR
• CFR
• Refactor

Enabling and disabling benchmarks

We understand that benchmarks won't apply or be constructive for all teams. To disable the benchmarks icons for a specific team, go to Team Settings -> General to switch off Engineering Metrics Benchmarks. Make sure to click Save after disabling benchmarks.