Skip to main content

Evaluation Metrics

Evaluation Metrics

AUROC ranges from 0 to 1. The higher the AUROC, the better the overall performance of the algorithm.

Single-lead

Sample size: approximately 47,000 cases, with an average length of 30 seconds per single-lead ECG.

Data source: data collected from HeartVoice equipment.

Annotation method: cardiologists/physicians from tertiary hospitals annotated the data.

Test results (AUROC)

Diagnosis conclusionLabelAUROC
Sinus rhythmSN0.826
Sinus rhythm irregularSNA0.94
Sinus tachycardiaSNT0.988
Sinus bradycardiaSNB0.993
Premature ventricular contractionPVC0.975
Premature atrial contractionPAC0.967
Ventricular tachycardiaVT0.748
Supraventricular tachycardiaSVT0.968
Atrial fibrillationAF0.988
Atrial flutterAFL0.93
Atrioventricular re-entrant syndrome / pre-excitation syndromeWPW0.812
Junctional escape beatAE0.921
Supraventricular escape beatJE0.903
First-degree atrioventricular blockAVBI0.967
Second-degree atrioventricular blockAVBII0.876
Third-degree atrioventricular blockAVBIII0.997
Left bundle branch blockLBBB0.845
Right bundle branch blockRBBB0.945

12-lead

Sample size: approximately 60,000 cases, with an average length of 30 seconds per 12-lead ECG.

Data source: 5 datasets.

Annotation method: unknown.

Test results (AUROC)

Multi-dataset comparison results

ClassPTB-XLningbochapman_shaoxinggeorgiaCINC2021
SN0.78840.9130.94790.90410.7951
N0.47980.6790.71630.59120.6445
SNA0.07570.15480.13940.09920.1423
SNT0.50150.40050.65870.38730.5168
SNB0.51410.83650.38180.52160.4443
PVC0.94710.82650.52890.85830.7811
PVCB0.77180.61020.71940.7020.7548
PVCT0.58930.6740.90520.69740.6713
PACB0.86620.83450.73770.89170.8157
PJC0.91490.84740.5360.88990.6969
PSCB0.75490.79640.87770.40620.7847
VT0.80150.8630.92810.99230.8989
AFL0.71010.6420.75950.55750.7015
VF0.67350.6380.69080.84780.6601
VFL0.61470.80930.76820.65630.644
WPW0.54570.88180.77440.70650.6801
AE0.54710.87780.57880.64990.5028
VE0.67210.69640.64210.95520.612
JE0.92210.83360.80590.85640.8292
SE0.80660.80910.68150.73450.7907
AVBI0.51630.61690.64430.70690.5473
AVBII0.69260.93970.95740.7860.806
AVBIII0.71340.88620.33930.39610.6623
LBBB0.66760.65840.360.75070.6651
ILBBB0.66590.79610.52490.82080.7602
LAFB0.69480.76280.57890.85070.6323
LPFB0.51430.6910.67910.67510.6168
RBBB0.72930.79920.74020.65540.743

DeepLife

This DeepLife interface showcases core information for 11 common infectious diseases and the model’s recognition performance for these diseases:

ICD coding: the internationally standardized disease coding system, helping identify diseases precisely.

Positive/negative sample counts: the number of confirmed cases for the disease (positive) and the number of non-cases (negative).

AUC value: a metric measuring how well the model recognizes whether the patient has the disease (range 0–1). A higher score means better recognition.

For detailed data, download the reference material below.

Reference material (DeepLife data)

Next steps