Histoboard
Back to Benchmarks

Sinai SSL Benchmark
pathology
H&E

Comprehensive benchmark from Mount Sinai evaluating pathology foundation models on cancer detection and biomarker prediction tasks across multiple organs and institutions.

11 models evaluated
22 tasks
Organs:
breast
oral
bladder
kidney
thyroid
prostate
colorectal
lung
skin

Detailed Results

Model
Average
rank
Average
metric
MSHS BCa ER
breast
MSHS BCa HER2
breast
MSHS BCa PR
breast
MSHS BioMe HRD
breast
MSHS Bladder
bladder
MSHS Breast
breast
MSHS Colorectal
colorectal
MSHS DCIS
breast
MSHS IBD
colorectal
MSHS Kidney
kidney
MSHS LUAD EGFR
lung
MSHS Oral
oral
MSHS Prostate
prostate
MSHS Thyroid
thyroid
MSKCC LUAD ALK
lung
MSKCC LUAD EGFR
lung
MSKCC LUAD KRAS
lung
MSKCC LUAD STK11
lung
MSKCC LUAD TP53
lung
MSKCC NSCLC IO
lung
SUH Melanoma BRAF
skin
SUH Melanoma NRAS
skin
1H-optimus-0
2.050.865
0.973±0.008
0.860±0.026
0.937±0.010
0.695±0.152
0.963±0.017
0.981±0.007
0.974±0.029
0.992±0.006
0.980±0.008
0.973±0.009
0.829±0.047
0.991±0.018
0.991±0.005
0.975±0.013
0.821±0.044
0.823±0.030
0.711±0.031
0.874±0.030
0.732±0.031
0.596±0.069
0.705±0.053
0.650±0.049
2Prov-GigaPath
3.590.860
0.972±0.008
0.831±0.027
0.925±0.011
0.741±0.097
0.958±0.016
0.979±0.009
0.974±0.026
0.983±0.017
0.980±0.006
0.970±0.009
0.821±0.039
0.993±0.013
0.991±0.006
0.974±0.011
0.813±0.042
0.812±0.028
0.730±0.030
0.868±0.036
0.757±0.028
0.562±0.060
0.651±0.052
0.625±0.068
3UNI
3.090.857
0.970±0.009
0.830±0.024
0.929±0.012
0.727±0.129
0.954±0.018
0.981±0.007
0.970±0.028
0.992±0.010
0.973±0.008
0.971±0.009
0.797±0.041
0.992±0.016
0.992±0.005
0.977±0.010
0.789±0.045
0.795±0.039
0.716±0.031
0.843±0.034
0.746±0.032
0.607±0.053
0.698±0.051
0.608±0.060
4Virchow2
4.820.846
0.970±0.007
0.836±0.023
0.912±0.011
0.703±0.092
0.964±0.016
0.978±0.008
0.970±0.027
0.989±0.014
0.973±0.010
0.971±0.010
0.792±0.054
0.994±0.013
0.990±0.007
0.968±0.015
0.778±0.053
0.766±0.038
0.694±0.037
0.808±0.048
0.706±0.027
0.578±0.055
0.671±0.063
0.611±0.053
5Phikon
5.950.846
0.966±0.009
0.812±0.033
0.925±0.013
0.711±0.117
0.950±0.017
0.977±0.007
0.966±0.028
0.988±0.012
0.967±0.010
0.965±0.008
0.763±0.053
0.992±0.012
0.989±0.008
0.972±0.011
0.782±0.046
0.760±0.039
0.683±0.029
0.824±0.032
0.743±0.031
0.573±0.047
0.668±0.057
0.635±0.070
6Phikon-v2
6.680.844
0.964±0.008
0.807±0.029
0.913±0.014
0.813±0.104
0.960±0.015
0.978±0.008
0.969±0.027
0.989±0.010
0.961±0.011
0.967±0.008
0.754±0.052
0.990±0.013
0.988±0.006
0.970±0.010
0.761±0.040
0.765±0.036
0.671±0.018
0.803±0.038
0.728±0.030
0.541±0.070
0.671±0.053
0.608±0.056
7SP85M
5.500.838
0.965±0.010
0.802±0.023
0.926±0.013
0.718±0.099
0.961±0.015
0.981±0.007
0.973±0.024
0.985±0.018
0.975±0.009
0.972±0.009
0.745±0.043
0.987±0.018
0.992±0.006
0.975±0.014
0.736±0.053
0.755±0.034
0.677±0.027
0.813±0.054
0.705±0.032
0.503±0.039
0.653±0.052
0.633±0.069
8SP22M
6.910.835
0.967±0.009
0.814±0.021
0.926±0.011
0.685±0.113
0.954±0.016
0.980±0.009
0.972±0.023
0.985±0.012
0.975±0.007
0.970±0.010
0.725±0.059
0.989±0.013
0.990±0.006
0.973±0.012
0.742±0.049
0.753±0.030
0.667±0.020
0.811±0.049
0.703±0.028
0.525±0.058
0.650±0.043
0.609±0.062
9Virchow
7.320.833
0.968±0.008
0.825±0.026
0.918±0.012
0.702±0.099
0.949±0.022
0.978±0.006
0.970±0.030
0.984±0.015
0.965±0.010
0.965±0.011
0.767±0.052
0.992±0.014
0.992±0.005
0.975±0.012
0.747±0.041
0.755±0.042
0.658±0.020
0.785±0.059
0.702±0.024
0.527±0.060
0.607±0.052
0.590±0.061
10CTransPath
9.270.825
0.949±0.009
0.803±0.023
0.896±0.013
0.672±0.140
0.950±0.023
0.969±0.011
0.963±0.027
0.974±0.025
0.956±0.009
0.962±0.009
0.718±0.051
0.987±0.012
0.983±0.011
0.971±0.013
0.732±0.049
0.739±0.037
0.633±0.032
0.799±0.042
0.708±0.029
0.556±0.044
0.655±0.090
0.575±0.055
11ResNet50 (ImageNet)
10.820.773
0.912±0.022
0.772±0.039
0.838±0.027
0.545±0.138
0.938±0.027
0.932±0.013
0.950±0.022
0.951±0.034
0.939±0.020
0.952±0.012
0.594±0.057
0.966±0.024
0.985±0.007
0.968±0.013
0.625±0.062
0.649±0.031
0.546±0.062
0.657±0.061
0.658±0.043
0.537±0.077
0.567±0.060
0.530±0.058