Compare commits

Home / Compare cb5e6c43 .. a8d87182

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.056=-0.001
σ0.370-0.369=0.001
min53.910-53.910=0.000
max55.107-55.107=0.001
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.140-0.142=-0.001
σ0.005-0.004=0.001
min0.133-0.138=-0.004
max0.148-0.147=0.001
cache=y
dps=1
iters=10
policies=100
mean43.393-43.392=0.001
σ0.006-0.006=-0.000
min43.386-43.383=0.003
max43.401-43.401=-0.001
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.120-0.121=-0.001
σ0.003-0.006=-0.002
min0.114-0.114=-0.001
max0.125-0.132=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.001-1007.006=-0.005
σ1.206-1.188=0.018
min1006.464-1006.433=0.031
max1012.057-1011.982=0.075
mean1055.600-1047.950=7.650
σ319.973-306.673=13.301
min574.000-588.000=-14.000
max1621.000-1648.000=-27.000
mean1.576-1.553=0.023
σ0.078-0.076=0.002
min1.499-1.389=0.110
max1.841-1.679=0.162

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean0.419-0.415=0.005
σ0.164-0.134=0.030
min0.327-0.327=0.000
max0.711-0.652=0.059
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean0.883-0.885=-0.002
σ0.092-0.085=0.007
min0.808-0.829=-0.021
max1.042-1.034=0.009
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean0.526-0.528=-0.002
σ0.053-0.046=0.007
min0.480-0.494=-0.014
max0.610-0.607=0.003
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean0.853-0.846=0.007
σ0.030-0.036=-0.006
min0.826-0.808=0.018
max0.904-0.902=0.002

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.830-964.840=-0.010
σ0.025-0.034=-0.009
min964.802-964.812=-0.010
max964.863-964.895=-0.033
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean0.840-0.815=0.026
σ0.024-0.042=-0.017
min0.813-0.777=0.036
max0.870-0.861=0.009
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.005-0.007=-0.002
min885.504-885.505=-0.001
max885.517-885.523=-0.006
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean0.707-0.722=-0.015
σ0.034-0.030=0.004
min0.672-0.668=0.004
max0.742-0.736=0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.719=0.003
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean3.549-3.508=0.042
σ0.090-0.075=0.015
min3.378-3.378=0.000
max3.912-3.825=0.087
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean3.546-3.470=0.076
σ0.090-0.061=0.029
min3.413-3.363=0.049
max3.939-3.713=0.226
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean0.645-0.740=-0.094
σ0.106-0.021=0.085
min0.518-0.625=-0.106
max0.849-0.835=0.013
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean0.514-0.700=-0.185
σ0.041-0.016=0.025
min0.491-0.668=-0.176
max0.908-0.778=0.130

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.965-296.879=0.086
σ0.228-0.222=0.006
min296.723-296.717=0.007
max297.561-297.493=0.068
mean1907.000-2031.000=-124.000
σ0.000
min1907.000-2031.000=-124.000
max1907.000-2031.000=-124.000
mean0.584-0.574=0.010
σ0.046-0.034=0.013
min0.513-0.510=0.002
max0.673-0.605=0.069

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.826-286.820=0.007
σ0.039-0.037=0.001
min286.777-286.771=0.007
max286.865-286.859=0.006
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean0.396-0.396=0.001
σ0.007-0.005=0.001
min0.389-0.390=-0.002
max0.402-0.403=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1297.270-1297.273=-0.003
σ0.084-0.093=-0.009
min1297.164-1297.139=0.024
max1297.380-1297.386=-0.006
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean2.192-2.253=-0.062
σ0.037-0.070=-0.034
min2.140-2.174=-0.034
max2.230-2.366=-0.136
iters=5
new-facts=6402
prior-facts=1
mean1541.381-1541.362=0.019
σ6.815-6.807=0.007
min1538.189-1538.182=0.006
max1553.568-1553.537=0.031
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean2.328-2.277=0.050
σ0.161-0.212=-0.051
min2.139-2.101=0.038
max2.498-2.608=-0.110
iters=5
new-facts=6402
prior-facts=6402
mean1859.113-1859.125=-0.012
σ0.065-0.057=0.008
min1859.028-1859.040=-0.012
max1859.192-1859.177=0.015
mean1768.600-1782.000=-13.400
σ135.686-166.384=-30.697
min1621.000-1648.000=-27.000
max1907.000-2031.000=-124.000
mean3.108-2.935=0.173
σ0.241-0.167=0.074
min2.870-2.676=0.194
max3.454-3.103=0.351

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.354-1.232=0.122
σ0.370-0.270=0.100
min0.942-0.930=0.012
max1.791-1.567=0.224

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.819-448.821=-0.001
σ581.372-581.372=-0.000
min158.132-158.133=-0.001
max1320.877-1320.879=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean0.532-0.554=-0.022
σ0.534-0.576=-0.042
min0.263-0.264=-0.001
max1.332-1.418=-0.085
policies=20
mean1581.605-1581.610=-0.004
σ0.364-0.359=0.005
min1581.357-1581.371=-0.014
max1582.145-1582.143=0.002
mean920.000
σ0.000
min920.000
max920.000
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean2.635-2.645=-0.011
σ0.011-0.016=-0.005
min2.623-2.629=-0.006
max2.649-2.662=-0.013
policies=200
mean15824.207-15824.114=0.093
σ0.157-0.140=0.018
min15824.067-15823.966=0.101
max15824.431-15824.255=0.176
mean9200.000
σ0.000
min9200.000
max9200.000
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean26.668-26.709=-0.042
σ0.054-0.091=-0.037
min26.618-26.621=-0.002
max26.744-26.788=-0.044