Compare commits

Home / Compare 9d9d12b7 .. 468077b6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.971-53.837=0.135
σ0.368-0.369=-0.001
min53.825-53.692=0.133
max55.018-54.886=0.131
mean419.000-422.000=-3.000
σ0.000
min419.000-422.000=-3.000
max419.000-422.000=-3.000
mean0.139-0.138=0.000
σ0.004-0.003=0.001
min0.135-0.132=0.003
max0.145-0.142=0.004
cache=y
dps=1
iters=10
policies=100
mean43.343-43.208=0.135
σ0.006-0.006=-0.000
min43.336-43.200=0.136
max43.354-43.220=0.134
mean419.000-422.000=-3.000
σ0.000
min419.000-422.000=-3.000
max419.000-422.000=-3.000
mean0.121-0.119=0.003
σ0.004-0.003=0.001
min0.119-0.113=0.006
max0.129-0.123=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.896-1016.207=0.690
σ1.159-1.168=-0.009
min1016.322-1015.631=0.690
max1021.747-1021.095=0.652
mean1066.150-1053.600=12.550
σ317.259-311.247=6.011
min606.000-562.000=44.000
max1631.000-1517.000=114.000
mean1.526-1.537=-0.011
σ0.088-0.049=0.039
min1.369-1.472=-0.103
max1.798-1.634=0.164

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.060-301.222=0.838
σ0.262-0.180=0.082
min301.833-301.096=0.737
max302.759-301.706=1.053
mean2028.000-2008.000=20.000
σ0.000
min2028.000-2008.000=20.000
max2028.000-2008.000=20.000
mean0.589-0.563=0.026
σ0.025-0.031=-0.006
min0.520-0.500=0.020
max0.608-0.605=0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.507-301.475=2.031
σ0.068-0.057=0.011
min303.397-301.383=2.014
max303.568-301.531=2.037
mean1631.000-1517.000=114.000
σ0.000
min1631.000-1517.000=114.000
max1631.000-1517.000=114.000
mean0.390-0.390=-0.000
σ0.002-0.001=0.001
min0.387-0.389=-0.002
max0.392-0.391=0.001
iters=5
new-facts=1
prior-facts=6402
mean1326.059-1324.065=1.995
σ0.111-0.113=-0.002
min1325.920-1323.925=1.995
max1326.199-1324.204=1.995
mean1631.000-1517.000=114.000
σ0.000
min1631.000-1517.000=114.000
max1631.000-1517.000=114.000
mean1.901-1.872=0.029
σ0.090-0.055=0.035
min1.831-1.815=0.016
max2.041-1.954=0.086
iters=5
new-facts=6402
prior-facts=1
mean1564.115-1562.072=2.043
σ6.926-6.898=0.028
min1560.765-1558.755=2.010
max1576.498-1574.405=2.092
mean1631.000-1517.000=114.000
σ0.000
min1631.000-1517.000=114.000
max1631.000-1517.000=114.000
mean2.355-2.262=0.094
σ0.292-0.185=0.107
min2.109-2.029=0.081
max2.784-2.503=0.281
iters=5
new-facts=6402
prior-facts=6402
mean1894.015-1891.970=2.044
σ0.069-0.066=0.003
min1893.895-1891.854=2.040
max1894.066-1892.009=2.056
mean1759.400-1725.800=33.600
σ170.948-207.106=-36.157
min1631.000-1517.000=114.000
max2028.000-2008.000=20.000
mean2.935-3.027=-0.092
σ0.115-0.367=-0.252
min2.840-2.816=0.023
max3.131-3.680=-0.549

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.225-1.476=-0.252
σ0.274-0.327=-0.052
min1.007-1.049=-0.043
max1.535-1.787=-0.252

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.704-443.478=1.226
σ575.143-574.230=0.913
min157.125-156.362=0.763
max1307.419-1304.824=2.595
mean96.250
σ8.500
min92.000
max109.000
mean1631.000-1517.000=114.000
σ0.000
min1631.000-1517.000=114.000
max1631.000-1517.000=114.000
mean0.527-0.533=-0.006
σ0.528-0.549=-0.021
min0.262-0.256=0.006
max1.318-1.356=-0.038
policies=20
mean1571.553-1563.892=7.661
σ0.336-0.346=-0.011
min1571.350-1563.675=7.675
max1572.055-1564.409=7.646
mean920.000
σ0.000
min920.000
max920.000
mean1631.000-1517.000=114.000
σ0.000
min1631.000-1517.000=114.000
max1631.000-1517.000=114.000
mean2.624-2.625=-0.001
σ0.018-0.010=0.008
min2.608-2.613=-0.005
max2.648-2.636=0.013
policies=200
mean15723.338-15646.948=76.390
σ0.059-0.147=-0.088
min15723.261-15646.820=76.441
max15723.402-15647.093=76.308
mean9200.000
σ0.000
min9200.000
max9200.000
mean1631.000-1517.000=114.000
σ0.000
min1631.000-1517.000=114.000
max1631.000-1517.000=114.000
mean26.456-26.497=-0.041
σ0.142-0.113=0.029
min26.278-26.397=-0.120
max26.584-26.615=-0.031