Compare commits

Home / Compare 24c5f225 .. b78c65e4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.047-53.837=0.211
σ0.368-0.367=0.002
min53.903-53.701=0.202
max55.095-54.879=0.215
mean418.000-414.700=3.300
σ0.000-0.483=-0.483
min418.000-414.000=4.000
max418.000-415.000=3.000
mean0.138-0.138=0.000
σ0.004-0.005=-0.001
min0.132-0.130=0.002
max0.145-0.148=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.341-43.208=0.133
σ0.005-0.005=-0.000
min43.333-43.202=0.131
max43.351-43.218=0.132
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.120-0.120=0.001
σ0.004-0.001=0.003
min0.114-0.118=-0.005
max0.128-0.121=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.200-1016.208=0.991
σ1.156-1.155=0.001
min1016.627-1015.632=0.995
max1022.041-1021.034=1.007
mean1063.350-1043.100=20.250
σ312.940-292.360=20.579
min593.000-576.000=17.000
max1633.000-1429.000=204.000
mean1.511-1.524=-0.013
σ0.067-0.062=0.005
min1.313-1.462=-0.148
max1.629-1.647=-0.017

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.074-301.200=0.875
σ0.209-0.218=-0.009
min301.945-301.013=0.932
max302.657-301.793=0.865
mean1949.000-2037.000=-88.000
σ0.000
min1949.000-2037.000=-88.000
max1949.000-2037.000=-88.000
mean0.558-0.548=0.010
σ0.042-0.037=0.005
min0.499-0.502=-0.003
max0.596-0.582=0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.801-301.475=2.326
σ0.034-0.057=-0.022
min303.762-301.382=2.379
max303.842-301.524=2.318
mean1633.000-1429.000=204.000
σ0.000
min1633.000-1429.000=204.000
max1633.000-1429.000=204.000
mean0.390-0.396=-0.005
σ0.002-0.007=-0.006
min0.389-0.391=-0.002
max0.393-0.409=-0.015
iters=5
new-facts=1
prior-facts=6402
mean1326.326-1324.065=2.262
σ0.098-0.113=-0.014
min1326.191-1323.929=2.262
max1326.442-1324.209=2.233
mean1633.000-1429.000=204.000
σ0.000
min1633.000-1429.000=204.000
max1633.000-1429.000=204.000
mean2.037-1.878=0.159
σ0.159-0.055=0.104
min1.878-1.800=0.078
max2.264-1.931=0.333
iters=5
new-facts=6402
prior-facts=1
mean1564.413-1562.068=2.345
σ6.921-6.927=-0.006
min1561.088-1558.762=2.327
max1576.788-1574.455=2.333
mean1633.000-1429.000=204.000
σ0.000
min1633.000-1429.000=204.000
max1633.000-1429.000=204.000
mean2.420-2.269=0.151
σ0.284-0.256=0.028
min2.161-2.062=0.099
max2.887-2.668=0.218
iters=5
new-facts=6402
prior-facts=6402
mean1894.289-1891.944=2.345
σ0.090-0.063=0.026
min1894.132-1891.855=2.277
max1894.356-1892.013=2.343
mean1780.000-1717.000=63.000
σ114.164-238.228=-124.063
min1633.000-1429.000=204.000
max1949.000-2037.000=-88.000
mean2.958-2.937=0.022
σ0.161-0.111=0.050
min2.819-2.866=-0.047
max3.216-3.133=0.083

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.193-1.692=-0.498
σ0.281-0.154=0.126
min0.947-1.428=-0.481
max1.630-1.801=-0.171

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.177-443.478=4.699
σ581.476-574.233=7.243
min157.434-156.355=1.079
max1320.391-1304.828=15.563
mean96.250
σ8.500
min92.000
max109.000
mean1633.000-1429.000=204.000
σ0.000
min1633.000-1429.000=204.000
max1633.000-1429.000=204.000
mean0.552-0.550=0.001
σ0.571-0.559=0.012
min0.263-0.263=0.000
max1.409-1.389=0.019
policies=20
mean1574.630-1563.888=10.743
σ0.338-0.340=-0.002
min1574.442-1563.666=10.776
max1575.138-1564.395=10.743
mean920.000
σ0.000
min920.000
max920.000
mean1633.000-1429.000=204.000
σ0.000
min1633.000-1429.000=204.000
max1633.000-1429.000=204.000
mean2.634-2.624=0.011
σ0.011-0.028=-0.017
min2.623-2.595=0.028
max2.649-2.660=-0.012
policies=200
mean15754.171-15646.958=107.213
σ0.050-0.049=0.001
min15754.098-15646.900=107.198
max15754.212-15647.019=107.193
mean9200.000
σ0.000
min9200.000
max9200.000
mean1633.000-1429.000=204.000
σ0.000
min1633.000-1429.000=204.000
max1633.000-1429.000=204.000
mean26.619-26.445=0.174
σ0.146-0.197=-0.052
min26.501-26.255=0.246
max26.801-26.699=0.102