Compare commits

Home / Compare 27a2c2b2 .. 502d30fd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.049-54.047=0.002
σ0.369-0.370=-0.001
min53.908-53.906=0.002
max55.100-55.099=0.001
mean417.000
σ0.000
min417.000
max417.000
mean0.139-0.138=0.001
σ0.004-0.005=-0.001
min0.136-0.131=0.005
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.343-43.342=0.001
σ0.007-0.007=0.000
min43.331-43.328=0.003
max43.357-43.353=0.004
mean417.000
σ0.000
min417.000
max417.000
mean0.123-0.122=0.001
σ0.003-0.004=-0.001
min0.119-0.115=0.004
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.196-1017.202=-0.006
σ1.165-1.147=0.018
min1016.625-1016.624=0.001
max1022.080-1021.997=0.082
mean1056.750-1061.400=-4.650
σ316.477-312.308=4.169
min590.000-591.000=-1.000
max1612.000-1631.000=-19.000
mean1.532-1.504=0.028
σ0.095-0.065=0.030
min1.424-1.345=0.079
max1.785-1.657=0.128

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.036-302.023=0.013
σ0.232-0.187=0.045
min301.907-301.871=0.036
max302.685-302.491=0.194
mean2068.000-1962.000=106.000
σ0.000
min2068.000-1962.000=106.000
max2068.000-1962.000=106.000
mean0.508-0.595=-0.087
σ0.008-0.014=-0.006
min0.497-0.557=-0.061
max0.521-0.610=-0.089

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.796-303.790=0.006
σ0.047-0.059=-0.012
min303.727-303.694=0.033
max303.852-303.848=0.003
mean1612.000-1631.000=-19.000
σ0.000
min1612.000-1631.000=-19.000
max1612.000-1631.000=-19.000
mean0.397-0.398=-0.001
σ0.008-0.007=0.001
min0.391-0.392=-0.000
max0.411-0.408=0.003
iters=5
new-facts=1
prior-facts=6402
mean1326.325-1326.319=0.006
σ0.114-0.117=-0.003
min1326.188-1326.193=-0.004
max1326.443-1326.478=-0.034
mean1612.000-1631.000=-19.000
σ0.000
min1612.000-1631.000=-19.000
max1612.000-1631.000=-19.000
mean1.921-1.967=-0.047
σ0.092-0.125=-0.033
min1.821-1.835=-0.013
max2.029-2.144=-0.114
iters=5
new-facts=6402
prior-facts=1
mean1564.384-1564.395=-0.011
σ6.907-6.933=-0.026
min1561.077-1561.041=0.036
max1576.734-1576.791=-0.057
mean1612.000-1631.000=-19.000
σ0.000
min1612.000-1631.000=-19.000
max1612.000-1631.000=-19.000
mean2.264-2.381=-0.116
σ0.223-0.306=-0.083
min2.013-2.034=-0.022
max2.563-2.784=-0.221
iters=5
new-facts=6402
prior-facts=6402
mean1894.275-1894.288=-0.013
σ0.062-0.071=-0.009
min1894.167-1894.162=0.005
max1894.313-1894.328=-0.015
mean1764.400-1778.400=-14.000
σ194.774-119.937=74.837
min1612.000-1631.000=-19.000
max2068.000-1962.000=106.000
mean2.978-2.988=-0.009
σ0.168-0.138=0.030
min2.847-2.870=-0.023
max3.267-3.209=0.058

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.313-1.309=0.003
σ0.365-0.371=-0.006
min0.937-0.949=-0.011
max1.832-1.880=-0.048

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.342-448.178=0.164
σ581.801-581.473=0.328
min157.433-157.437=-0.004
max1321.044-1320.387=0.656
mean96.250
σ8.500
min92.000
max109.000
mean1612.000-1631.000=-19.000
σ0.000
min1612.000-1631.000=-19.000
max1612.000-1631.000=-19.000
mean0.533-0.540=-0.007
σ0.538-0.554=-0.015
min0.257-0.262=-0.005
max1.340-1.371=-0.030
policies=20
mean1574.612-1574.613=-0.000
σ0.321-0.332=-0.011
min1574.419-1574.415=0.004
max1575.092-1575.110=-0.017
mean920.000
σ0.000
min920.000
max920.000
mean1612.000-1631.000=-19.000
σ0.000
min1612.000-1631.000=-19.000
max1612.000-1631.000=-19.000
mean2.606-2.618=-0.012
σ0.021-0.009=0.012
min2.578-2.610=-0.032
max2.627-2.629=-0.002
policies=200
mean15754.265-15754.189=0.076
σ0.068-0.086=-0.018
min15754.193-15754.119=0.074
max15754.346-15754.305=0.041
mean9200.000
σ0.000
min9200.000
max9200.000
mean1612.000-1631.000=-19.000
σ0.000
min1612.000-1631.000=-19.000
max1612.000-1631.000=-19.000
mean26.598-26.707=-0.109
σ0.128-0.304=-0.175
min26.474-26.442=0.032
max26.712-26.982=-0.270