Compare commits

Home / Compare 4b16702c .. 2f5d750f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.039-54.039=-0.001
σ0.369-0.371=-0.001
min53.900-53.897=0.003
max55.090-55.093=-0.004
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.139-0.140=-0.001
σ0.005-0.004=0.001
min0.131-0.136=-0.005
max0.149-0.148=0.001
cache=y
dps=1
iters=10
policies=100
mean43.341-43.341=0.000
σ0.007-0.006=0.000
min43.333-43.330=0.003
max43.353-43.353=-0.000
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.122-0.121=0.002
σ0.003-0.004=-0.001
min0.120-0.116=0.004
max0.127-0.126=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.203-1017.207=-0.005
σ1.164-1.166=-0.002
min1016.631-1016.627=0.004
max1022.079-1022.086=-0.007
mean1058.900-1058.950=-0.050
σ312.839-316.137=-3.298
min578.000-556.000=22.000
max1629.000-1516.000=113.000
mean1.531-1.549=-0.018
σ0.048-0.064=-0.016
min1.481-1.483=-0.001
max1.633-1.676=-0.043

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.094-301.894=0.200
σ0.235-0.249=-0.013
min301.890-301.749=0.141
max302.694-302.591=0.103
mean2049.000-2064.000=-15.000
σ0.000
min2049.000-2064.000=-15.000
max2049.000-2064.000=-15.000
mean0.602-0.600=0.002
σ0.005-0.008=-0.003
min0.594-0.581=0.013
max0.609-0.610=-0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.790-303.784=0.006
σ0.050-0.056=-0.006
min303.721-303.700=0.020
max303.845-303.844=0.001
mean1629.000-1516.000=113.000
σ0.000
min1629.000-1516.000=113.000
max1629.000-1516.000=113.000
mean0.392-0.394=-0.002
σ0.002-0.001=0.001
min0.390-0.393=-0.003
max0.395-0.395=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1326.330-1326.335=-0.005
σ0.102-0.112=-0.010
min1326.197-1326.191=0.005
max1326.450-1326.470=-0.020
mean1629.000-1516.000=113.000
σ0.000
min1629.000-1516.000=113.000
max1629.000-1516.000=113.000
mean1.954-1.945=0.009
σ0.119-0.102=0.017
min1.831-1.826=0.005
max2.087-2.049=0.038
iters=5
new-facts=6402
prior-facts=1
mean1564.392-1564.431=-0.039
σ6.909-6.868=0.041
min1561.110-1561.176=-0.066
max1576.748-1576.713=0.034
mean1629.000-1516.000=113.000
σ0.000
min1629.000-1516.000=113.000
max1629.000-1516.000=113.000
mean2.327-2.360=-0.032
σ0.306-0.250=0.056
min2.048-2.025=0.023
max2.664-2.619=0.045
iters=5
new-facts=6402
prior-facts=6402
mean1894.273-1894.283=-0.010
σ0.065-0.072=-0.007
min1894.160-1894.159=0.001
max1894.321-1894.337=-0.016
mean1773.400-1772.400=1.000
σ175.768-223.528=-47.760
min1629.000-1516.000=113.000
max2049.000-2064.000=-15.000
mean2.995-3.069=-0.074
σ0.188-0.138=0.050
min2.847-2.889=-0.043
max3.302-3.241=0.060

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.267-1.465=-0.198
σ0.327-0.242=0.085
min0.954-1.188=-0.235
max1.809-1.753=0.056

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.061-448.044=0.018
σ581.236-581.224=0.012
min157.436-157.430=0.006
max1319.916-1319.880=0.036
mean96.250
σ8.500
min92.000
max109.000
mean1629.000-1516.000=113.000
σ0.000
min1629.000-1516.000=113.000
max1629.000-1516.000=113.000
mean0.549-0.540=0.009
σ0.562-0.550=0.011
min0.265-0.264=0.002
max1.391-1.365=0.026
policies=20
mean1574.624-1574.590=0.034
σ0.345-0.358=-0.013
min1574.410-1574.357=0.053
max1575.139-1575.124=0.015
mean920.000
σ0.000
min920.000
max920.000
mean1629.000-1516.000=113.000
σ0.000
min1629.000-1516.000=113.000
max1629.000-1516.000=113.000
mean2.632-2.650=-0.018
σ0.008-0.008=0.000
min2.625-2.640=-0.015
max2.640-2.659=-0.019
policies=200
mean15754.210-15754.095=0.115
σ0.132-0.081=0.051
min15754.108-15754.019=0.089
max15754.404-15754.193=0.212
mean9200.000
σ0.000
min9200.000
max9200.000
mean1629.000-1516.000=113.000
σ0.000
min1629.000-1516.000=113.000
max1629.000-1516.000=113.000
mean26.739-26.852=-0.112
σ0.109-0.182=-0.072
min26.627-26.676=-0.048
max26.840-27.077=-0.236