Compare commits

Home / Compare 7e98ee6a .. 956420ef

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.391-70.390=0.001
σ0.046-0.046=0.000
min70.365-70.358=0.007
max70.520-70.518=0.003
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.160-0.157=0.003
σ0.004-0.005=-0.001
min0.152-0.150=0.002
max0.165-0.165=0.000
cache=y
dps=1
iters=10
policies=100
mean21.145-21.144=0.001
σ0.003-0.002=0.001
min21.141-21.142=-0.000
max21.150-21.147=0.003
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.061-0.064=-0.003
σ0.003-0.003=0.001
min0.057-0.063=-0.006
max0.067-0.072=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.396-1752.392=0.004
σ0.362-0.360=0.002
min1751.827-1751.821=0.005
max1752.975-1752.955=0.020
mean1632.050-1629.250=2.800
σ596.670-588.493=8.177
min625.000
max2411.000
mean2.817-2.819=-0.003
σ0.174-0.122=0.052
min2.263-2.532=-0.269
max3.043-3.002=0.042

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.241-270.238=0.003
σ0.007-0.007=0.000
min270.232-270.227=0.005
max270.250-270.244=0.006
mean2411.000
σ0.000
min2411.000
max2411.000
mean0.387-0.383=0.004
σ0.008-0.014=-0.006
min0.380-0.371=0.009
max0.397-0.408=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1930.699-1930.701=-0.002
σ0.012-0.011=0.001
min1930.681-1930.689=-0.008
max1930.711-1930.713=-0.003
mean2411.000
σ0.000
min2411.000
max2411.000
mean2.614-2.531=0.083
σ0.168-0.090=0.078
min2.433-2.457=-0.024
max2.847-2.641=0.206
iters=5
new-facts=6402
prior-facts=1
mean4751.363-4751.365=-0.001
σ0.969-0.904=0.065
min4750.877-4750.901=-0.023
max4753.094-4752.979=0.115
mean2411.000
σ0.000
min2411.000
max2411.000
mean8.887-8.710=0.177
σ0.334-0.342=-0.007
min8.485-8.248=0.237
max9.263-9.066=0.196
iters=5
new-facts=6402
prior-facts=6402
mean4941.869-4941.728=0.141
σ0.029-0.314=-0.286
min4941.839-4941.166=0.673
max4941.900-4941.881=0.019
mean3006.400-3021.400=-15.000
σ349.045-312.687=36.358
min2543.000-2607.000=-64.000
max3332.000-3424.000=-92.000
mean8.705-8.524=0.181
σ0.321-0.141=0.181
min8.433-8.383=0.051
max9.239-8.719=0.520

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.551-1.759=-0.208
σ0.216-0.110=0.105
min1.179-1.584=-0.405
max1.714-1.860=-0.146

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.363-466.360=0.003
σ575.926-575.915=0.011
min178.397-178.399=-0.002
max1330.252-1330.233=0.019
mean84.000
σ8.000
min80.000
max96.000
mean2411.000
σ0.000
min2411.000
max2411.000
mean0.563-0.566=-0.003
σ0.568-0.572=-0.004
min0.275-0.278=-0.002
max1.416-1.425=-0.009
policies=20
mean1784.296-1784.292=0.004
σ0.356-0.370=-0.014
min1784.066-1784.055=0.011
max1784.825-1784.841=-0.016
mean800.000
σ0.000
min800.000
max800.000
mean2411.000
σ0.000
min2411.000
max2411.000
mean2.786-2.786=0.000
σ0.024-0.010=0.014
min2.765-2.775=-0.010
max2.821-2.797=0.024
policies=200
mean17849.877-17849.801=0.076
σ0.490-0.528=-0.037
min17849.604-17849.440=0.164
max17850.612-17850.573=0.038
mean8000.000
σ0.000
min8000.000
max8000.000
mean2411.000
σ0.000
min2411.000
max2411.000
mean27.960-28.088=-0.129
σ0.069-0.080=-0.012
min27.861-27.985=-0.124
max28.010-28.164=-0.153