Compare commits

Home / Compare 266fca10 .. 2210753b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.376=-0.002
σ0.059-0.057=0.002
min70.334-70.340=-0.006
max70.538-70.534=0.003
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.158-0.158=-0.000
σ0.004-0.003=0.001
min0.151-0.156=-0.005
max0.164-0.164=0.000
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.000
σ0.003-0.002=0.001
min21.140-21.140=0.000
max21.148-21.146=0.002
mean418.000-413.000=5.000
σ0.000
min418.000-413.000=5.000
max418.000-413.000=5.000
mean0.065-0.063=0.002
σ0.002-0.004=-0.002
min0.063-0.058=0.005
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.199-1752.201=-0.002
σ0.363-0.360=0.002
min1751.626-1751.627=-0.001
max1752.791-1752.792=-0.001
mean1653.300-1659.700=-6.400
σ637.434-625.456=11.978
min647.000-682.000=-35.000
max2852.000-2740.000=112.000
mean2.777-2.822=-0.045
σ0.209-0.178=0.031
min2.169-2.163=0.007
max3.121-3.016=0.105

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.025-269.928=0.097
σ0.005-0.009=-0.004
min270.020-269.921=0.099
max270.033-269.944=0.090
mean2852.000-2740.000=112.000
σ0.000
min2852.000-2740.000=112.000
max2852.000-2740.000=112.000
mean0.380-0.373=0.007
σ0.003-0.005=-0.002
min0.377-0.369=0.008
max0.386-0.382=0.004
iters=5
new-facts=1
prior-facts=6402
mean1930.484-1930.387=0.098
σ0.020-0.022=-0.002
min1930.458-1930.354=0.105
max1930.503-1930.406=0.097
mean2852.000-2740.000=112.000
σ0.000
min2852.000-2740.000=112.000
max2852.000-2740.000=112.000
mean2.588-2.569=0.019
σ0.239-0.149=0.090
min2.380-2.463=-0.083
max2.984-2.808=0.176
iters=5
new-facts=6402
prior-facts=1
mean4751.033-4750.855=0.178
σ0.760-0.802=-0.042
min4750.550-4750.340=0.211
max4752.380-4752.264=0.116
mean2852.000-2740.000=112.000
σ0.000
min2852.000-2740.000=112.000
max2852.000-2740.000=112.000
mean8.043-8.518=-0.475
σ0.338-0.309=0.029
min7.687-8.249=-0.562
max8.491-8.891=-0.400
iters=5
new-facts=6402
prior-facts=6402
mean4941.416-4941.332=0.083
σ0.079-0.086=-0.006
min4941.349-4941.262=0.087
max4941.508-4941.429=0.079
mean3090.000-3028.400=61.600
σ310.919-268.738=42.180
min2852.000-2740.000=112.000
max3566.000-3400.000=166.000
mean8.410-8.528=-0.118
σ0.076-0.157=-0.082
min8.353-8.285=0.068
max8.537-8.665=-0.128

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.082-1.081=0.000
σ0.113-0.116=-0.003
min0.933-0.939=-0.006
max1.251-1.262=-0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.919-465.917=0.001
σ575.770-575.771=-0.001
min178.024-178.024=0.000
max1329.574-1329.574=0.000
mean81.750
σ7.500
min78.000
max93.000
mean2852.000-2740.000=112.000
σ0.000
min2852.000-2740.000=112.000
max2852.000-2740.000=112.000
mean0.442-0.542=-0.100
σ0.307-0.526=-0.219
min0.284-0.278=0.006
max0.903-1.331=-0.429
policies=20
mean1780.510-1780.478=0.032
σ0.357-0.355=0.002
min1780.256-1780.232=0.024
max1781.035-1781.004=0.030
mean780.000
σ0.000
min780.000
max780.000
mean2852.000-2740.000=112.000
σ0.000
min2852.000-2740.000=112.000
max2852.000-2740.000=112.000
mean2.848-2.777=0.071
σ0.018-0.017=0.001
min2.831-2.763=0.068
max2.872-2.797=0.075
policies=200
mean17811.440-17811.478=-0.039
σ0.539-0.363=0.177
min17811.095-17811.286=-0.191
max17812.243-17812.022=0.220
mean7800.000
σ0.000
min7800.000
max7800.000
mean2852.000-2740.000=112.000
σ0.000
min2852.000-2740.000=112.000
max2852.000-2740.000=112.000
mean28.263-27.961=0.303
σ0.474-0.111=0.363
min27.810-27.866=-0.056
max28.762-28.079=0.683