Compare commits

Home / Compare d9c4e696 .. 1c10d347

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.373-70.374=-0.001
σ0.060-0.059=0.001
min70.330-70.335=-0.005
max70.540-70.539=0.000
mean412.400-412.000=0.400
σ0.516-0.000=0.516
min412.000
max413.000-412.000=1.000
mean0.154-0.158=-0.005
σ0.004-0.005=-0.001
min0.149-0.150=-0.001
max0.159-0.166=-0.007
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.001
σ0.002-0.002=-0.001
min21.142-21.140=0.002
max21.148-21.147=0.001
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.064-0.065=-0.001
σ0.003-0.003=-0.000
min0.060-0.063=-0.003
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.199-1752.200=-0.001
σ0.360-0.363=-0.003
min1751.629-1751.626=0.003
max1752.785-1752.781=0.004
mean1648.550-1653.950=-5.400
σ617.499-646.173=-28.674
min656.000-630.000=26.000
max2485.000-2848.000=-363.000
mean2.804-2.842=-0.037
σ0.194-0.172=0.022
min2.208-2.316=-0.108
max3.031-3.060=-0.029

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.935-269.934=0.002
σ0.006-0.008=-0.002
min269.925-269.924=0.002
max269.942-269.944=-0.002
mean2485.000-2848.000=-363.000
σ0.000
min2485.000-2848.000=-363.000
max2485.000-2848.000=-363.000
mean0.384-0.372=0.012
σ0.006-0.005=0.001
min0.380-0.369=0.010
max0.394-0.381=0.013
iters=5
new-facts=1
prior-facts=6402
mean1930.389-1930.396=-0.008
σ0.020-0.004=0.016
min1930.359-1930.389=-0.030
max1930.407-1930.399=0.008
mean2485.000-2848.000=-363.000
σ0.000
min2485.000-2848.000=-363.000
max2485.000-2848.000=-363.000
mean2.528-2.593=-0.065
σ0.055-0.110=-0.054
min2.484-2.488=-0.004
max2.611-2.763=-0.153
iters=5
new-facts=6402
prior-facts=1
mean4750.830-4750.863=-0.032
σ0.838-0.876=-0.038
min4750.269-4750.396=-0.127
max4752.298-4752.426=-0.128
mean2485.000-2848.000=-363.000
σ0.000
min2485.000-2848.000=-363.000
max2485.000-2848.000=-363.000
mean8.724-8.567=0.157
σ0.330-0.561=-0.230
min8.454-7.658=0.796
max9.132-9.053=0.080
iters=5
new-facts=6402
prior-facts=6402
mean4941.332-4941.334=-0.002
σ0.082-0.077=0.004
min4941.266-4941.258=0.008
max4941.428-4941.425=0.003
mean2932.000-3098.400=-166.400
σ310.053-268.277=41.776
min2485.000-2848.000=-363.000
max3308.000-3380.000=-72.000
mean8.528-8.699=-0.171
σ0.155-0.392=-0.237
min8.423-8.393=0.030
max8.796-9.368=-0.572

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.761-1.107=0.654
σ0.160-0.080=0.081
min1.500-1.068=0.431
max1.886-1.250=0.637

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.905-465.913=-0.008
σ575.764-575.764=-0.000
min178.020-178.021=-0.002
max1329.550-1329.558=-0.008
mean81.750
σ7.500
min78.000
max93.000
mean2485.000-2848.000=-363.000
σ0.000
min2485.000-2848.000=-363.000
max2485.000-2848.000=-363.000
mean0.580-0.444=0.135
σ0.598-0.305=0.293
min0.278-0.291=-0.013
max1.477-0.902=0.575
policies=20
mean1780.446-1780.511=-0.065
σ0.350-0.356=-0.006
min1780.211-1780.247=-0.037
max1780.964-1781.029=-0.065
mean780.000
σ0.000
min780.000
max780.000
mean2485.000-2848.000=-363.000
σ0.000
min2485.000-2848.000=-363.000
max2485.000-2848.000=-363.000
mean2.781-2.852=-0.071
σ0.008-0.007=0.001
min2.769-2.844=-0.076
max2.787-2.861=-0.075
policies=200
mean17811.477-17811.583=-0.106
σ0.515-0.458=0.057
min17811.076-17811.292=-0.215
max17812.231-17812.263=-0.032
mean7800.000
σ0.000
min7800.000
max7800.000
mean2485.000-2848.000=-363.000
σ0.000
min2485.000-2848.000=-363.000
max2485.000-2848.000=-363.000
mean27.957-28.329=-0.373
σ0.056-0.546=-0.490
min27.903-27.684=0.219
max28.019-28.800=-0.781