Compare commits

Home / Compare a4cdfb88 .. f1c4bade

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.375-70.376=-0.002
σ0.060-0.057=0.003
min70.333-70.340=-0.007
max70.541-70.537=0.005
mean411.900-415.000=-3.100
σ0.316-0.000=0.316
min411.000-415.000=-4.000
max412.000-415.000=-3.000
mean0.160-0.160=0.001
σ0.003-0.005=-0.002
min0.152-0.151=0.001
max0.165-0.168=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.000
σ0.003-0.002=0.000
min21.140-21.141=-0.000
max21.148-21.147=0.001
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.064-0.064=0.001
σ0.002-0.003=-0.000
min0.063-0.059=0.004
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.202-1752.200=0.002
σ0.361-0.361=0.001
min1751.625-1751.632=-0.007
max1752.780-1752.786=-0.006
mean1634.600-1650.550=-15.950
σ616.554-641.319=-24.765
min643.000-633.000=10.000
max2468.000-2857.000=-389.000
mean2.862-2.811=0.051
σ0.143-0.112=0.032
min2.673-2.572=0.101
max3.351-2.976=0.375

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.938-269.933=0.005
σ0.005-0.009=-0.003
min269.931-269.920=0.011
max269.944-269.944=-0.000
mean2468.000-2857.000=-389.000
σ0.000
min2468.000-2857.000=-389.000
max2468.000-2857.000=-389.000
mean0.386-0.375=0.010
σ0.008-0.008=0.000
min0.379-0.369=0.009
max0.396-0.386=0.010
iters=5
new-facts=1
prior-facts=6402
mean1930.397-1930.398=-0.001
σ0.008-0.018=-0.009
min1930.385-1930.367=0.019
max1930.406-1930.408=-0.003
mean2468.000-2857.000=-389.000
σ0.000
min2468.000-2857.000=-389.000
max2468.000-2857.000=-389.000
mean2.518-2.490=0.028
σ0.041-0.060=-0.019
min2.479-2.446=0.033
max2.571-2.592=-0.021
iters=5
new-facts=6402
prior-facts=1
mean4750.899-4750.733=0.166
σ0.847-0.889=-0.042
min4750.454-4750.020=0.434
max4752.413-4752.266=0.148
mean2468.000-2857.000=-389.000
σ0.000
min2468.000-2857.000=-389.000
max2468.000-2857.000=-389.000
mean8.390-8.610=-0.220
σ0.563-0.294=0.269
min7.732-8.322=-0.590
max9.094-9.061=0.033
iters=5
new-facts=6402
prior-facts=6402
mean4941.330-4941.322=0.008
σ0.090-0.097=-0.007
min4941.260-4941.239=0.021
max4941.431-4941.431=-0.000
mean2980.200-3057.400=-77.200
σ284.150-202.554=81.596
min2591.000-2857.000=-266.000
max3315.000-3333.000=-18.000
mean8.477-8.564=-0.087
σ0.103-0.229=-0.126
min8.377-8.340=0.036
max8.635-8.825=-0.190

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.797-0.989=0.808
σ0.137-0.137=0.001
min1.628-0.915=0.713
max1.989-1.233=0.756

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.904-465.911=-0.007
σ575.758-575.765=-0.006
min178.021-178.024=-0.003
max1329.541-1329.558=-0.017
mean81.750
σ7.500
min78.000
max93.000
mean2468.000-2857.000=-389.000
σ0.000
min2468.000-2857.000=-389.000
max2468.000-2857.000=-389.000
mean0.560-0.440=0.119
σ0.550-0.304=0.246
min0.281-0.286=-0.005
max1.384-0.897=0.487
policies=20
mean1780.456-1780.507=-0.051
σ0.356-0.352=0.004
min1780.215-1780.261=-0.045
max1780.984-1781.024=-0.041
mean780.000
σ0.000
min780.000
max780.000
mean2468.000-2857.000=-389.000
σ0.000
min2468.000-2857.000=-389.000
max2468.000-2857.000=-389.000
mean2.759-2.853=-0.094
σ0.027-0.007=0.020
min2.719-2.845=-0.125
max2.780-2.862=-0.081
policies=200
mean17811.273-17811.476=-0.203
σ0.480-0.445=0.035
min17810.974-17811.064=-0.090
max17811.990-17812.101=-0.111
mean7800.000
σ0.000
min7800.000
max7800.000
mean2468.000-2857.000=-389.000
σ0.000
min2468.000-2857.000=-389.000
max2468.000-2857.000=-389.000
mean27.638-28.363=-0.725
σ0.035-0.490=-0.454
min27.598-27.838=-0.240
max27.684-28.814=-1.130