Compare commits

Home / Compare f1c4bade .. 266fca10

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.376-70.375=0.001
σ0.057-0.060=-0.003
min70.340-70.333=0.007
max70.534-70.541=-0.007
mean413.000-411.900=1.100
σ0.000-0.316=-0.316
min413.000-411.000=2.000
max413.000-412.000=1.000
mean0.158-0.160=-0.002
σ0.003-0.003=0.000
min0.156-0.152=0.003
max0.164-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.144=-0.000
σ0.002-0.003=-0.001
min21.140-21.140=-0.000
max21.146-21.148=-0.002
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.063-0.064=-0.001
σ0.004-0.002=0.002
min0.058-0.063=-0.004
max0.072-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.201-1752.202=-0.000
σ0.360-0.361=-0.001
min1751.627-1751.625=0.002
max1752.792-1752.780=0.012
mean1659.700-1634.600=25.100
σ625.456-616.554=8.903
min682.000-643.000=39.000
max2740.000-2468.000=272.000
mean2.822-2.862=-0.040
σ0.178-0.143=0.035
min2.163-2.673=-0.511
max3.016-3.351=-0.336

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.928-269.938=-0.010
σ0.009-0.005=0.004
min269.921-269.931=-0.009
max269.944-269.944=-0.000
mean2740.000-2468.000=272.000
σ0.000
min2740.000-2468.000=272.000
max2740.000-2468.000=272.000
mean0.373-0.386=-0.013
σ0.005-0.008=-0.003
min0.369-0.379=-0.010
max0.382-0.396=-0.015
iters=5
new-facts=1
prior-facts=6402
mean1930.387-1930.397=-0.010
σ0.022-0.008=0.013
min1930.354-1930.385=-0.032
max1930.406-1930.406=0.001
mean2740.000-2468.000=272.000
σ0.000
min2740.000-2468.000=272.000
max2740.000-2468.000=272.000
mean2.569-2.518=0.051
σ0.149-0.041=0.108
min2.463-2.479=-0.016
max2.808-2.571=0.237
iters=5
new-facts=6402
prior-facts=1
mean4750.855-4750.899=-0.044
σ0.802-0.847=-0.045
min4750.340-4750.454=-0.114
max4752.264-4752.413=-0.149
mean2740.000-2468.000=272.000
σ0.000
min2740.000-2468.000=272.000
max2740.000-2468.000=272.000
mean8.518-8.390=0.128
σ0.309-0.563=-0.254
min8.249-7.732=0.517
max8.891-9.094=-0.203
iters=5
new-facts=6402
prior-facts=6402
mean4941.332-4941.330=0.002
σ0.086-0.090=-0.004
min4941.262-4941.260=0.002
max4941.429-4941.431=-0.002
mean3028.400-2980.200=48.200
σ268.738-284.150=-15.412
min2740.000-2591.000=149.000
max3400.000-3315.000=85.000
mean8.528-8.477=0.051
σ0.157-0.103=0.055
min8.285-8.377=-0.092
max8.665-8.635=0.030

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.081-1.797=-0.716
σ0.116-0.137=-0.021
min0.939-1.628=-0.689
max1.262-1.989=-0.727

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.917-465.904=0.013
σ575.771-575.758=0.013
min178.024-178.021=0.003
max1329.574-1329.541=0.033
mean81.750
σ7.500
min78.000
max93.000
mean2740.000-2468.000=272.000
σ0.000
min2740.000-2468.000=272.000
max2740.000-2468.000=272.000
mean0.542-0.560=-0.018
σ0.526-0.550=-0.023
min0.278-0.281=-0.003
max1.331-1.384=-0.053
policies=20
mean1780.478-1780.456=0.022
σ0.355-0.356=-0.001
min1780.232-1780.215=0.017
max1781.004-1780.984=0.021
mean780.000
σ0.000
min780.000
max780.000
mean2740.000-2468.000=272.000
σ0.000
min2740.000-2468.000=272.000
max2740.000-2468.000=272.000
mean2.777-2.759=0.019
σ0.017-0.027=-0.010
min2.763-2.719=0.044
max2.797-2.780=0.017
policies=200
mean17811.478-17811.273=0.205
σ0.363-0.480=-0.117
min17811.286-17810.974=0.312
max17812.022-17811.990=0.032
mean7800.000
σ0.000
min7800.000
max7800.000
mean2740.000-2468.000=272.000
σ0.000
min2740.000-2468.000=272.000
max2740.000-2468.000=272.000
mean27.961-27.638=0.323
σ0.111-0.035=0.075
min27.866-27.598=0.268
max28.079-27.684=0.395