Compare commits

Home / Compare 1c10d347 .. 968f89c4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.375-70.373=0.001
σ0.059-0.060=-0.001
min70.334-70.330=0.003
max70.540-70.540=0.000
mean415.400-412.400=3.000
σ0.516
min415.000-412.000=3.000
max416.000-413.000=3.000
mean0.160-0.154=0.006
σ0.002-0.004=-0.002
min0.157-0.149=0.008
max0.164-0.159=0.004
cache=y
dps=1
iters=10
policies=100
mean21.143-21.144=-0.001
σ0.002-0.002=0.000
min21.140-21.142=-0.002
max21.146-21.148=-0.002
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.064-0.064=0.000
σ0.002-0.003=-0.001
min0.063-0.060=0.003
max0.071-0.071=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.199-1752.199=0.000
σ0.363-0.360=0.003
min1751.644-1751.629=0.015
max1752.768-1752.785=-0.018
mean1652.900-1648.550=4.350
σ642.351-617.499=24.852
min633.000-656.000=-23.000
max2847.000-2485.000=362.000
mean2.835-2.804=0.030
σ0.239-0.194=0.045
min2.288-2.208=0.080
max3.402-3.031=0.372

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.935-269.935=-0.001
σ0.009-0.006=0.003
min269.923-269.925=-0.002
max269.944-269.942=0.002
mean2847.000-2485.000=362.000
σ0.000
min2847.000-2485.000=362.000
max2847.000-2485.000=362.000
mean0.384-0.384=-0.001
σ0.004-0.006=-0.002
min0.379-0.380=-0.000
max0.389-0.394=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1930.382-1930.389=-0.006
σ0.027-0.020=0.006
min1930.353-1930.359=-0.006
max1930.413-1930.407=0.006
mean2847.000-2485.000=362.000
σ0.000
min2847.000-2485.000=362.000
max2847.000-2485.000=362.000
mean2.578-2.528=0.050
σ0.154-0.055=0.099
min2.469-2.484=-0.015
max2.835-2.611=0.225
iters=5
new-facts=6402
prior-facts=1
mean4750.848-4750.830=0.018
σ0.810-0.838=-0.028
min4750.327-4750.269=0.057
max4752.275-4752.298=-0.024
mean2847.000-2485.000=362.000
σ0.000
min2847.000-2485.000=362.000
max2847.000-2485.000=362.000
mean8.553-8.724=-0.171
σ0.319-0.330=-0.011
min8.229-8.454=-0.225
max8.992-9.132=-0.141
iters=5
new-facts=6402
prior-facts=6402
mean4941.326-4941.332=-0.007
σ0.089-0.082=0.008
min4941.254-4941.266=-0.012
max4941.429-4941.428=0.001
mean3027.800-2932.000=95.800
σ194.055-310.053=-115.999
min2847.000-2485.000=362.000
max3315.000-3308.000=7.000
mean8.516-8.528=-0.012
σ0.080-0.155=-0.075
min8.424-8.423=0.001
max8.614-8.796=-0.182

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.126-1.761=-0.635
σ0.255-0.160=0.095
min0.955-1.500=-0.545
max1.570-1.886=-0.316

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.917-465.905=0.013
σ575.762-575.764=-0.002
min178.030-178.020=0.011
max1329.560-1329.550=0.010
mean81.750
σ7.500
min78.000
max93.000
mean2847.000-2485.000=362.000
σ0.000
min2847.000-2485.000=362.000
max2847.000-2485.000=362.000
mean0.442-0.580=-0.138
σ0.314-0.598=-0.284
min0.283-0.278=0.005
max0.913-1.477=-0.564
policies=20
mean1780.520-1780.446=0.074
σ0.359-0.350=0.010
min1780.262-1780.211=0.051
max1781.045-1780.964=0.081
mean780.000
σ0.000
min780.000
max780.000
mean2847.000-2485.000=362.000
σ0.000
min2847.000-2485.000=362.000
max2847.000-2485.000=362.000
mean2.867-2.781=0.086
σ0.007-0.008=-0.001
min2.856-2.769=0.087
max2.872-2.787=0.085
policies=200
mean17811.428-17811.477=-0.049
σ0.517-0.515=0.002
min17811.062-17811.076=-0.014
max17812.176-17812.231=-0.055
mean7800.000
σ0.000
min7800.000
max7800.000
mean2847.000-2485.000=362.000
σ0.000
min2847.000-2485.000=362.000
max2847.000-2485.000=362.000
mean28.361-27.957=0.404
σ0.516-0.056=0.460
min27.853-27.903=-0.049
max28.841-28.019=0.822