Compare commits

Home / Compare 3b892afd .. 1be5e4d6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.373-70.373=-0.000
σ0.057-0.058=-0.001
min70.336-70.335=0.001
max70.532-70.536=-0.004
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.157-0.156=0.001
σ0.006-0.006=0.000
min0.150-0.149=0.000
max0.168-0.166=0.002
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=-0.001
σ0.003-0.003=-0.001
min21.138-21.139=-0.002
max21.147-21.148=-0.001
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.063-0.065=-0.002
σ0.004-0.003=0.001
min0.058-0.063=-0.005
max0.069-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.200-1752.199=0.001
σ0.360-0.362=-0.002
min1751.626-1751.629=-0.002
max1752.799-1752.783=0.017
mean1652.150-1635.750=16.400
σ646.049-617.395=28.655
min645.000-643.000=2.000
max2845.000-2470.000=375.000
mean2.836-2.841=-0.005
σ0.186-0.130=0.057
min2.248-2.544=-0.295
max3.130-3.050=0.080

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.933-269.935=-0.002
σ0.011-0.005=0.006
min269.920-269.927=-0.008
max269.946-269.939=0.007
mean2845.000-2470.000=375.000
σ0.000
min2845.000-2470.000=375.000
max2845.000-2470.000=375.000
mean0.374-0.383=-0.009
σ0.004-0.005=-0.001
min0.371-0.379=-0.008
max0.381-0.391=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1930.387-1930.384=0.003
σ0.019-0.024=-0.005
min1930.361-1930.355=0.006
max1930.405-1930.406=-0.001
mean2845.000-2470.000=375.000
σ0.000
min2845.000-2470.000=375.000
max2845.000-2470.000=375.000
mean2.564-2.571=-0.007
σ0.139-0.138=0.001
min2.445-2.456=-0.011
max2.797-2.797=0.000
iters=5
new-facts=6402
prior-facts=1
mean4750.892-4750.728=0.164
σ0.850-0.874=-0.024
min4750.432-4750.078=0.354
max4752.405-4752.264=0.141
mean2845.000-2470.000=375.000
σ0.000
min2845.000-2470.000=375.000
max2845.000-2470.000=375.000
mean8.352-8.624=-0.272
σ0.397-0.211=0.186
min7.755-8.374=-0.619
max8.866-8.836=0.030
iters=5
new-facts=6402
prior-facts=6402
mean4941.327-4941.190=0.137
σ0.078-0.252=-0.174
min4941.265-4940.917=0.348
max4941.415-4941.423=-0.008
mean3031.800-2961.600=70.200
σ262.883-274.590=-11.707
min2845.000-2593.000=252.000
max3448.000-3317.000=131.000
mean8.391-8.402=-0.011
σ0.071-0.041=0.029
min8.294-8.351=-0.057
max8.454-8.450=0.005

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.076-1.826=-0.750
σ0.109-0.094=0.015
min0.948-1.713=-0.765
max1.250-1.973=-0.723

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.915-465.902=0.013
σ575.767-575.752=0.014
min178.019-178.022=-0.003
max1329.565-1329.530=0.035
mean81.750
σ7.500
min78.000
max93.000
mean2845.000-2470.000=375.000
σ0.000
min2845.000-2470.000=375.000
max2845.000-2470.000=375.000
mean0.444-0.538=-0.094
σ0.308-0.505=-0.197
min0.286-0.277=0.009
max0.906-1.295=-0.390
policies=20
mean1780.472-1780.452=0.020
σ0.358-0.355=0.002
min1780.207-1780.219=-0.013
max1780.992-1780.979=0.013
mean780.000
σ0.000
min780.000
max780.000
mean2845.000-2470.000=375.000
σ0.000
min2845.000-2470.000=375.000
max2845.000-2470.000=375.000
mean2.867-2.763=0.103
σ0.010-0.021=-0.011
min2.857-2.741=0.116
max2.880-2.792=0.088
policies=200
mean17811.328-17811.318=0.010
σ0.492-0.512=-0.020
min17811.032-17811.024=0.007
max17812.060-17812.085=-0.024
mean7800.000
σ0.000
min7800.000
max7800.000
mean2845.000-2470.000=375.000
σ0.000
min2845.000-2470.000=375.000
max2845.000-2470.000=375.000
mean28.359-27.782=0.577
σ0.516-0.054=0.463
min27.858-27.719=0.139
max28.860-27.850=1.010