Compare commits

Home / Compare c68d2b39 .. 1b58ae5d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.376=-0.002
σ0.056-0.058=-0.002
min70.335-70.333=0.002
max70.531-70.538=-0.007
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.160-0.161=-0.001
σ0.003-0.003=-0.000
min0.157-0.158=-0.001
max0.165-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.142-21.142=-0.001
σ0.003-0.003=-0.000
min21.138-21.139=-0.001
max21.146-21.146=-0.001
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.060-0.063=-0.003
σ0.003-0.003=-0.000
min0.058-0.059=-0.001
max0.067-0.070=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.200-1752.201=-0.001
σ0.363-0.362=0.001
min1751.640-1751.631=0.010
max1752.782-1752.804=-0.022
mean1651.050-1659.950=-8.900
σ642.954-637.720=5.234
min629.000-625.000=4.000
max2845.000-2814.000=31.000
mean2.824-2.823=0.002
σ0.183-0.114=0.070
min2.320-2.467=-0.147
max3.036-2.991=0.045

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.911-269.933=-0.023
σ0.009-0.009=-0.000
min269.901-269.922=-0.021
max269.920-269.943=-0.024
mean2845.000-2814.000=31.000
σ0.000
min2845.000-2814.000=31.000
max2845.000-2814.000=31.000
mean0.384-0.378=0.006
σ0.003-0.007=-0.004
min0.382-0.372=0.011
max0.390-0.390=0.000
iters=5
new-facts=1
prior-facts=6402
mean1930.400-1930.400=-0.000
σ0.008-0.010=-0.002
min1930.390-1930.387=0.004
max1930.413-1930.414=-0.001
mean2845.000-2814.000=31.000
σ0.000
min2845.000-2814.000=31.000
max2845.000-2814.000=31.000
mean2.508-2.549=-0.041
σ0.060-0.136=-0.076
min2.454-2.445=0.009
max2.603-2.764=-0.161
iters=5
new-facts=6402
prior-facts=1
mean4750.909-4750.879=0.029
σ0.823-0.889=-0.066
min4750.415-4750.262=0.153
max4752.371-4752.453=-0.083
mean2845.000-2814.000=31.000
σ0.000
min2845.000-2814.000=31.000
max2845.000-2814.000=31.000
mean8.442-8.625=-0.183
σ0.685-0.724=-0.039
min7.715-7.702=0.013
max9.357-9.424=-0.067
iters=5
new-facts=6402
prior-facts=6402
mean4941.333-4941.335=-0.002
σ0.087-0.079=0.008
min4941.264-4941.268=-0.004
max4941.437-4941.422=0.015
mean3040.200-3039.800=0.400
σ199.547-237.504=-37.957
min2845.000-2814.000=31.000
max3317.000-3383.000=-66.000
mean8.637-8.684=-0.047
σ0.203-0.276=-0.073
min8.483-8.395=0.088
max8.906-8.970=-0.064

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.039-1.037=0.002
σ0.136-0.138=-0.002
min0.952-0.941=0.011
max1.264-1.257=0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.914-465.915=-0.002
σ575.763-575.762=0.001
min178.023-178.026=-0.003
max1329.558-1329.559=-0.000
mean81.750
σ7.500
min78.000
max93.000
mean2845.000-2814.000=31.000
σ0.000
min2845.000-2814.000=31.000
max2845.000-2814.000=31.000
mean0.446-0.445=0.000
σ0.312-0.308=0.004
min0.285-0.289=-0.004
max0.913-0.907=0.006
policies=20
mean1780.516-1780.519=-0.003
σ0.357-0.339=0.019
min1780.243-1780.265=-0.022
max1781.034-1781.011=0.024
mean780.000
σ0.000
min780.000
max780.000
mean2845.000-2814.000=31.000
σ0.000
min2845.000-2814.000=31.000
max2845.000-2814.000=31.000
mean2.859-2.875=-0.015
σ0.008-0.109=-0.101
min2.850-2.763=0.087
max2.870-3.025=-0.154
policies=200
mean17811.470-17811.534=-0.064
σ0.567-0.467=0.100
min17811.056-17811.259=-0.203
max17812.308-17812.232=0.076
mean7800.000
σ0.000
min7800.000
max7800.000
mean2845.000-2814.000=31.000
σ0.000
min2845.000-2814.000=31.000
max2845.000-2814.000=31.000
mean28.321-27.945=0.376
σ0.571-0.113=0.458
min27.796-27.842=-0.046
max28.842-28.105=0.737