Compare commits

Home / Compare 7d70ad36 .. c68d2b39

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.376-70.375=0.001
σ0.058-0.059=-0.001
min70.333-70.334=-0.001
max70.538-70.540=-0.003
mean413.000-415.400=-2.400
σ0.000-0.516=-0.516
min413.000-415.000=-2.000
max413.000-416.000=-3.000
mean0.161-0.160=0.001
σ0.003-0.002=0.001
min0.158-0.157=0.001
max0.167-0.164=0.003
cache=y
dps=1
iters=10
policies=100
mean21.142-21.143=-0.000
σ0.003-0.002=0.001
min21.139-21.140=-0.001
max21.146-21.146=-0.000
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.063-0.064=-0.002
σ0.003-0.002=0.001
min0.059-0.063=-0.004
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.201-1752.199=0.002
σ0.362-0.363=-0.001
min1751.631-1751.644=-0.013
max1752.804-1752.768=0.037
mean1659.950-1652.900=7.050
σ637.720-642.351=-4.631
min625.000-633.000=-8.000
max2814.000-2847.000=-33.000
mean2.823-2.835=-0.012
σ0.114-0.239=-0.125
min2.467-2.288=0.179
max2.991-3.402=-0.412

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.933-269.935=-0.001
σ0.009-0.009=0.000
min269.922-269.923=-0.001
max269.943-269.944=-0.001
mean2814.000-2847.000=-33.000
σ0.000
min2814.000-2847.000=-33.000
max2814.000-2847.000=-33.000
mean0.378-0.384=-0.006
σ0.007-0.004=0.004
min0.372-0.379=-0.007
max0.390-0.389=0.001
iters=5
new-facts=1
prior-facts=6402
mean1930.400-1930.382=0.018
σ0.010-0.027=-0.016
min1930.387-1930.353=0.034
max1930.414-1930.413=0.001
mean2814.000-2847.000=-33.000
σ0.000
min2814.000-2847.000=-33.000
max2814.000-2847.000=-33.000
mean2.549-2.578=-0.029
σ0.136-0.154=-0.018
min2.445-2.469=-0.024
max2.764-2.835=-0.071
iters=5
new-facts=6402
prior-facts=1
mean4750.879-4750.848=0.031
σ0.889-0.810=0.079
min4750.262-4750.327=-0.064
max4752.453-4752.275=0.178
mean2814.000-2847.000=-33.000
σ0.000
min2814.000-2847.000=-33.000
max2814.000-2847.000=-33.000
mean8.625-8.553=0.072
σ0.724-0.319=0.405
min7.702-8.229=-0.527
max9.424-8.992=0.432
iters=5
new-facts=6402
prior-facts=6402
mean4941.335-4941.326=0.009
σ0.079-0.089=-0.011
min4941.268-4941.254=0.014
max4941.422-4941.429=-0.007
mean3039.800-3027.800=12.000
σ237.504-194.055=43.449
min2814.000-2847.000=-33.000
max3383.000-3315.000=68.000
mean8.684-8.516=0.168
σ0.276-0.080=0.196
min8.395-8.424=-0.029
max8.970-8.614=0.356

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.037-1.126=-0.089
σ0.138-0.255=-0.118
min0.941-0.955=-0.014
max1.257-1.570=-0.314

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.915-465.917=-0.002
σ575.762-575.762=0.001
min178.026-178.030=-0.004
max1329.559-1329.560=-0.001
mean81.750
σ7.500
min78.000
max93.000
mean2814.000-2847.000=-33.000
σ0.000
min2814.000-2847.000=-33.000
max2814.000-2847.000=-33.000
mean0.445-0.442=0.003
σ0.308-0.314=-0.006
min0.289-0.283=0.006
max0.907-0.913=-0.005
policies=20
mean1780.519-1780.520=-0.001
σ0.339-0.359=-0.021
min1780.265-1780.262=0.003
max1781.011-1781.045=-0.035
mean780.000
σ0.000
min780.000
max780.000
mean2814.000-2847.000=-33.000
σ0.000
min2814.000-2847.000=-33.000
max2814.000-2847.000=-33.000
mean2.875-2.867=0.008
σ0.109-0.007=0.102
min2.763-2.856=-0.092
max3.025-2.872=0.153
policies=200
mean17811.534-17811.428=0.106
σ0.467-0.517=-0.050
min17811.259-17811.062=0.197
max17812.232-17812.176=0.056
mean7800.000
σ0.000
min7800.000
max7800.000
mean2814.000-2847.000=-33.000
σ0.000
min2814.000-2847.000=-33.000
max2814.000-2847.000=-33.000
mean27.945-28.361=-0.416
σ0.113-0.516=-0.404
min27.842-27.853=-0.011
max28.105-28.841=-0.736