Compare commits

Home / Compare 2b3995f4 .. f41c31da

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.966-35.965=0.001
σ0.102-0.104=-0.002
min35.922-35.920=0.002
max36.255-36.260=-0.005
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.077-0.074=0.003
σ0.004-0.004=-0.000
min0.074-0.070=0.004
max0.084-0.081=0.003
cache=y
dps=1
iters=10
policies=100
mean26.209-26.209=-0.000
σ0.005-0.004=0.001
min26.202-26.204=-0.002
max26.215-26.216=-0.001
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.060-0.061=-0.001
σ0.004-0.002=0.001
min0.056-0.059=-0.004
max0.069-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.315-1756.314=0.001
σ0.366-0.369=-0.003
min1755.741-1755.739=0.001
max1756.912-1756.908=0.004
mean1646.250-1647.700=-1.450
σ634.080-625.175=8.906
min609.000
max2594.000-2634.000=-40.000
mean2.432-2.394=0.038
σ0.217-0.118=0.099
min2.270-2.232=0.038
max3.024-2.751=0.273

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.844-278.836=0.008
σ0.008-0.017=-0.009
min278.830-278.808=0.022
max278.849-278.848=0.000
mean2594.000-2634.000=-40.000
σ0.000
min2594.000-2634.000=-40.000
max2594.000-2634.000=-40.000
mean0.413-0.410=0.003
σ0.005-0.006=-0.001
min0.407-0.406=0.001
max0.418-0.420=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2268.904-2268.895=0.010
σ0.018-0.008=0.009
min2268.874-2268.884=-0.010
max2268.917-2268.903=0.014
mean2594.000-2634.000=-40.000
σ0.000
min2594.000-2634.000=-40.000
max2594.000-2634.000=-40.000
mean2.956-3.122=-0.166
σ0.178-0.216=-0.038
min2.835-2.914=-0.079
max3.270-3.433=-0.163
iters=5
new-facts=6402
prior-facts=1
mean4954.131-4954.128=0.003
σ0.964-0.941=0.023
min4953.217-4953.329=-0.112
max4955.765-4955.760=0.005
mean2594.000-2634.000=-40.000
σ0.000
min2594.000-2634.000=-40.000
max2594.000-2634.000=-40.000
mean8.048-8.138=-0.090
σ0.292-0.276=0.016
min7.688-7.856=-0.168
max8.382-8.438=-0.056
iters=5
new-facts=6402
prior-facts=6402
mean5168.811-5168.750=0.062
σ0.085-0.215=-0.130
min5168.748-5168.392=0.356
max5168.909-5168.934=-0.025
mean3367.400-3420.000=-52.600
σ461.935-500.785=-38.849
min2764.000-2835.000=-71.000
max3983.000-4166.000=-183.000
mean9.361-9.349=0.011
σ0.162-0.527=-0.365
min9.130-8.760=0.370
max9.587-10.118=-0.531

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.321-1.084=0.237
σ0.449-0.227=0.222
min0.944-0.945=-0.001
max1.839-1.480=0.358

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.356-460.361=-0.005
σ572.656-572.656=0.001
min174.023-174.023=0.000
max1319.340-1319.344=-0.004
mean79.500
σ7.000
min76.000
max90.000
mean2594.000-2634.000=-40.000
σ0.000
min2594.000-2634.000=-40.000
max2594.000-2634.000=-40.000
mean0.539-0.562=-0.023
σ0.539-0.572=-0.032
min0.267-0.266=0.000
max1.349-1.420=-0.072
policies=20
mean1740.501-1740.497=0.004
σ0.326-0.317=0.010
min1740.301-1740.290=0.011
max1740.988-1740.969=0.019
mean760.000
σ0.000
min760.000
max760.000
mean2594.000-2634.000=-40.000
σ0.000
min2594.000-2634.000=-40.000
max2594.000-2634.000=-40.000
mean2.691-2.682=0.009
σ0.011-0.007=0.003
min2.677-2.672=0.005
max2.701-2.688=0.013
policies=200
mean17411.956-17411.839=0.117
σ0.512-0.598=-0.086
min17411.668-17411.502=0.166
max17412.722-17412.735=-0.012
mean7600.000
σ0.000
min7600.000
max7600.000
mean2594.000-2634.000=-40.000
σ0.000
min2594.000-2634.000=-40.000
max2594.000-2634.000=-40.000
mean27.100-27.095=0.004
σ0.070-0.050=0.019
min27.031-27.029=0.001
max27.195-27.152=0.043