Compare commits

Home / Compare 382cfa61 .. e0416d70

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.957=-0.159
σ0.107-0.104=0.003
min35.752-35.915=-0.163
max36.103-36.251=-0.149
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.075-0.076=-0.001
σ0.004-0.003=0.000
min0.071-0.074=-0.003
max0.082-0.083=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.064-26.204=-0.139
σ0.003-0.004=-0.001
min26.060-26.197=-0.137
max26.071-26.209=-0.139
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.060-0.061=-0.001
σ0.003-0.003=0.000
min0.056-0.059=-0.003
max0.067-0.068=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.924-1756.306=-0.383
σ0.365-0.369=-0.003
min1755.356-1755.728=-0.373
max1756.515-1756.897=-0.382
mean1661.900-1661.150=0.750
σ627.393-631.179=-3.786
min671.000-616.000=55.000
max2659.000-2730.000=-71.000
mean2.823-2.397=0.425
σ0.110-0.096=0.014
min2.540-2.301=0.238
max3.016-2.610=0.406

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.199-278.828=-1.629
σ0.002-0.005=-0.003
min277.196-278.822=-1.626
max277.201-278.834=-1.633
mean2659.000-2730.000=-71.000
σ0.000
min2659.000-2730.000=-71.000
max2659.000-2730.000=-71.000
mean0.413-0.418=-0.005
σ0.010-0.007=0.003
min0.403-0.408=-0.005
max0.423-0.426=-0.003
iters=5
new-facts=1
prior-facts=6402
mean2174.430-2268.888=-94.458
σ0.016-0.011=0.005
min2174.402-2268.878=-94.476
max2174.444-2268.907=-94.463
mean2659.000-2730.000=-71.000
σ0.000
min2659.000-2730.000=-71.000
max2659.000-2730.000=-71.000
mean2.944-3.125=-0.180
σ0.125-0.132=-0.007
min2.807-2.960=-0.153
max3.074-3.239=-0.165
iters=5
new-facts=6402
prior-facts=1
mean5052.640-4954.173=98.468
σ0.899-1.051=-0.152
min5052.150-4953.106=99.044
max5054.245-4955.933=98.312
mean2659.000-2730.000=-71.000
σ0.000
min2659.000-2730.000=-71.000
max2659.000-2730.000=-71.000
mean8.792-8.013=0.779
σ0.601-0.334=0.267
min7.982-7.740=0.242
max9.653-8.584=1.070
iters=5
new-facts=6402
prior-facts=6402
mean5188.406-5168.759=19.647
σ0.098-0.140=-0.042
min5188.292-5168.556=19.736
max5188.517-5168.896=19.621
mean3209.000-3429.200=-220.200
σ478.003-503.364=-25.361
min2659.000-2837.000=-178.000
max3855.000-4171.000=-316.000
mean8.959-9.547=-0.588
σ0.466-0.173=0.293
min8.658-9.346=-0.688
max9.780-9.798=-0.018

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.277-1.042=0.236
σ0.442-0.159=0.283
min0.946-0.933=0.013
max2.044-1.308=0.736

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.852-459.817=5.035
σ572.653-571.590=1.063
min178.520-174.020=4.500
max1323.832-1317.201=6.631
mean79.500
σ7.000
min76.000
max90.000
mean2659.000-2730.000=-71.000
σ0.000
min2659.000-2730.000=-71.000
max2659.000-2730.000=-71.000
mean0.550-0.525=0.025
σ0.540-0.505=0.035
min0.279-0.270=0.010
max1.361-1.282=0.078
policies=20
mean1785.465-1740.406=45.059
σ0.349-0.309=0.041
min1785.234-1740.232=45.002
max1785.984-1740.868=45.116
mean760.000
σ0.000
min760.000
max760.000
mean2659.000-2730.000=-71.000
σ0.000
min2659.000-2730.000=-71.000
max2659.000-2730.000=-71.000
mean2.790-2.684=0.107
σ0.009-0.021=-0.012
min2.785-2.656=0.129
max2.803-2.705=0.098
policies=200
mean17861.489-17411.180=450.309
σ0.544-0.545=-0.001
min17861.083-17410.865=450.218
max17862.291-17411.993=450.298
mean7600.000
σ0.000
min7600.000
max7600.000
mean2659.000-2730.000=-71.000
σ0.000
min2659.000-2730.000=-71.000
max2659.000-2730.000=-71.000
mean28.162-27.076=1.086
σ0.139-0.033=0.106
min28.031-27.032=0.999
max28.345-27.110=1.235