Compare commits

Home / Compare 4a195f84 .. 83dace6c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.768=0.001
σ0.050-0.052=-0.002
min30.738-30.739=-0.001
max30.911-30.916=-0.004
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.079-0.074=0.005
σ0.003-0.005=-0.002
min0.076-0.069=0.006
max0.084-0.084=0.000
cache=y
dps=1
iters=10
policies=100
mean21.060-21.062=-0.001
σ0.002-0.002=0.000
min21.057-21.059=-0.001
max21.064-21.065=-0.001
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.060-0.063=-0.003
σ0.003-0.002=0.001
min0.057-0.062=-0.005
max0.065-0.069=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.236-1751.237=-0.000
σ0.362-0.362=0.000
min1750.671-1750.670=0.000
max1751.819-1751.823=-0.003
mean1660.050-1655.150=4.900
σ640.554-650.521=-9.967
min620.000-621.000=-1.000
max2825.000-2761.000=64.000
mean2.845-2.879=-0.034
σ0.167-0.106=0.061
min2.543-2.728=-0.185
max3.137-3.125=0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.563-275.560=0.003
σ0.003-0.006=-0.003
min275.559-275.553=0.007
max275.566-275.568=-0.002
mean2825.000-2761.000=64.000
σ0.000
min2825.000-2761.000=64.000
max2825.000-2761.000=64.000
mean0.405-0.402=0.003
σ0.008-0.007=0.001
min0.397-0.395=0.002
max0.415-0.412=0.003
iters=5
new-facts=1
prior-facts=6402
mean2168.094-2168.091=0.003
σ0.010-0.010=0.000
min2168.082-2168.076=0.006
max2168.107-2168.101=0.006
mean2825.000-2761.000=64.000
σ0.000
min2825.000-2761.000=64.000
max2825.000-2761.000=64.000
mean2.942-2.914=0.027
σ0.143-0.128=0.015
min2.744-2.776=-0.032
max3.099-3.104=-0.005
iters=5
new-facts=6402
prior-facts=1
mean5047.802-5047.907=-0.106
σ0.973-0.892=0.080
min5047.087-5047.355=-0.267
max5049.510-5049.495=0.015
mean2825.000-2761.000=64.000
σ0.000
min2825.000-2761.000=64.000
max2825.000-2761.000=64.000
mean8.844-8.633=0.211
σ0.450-0.483=-0.033
min8.263-7.871=0.392
max9.471-9.018=0.453
iters=5
new-facts=6402
prior-facts=6402
mean5179.043-5178.910=0.133
σ0.086-0.252=-0.166
min5178.958-5178.626=0.332
max5179.143-5179.162=-0.019
mean3242.000-3236.400=5.600
σ338.703-363.886=-25.183
min2825.000-2761.000=64.000
max3695.000-3710.000=-15.000
mean9.998-10.157=-0.159
σ0.260-0.218=0.042
min9.600-9.910=-0.311
max10.271-10.467=-0.196

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.039-1.070=-0.031
σ0.136-0.134=0.003
min0.947-0.949=-0.003
max1.256-1.278=-0.022

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.207-463.203=0.004
σ572.651-572.663=-0.012
min176.872-176.868=0.005
max1322.183-1322.197=-0.014
mean77.500
σ7.000
min74.000
max88.000
mean2825.000-2761.000=64.000
σ0.000
min2825.000-2761.000=64.000
max2825.000-2761.000=64.000
mean0.440-0.561=-0.121
σ0.307-0.568=-0.261
min0.285-0.273=0.012
max0.900-1.413=-0.513
policies=20
mean1769.013-1768.945=0.068
σ0.325-0.321=0.004
min1768.790-1768.741=0.049
max1769.489-1769.424=0.065
mean740.000
σ0.000
min740.000
max740.000
mean2825.000-2761.000=64.000
σ0.000
min2825.000-2761.000=64.000
max2825.000-2761.000=64.000
mean2.842-2.735=0.107
σ0.095-0.024=0.071
min2.758-2.705=0.053
max2.979-2.754=0.225
policies=200
mean17696.102-17696.137=-0.035
σ0.598-0.419=0.179
min17695.710-17695.868=-0.159
max17696.990-17696.753=0.236
mean7400.000
σ0.000
min7400.000
max7400.000
mean2825.000-2761.000=64.000
σ0.000
min2825.000-2761.000=64.000
max2825.000-2761.000=64.000
mean27.628-27.669=-0.041
σ0.044-0.147=-0.103
min27.579-27.456=0.123
max27.677-27.770=-0.093