Compare commits

Home / Compare f97ac1f9 .. c19d5515

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.773-30.773=-0.000
σ0.046-0.047=-0.000
min30.749-30.749=0.000
max30.904-30.906=-0.002
mean411.000-410.000=1.000
σ0.000
min411.000-410.000=1.000
max411.000-410.000=1.000
mean0.079-0.078=0.001
σ0.003-0.003=0.001
min0.076-0.076=0.000
max0.086-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean21.060-21.058=0.002
σ0.003-0.002=0.001
min21.057-21.055=0.002
max21.065-21.061=0.004
mean411.000-410.000=1.000
σ0.000
min411.000-410.000=1.000
max411.000-410.000=1.000
mean0.064-0.063=0.002
σ0.003-0.004=-0.002
min0.062-0.057=0.005
max0.070-0.070=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.235-1751.237=-0.002
σ0.364-0.362=0.002
min1750.671-1750.661=0.009
max1751.827-1751.821=0.006
mean1661.900-1642.250=19.650
σ627.285-617.812=9.473
min685.000-676.000=9.000
max2769.000-2632.000=137.000
mean2.844-2.750=0.094
σ0.129-0.239=-0.110
min2.439-2.267=0.172
max3.060-2.999=0.061

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean267.614-275.566=-7.952
σ17.779-0.004=17.775
min235.810-275.563=-39.753
max275.570-275.572=-0.002
mean2769.000-2632.000=137.000
σ0.000
min2769.000-2632.000=137.000
max2769.000-2632.000=137.000
mean0.380-0.394=-0.013
σ0.031-0.009=0.022
min0.326-0.386=-0.060
max0.399-0.404=-0.005
iters=5
new-facts=1
prior-facts=6402
mean2168.085-2168.087=-0.002
σ0.015-0.020=-0.005
min2168.067-2168.058=0.009
max2168.103-2168.108=-0.006
mean2769.000-2632.000=137.000
σ0.000
min2769.000-2632.000=137.000
max2769.000-2632.000=137.000
mean2.935-2.971=-0.036
σ0.097-0.105=-0.007
min2.810-2.798=0.012
max3.053-3.062=-0.010
iters=5
new-facts=6402
prior-facts=1
mean5047.909-5047.688=0.221
σ0.878-0.357=0.520
min5047.334-5047.349=-0.015
max5049.444-5048.268=1.175
mean2769.000-2632.000=137.000
σ0.000
min2769.000-2632.000=137.000
max2769.000-2632.000=137.000
mean8.903-9.067=-0.164
σ0.507-0.504=0.003
min8.196-8.330=-0.134
max9.405-9.582=-0.177
iters=5
new-facts=6402
prior-facts=6402
mean5178.975-5179.048=-0.073
σ0.200-0.073=0.127
min5178.651-5178.965=-0.315
max5179.159-5179.127=0.032
mean3302.400-3281.400=21.000
σ394.037-425.490=-31.453
min2769.000-2680.000=89.000
max3674.000-3672.000=2.000
mean9.873-9.973=-0.100
σ0.212-0.306=-0.094
min9.534-9.611=-0.078
max10.106-10.306=-0.200

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.056-1.184=-0.128
σ0.184-0.249=-0.065
min0.944-0.938=0.007
max1.373-1.580=-0.207

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.203-463.209=-0.006
σ572.662-572.673=-0.011
min176.869-176.869=0.001
max1322.197-1322.218=-0.021
mean77.500
σ7.000
min74.000
max88.000
mean2769.000-2632.000=137.000
σ0.000
min2769.000-2632.000=137.000
max2769.000-2632.000=137.000
mean0.440-0.563=-0.123
σ0.305-0.568=-0.263
min0.286-0.275=0.011
max0.897-1.415=-0.518
policies=20
mean1768.972-1768.974=-0.002
σ0.302-0.342=-0.040
min1768.762-1768.754=0.008
max1769.421-1769.485=-0.064
mean740.000
σ0.000
min740.000
max740.000
mean2769.000-2632.000=137.000
σ0.000
min2769.000-2632.000=137.000
max2769.000-2632.000=137.000
mean2.772-2.756=0.015
σ0.080-0.027=0.053
min2.714-2.735=-0.020
max2.890-2.790=0.100
policies=200
mean17696.272-17696.172=0.100
σ0.488-0.416=0.073
min17696.005-17695.920=0.085
max17697.004-17696.790=0.214
mean7400.000
σ0.000
min7400.000
max7400.000
mean2769.000-2632.000=137.000
σ0.000
min2769.000-2632.000=137.000
max2769.000-2632.000=137.000
mean27.577-27.720=-0.142
σ0.148-0.153=-0.005
min27.413-27.595=-0.182
max27.762-27.912=-0.151