Compare commits

Home / Compare f33fe4eb .. 6bec1fe7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.727
σ0.615
min35.918
max37.207
mean3864.000
σ0.000
min3864.000
max3864.000
mean0.074
σ0.003
min0.070
max0.078
cache=y
dps=1
iters=10
policies=100
mean26.713
σ0.649
min26.209
max27.468
mean3864.000
σ0.000
min3864.000
max3864.000
mean0.061
σ0.001
min0.060
max0.062

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.358-1753.293=3.065
σ0.370-0.362=0.008
min1755.785-1752.719=3.066
max1756.945-1753.865=3.080
mean1634.450-1657.900=-23.450
σ623.833-636.939=-13.106
min627.000-675.000=-48.000
max2830.000-2615.000=215.000
mean2.280-2.721=-0.442
σ0.210-0.175=0.035
min2.102-2.156=-0.053
max3.108-2.917=0.190

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.674-189.717=88.957
σ0.009-0.014=-0.005
min278.663-189.701=88.962
max278.685-189.733=88.952
mean2830.000-2615.000=215.000
σ0.000
min2830.000-2615.000=215.000
max2830.000-2615.000=215.000
mean0.421-0.277=0.144
σ0.001-0.001=0.000
min0.419-0.276=0.143
max0.422-0.278=0.145
iters=5
new-facts=1
prior-facts=6402
mean2268.843-1988.525=280.318
σ0.014-0.018=-0.004
min2268.828-1988.504=280.323
max2268.858-1988.543=280.315
mean2830.000-2615.000=215.000
σ0.000
min2830.000-2615.000=215.000
max2830.000-2615.000=215.000
mean3.071-2.409=0.663
σ0.158-0.076=0.082
min2.910-2.363=0.547
max3.296-2.544=0.752
iters=5
new-facts=6402
prior-facts=1
mean4952.240-4878.846=73.394
σ0.867-0.715=0.152
min4951.408-4878.135=73.273
max4953.714-4880.020=73.693
mean2830.000-2615.000=215.000
σ0.000
min2830.000-2615.000=215.000
max2830.000-2615.000=215.000
mean7.732-8.034=-0.302
σ0.126-0.212=-0.086
min7.635-7.746=-0.111
max7.936-8.209=-0.273
iters=5
new-facts=6402
prior-facts=6402
mean5166.982-4890.683=276.299
σ0.162-0.093=0.069
min5166.693-4890.603=276.090
max5167.073-4890.799=276.274
mean3341.000-3248.800=92.200
σ398.291-407.141=-8.850
min2830.000-2837.000=-7.000
max3864.000-3651.000=213.000
mean9.303-8.070=1.233
σ0.598-0.163=0.435
min9.006-7.920=1.085
max10.373-8.318=2.054

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.166-1.663=-0.497
σ0.350-0.304=0.047
min0.941-1.219=-0.278
max1.743-2.074=-0.331

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.775-456.327=4.447
σ573.646-573.570=0.076
min173.951-169.541=4.410
max1321.243-1316.682=4.561
mean79.500
σ7.000
min76.000
max90.000
mean434.000-433.000=1.000
σ0.000
min434.000-433.000=1.000
max434.000-433.000=1.000
mean0.537-0.543=-0.006
σ0.528-0.540=-0.012
min0.269-0.265=0.003
max1.329-1.353=-0.024
policies=20
mean1740.008-1695.937=44.072
σ0.332-0.305=0.027
min1739.770-1695.708=44.062
max1740.496-1696.382=44.114
mean760.000
σ0.000
min760.000
max760.000
mean445.250-442.000=3.250
σ10.308-10.392=-0.085
min434.000-433.000=1.000
max454.000-457.000=-3.000
mean2.672-2.610=0.063
σ0.004-0.008=-0.003
min2.666-2.602=0.065
max2.677-2.620=0.057
policies=200
mean17409.336-16968.841=440.496
σ0.078-0.042=0.036
min17409.267-16968.814=440.453
max17409.441-16968.903=440.538
mean7600.000
σ0.000
min7600.000
max7600.000
mean489.500-490.000=-0.500
σ1.732-1.633=0.099
min488.000
max492.000
mean27.036-26.350=0.686
σ0.152-0.043=0.109
min26.845-26.307=0.538
max27.168-26.391=0.777