Compare commits

Home / Compare 5165f92c .. 67cc8b10

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.592
σ0.093
min36.548
max36.855
mean411.800
σ0.422
min411.000
max412.000
mean0.076
σ0.004
min0.072
max0.083
cache=y
dps=1
iters=10
policies=100
mean26.465
σ0.002
min26.462
max26.467
mean412.000
σ0.000
min412.000
max412.000
mean0.058
σ0.002
min0.057
max0.061

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1750.983-1747.864=3.119
σ0.382-0.386=-0.004
min1750.385-1747.264=3.120
max1751.599-1748.480=3.119
mean1664.900-1651.050=13.850
σ621.669-620.723=0.946
min657.000-618.000=39.000
max2604.000-2689.000=-85.000
mean2.821-2.334=0.487
σ0.118-0.202=-0.084
min2.450-2.193=0.257
max2.963-2.910=0.053

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.910-280.022=1.888
σ0.007-0.008=-0.001
min281.902-280.010=1.892
max281.919-280.031=1.888
mean2604.000-2689.000=-85.000
σ0.000
min2604.000-2689.000=-85.000
max2604.000-2689.000=-85.000
mean0.404-0.418=-0.013
σ0.005-0.002=0.003
min0.400-0.415=-0.015
max0.411-0.420=-0.009
iters=5
new-facts=1
prior-facts=6402
mean2176.113-2265.240=-89.127
σ0.016-0.006=0.010
min2176.103-2265.229=-89.127
max2176.141-2265.245=-89.103
mean2604.000-2689.000=-85.000
σ0.000
min2604.000-2689.000=-85.000
max2604.000-2689.000=-85.000
mean2.865-2.973=-0.108
σ0.141-0.178=-0.037
min2.750-2.775=-0.025
max3.110-3.262=-0.153
iters=5
new-facts=6402
prior-facts=1
mean4899.392-4946.795=-47.403
σ354.927-1.085=353.842
min4264.482-4945.458=-680.976
max5059.636-4948.491=111.145
mean2604.000-2689.000=-85.000
σ0.000
min2604.000-2689.000=-85.000
max2604.000-2689.000=-85.000
mean9.144-7.991=1.153
σ0.761-0.320=0.442
min7.789-7.658=0.130
max9.593-8.379=1.214
iters=5
new-facts=6402
prior-facts=6402
mean5206.459-5174.389=32.070
σ0.177-0.190=-0.013
min5206.160-5174.063=32.098
max5206.597-5174.522=32.075
mean3141.800-3382.400=-240.600
σ453.662-464.262=-10.600
min2604.000-2751.000=-147.000
max3755.000-3969.000=-214.000
mean9.913-9.279=0.634
σ0.351-0.406=-0.055
min9.499-8.649=0.850
max10.296-9.696=0.600

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.579-1.072=0.507
σ0.350-0.158=0.191
min1.195-0.998=0.197
max1.978-1.355=0.622

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean512.397-502.919=9.479
σ663.607-663.316=0.291
min180.591-171.257=9.334
max1507.807-1497.892=9.915
mean79.500
σ7.000
min76.000
max90.000
mean2604.000-431.000=2173.000
σ0.000
min2604.000-431.000=2173.000
max2604.000-431.000=2173.000
mean0.582-0.578=0.004
σ0.590-0.620=-0.029
min0.284-0.263=0.022
max1.467-1.507=-0.040
policies=20
mean1806.188-1713.102=93.086
σ0.342-0.322=0.020
min1805.943-1712.868=93.075
max1806.691-1713.576=93.115
mean760.000
σ0.000
min760.000
max760.000
mean2604.000-444.000=2160.000
σ0.000-11.804=-11.804
min2604.000-431.000=2173.000
max2604.000-454.000=2150.000
mean2.858-2.643=0.215
σ0.051-0.020=0.030
min2.822-2.625=0.197
max2.933-2.665=0.268
policies=200
mean18068.654-17140.237=928.418
σ0.457-0.066=0.391
min18068.292-17140.147=928.145
max18069.316-17140.295=929.022
mean7600.000
σ0.000
min7600.000
max7600.000
mean2604.000-487.500=2116.500
σ0.000-2.380=-2.380
min2604.000-486.000=2118.000
max2604.000-491.000=2113.000
mean28.580-26.694=1.887
σ0.129-0.074=0.055
min28.506-26.583=1.923
max28.773-26.743=2.029