Compare commits

Home / Compare 6482eee5 .. 6e91350e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.244-35.243=0.001
σ0.053-0.056=-0.002
min35.217-35.209=0.008
max35.395-35.399=-0.005
mean416.000-414.900=1.100
σ0.000-0.316=-0.316
min416.000-414.000=2.000
max416.000-415.000=1.000
mean0.085-0.083=0.002
σ0.003-0.005=-0.002
min0.081-0.076=0.005
max0.091-0.091=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=-0.001
σ0.003-0.003=-0.001
min23.766-23.766=0.000
max23.772-23.773=-0.001
mean416.000-415.700=0.300
σ0.000-0.483=-0.483
min416.000-415.000=1.000
max416.000
mean0.065-0.068=-0.003
σ0.004-0.004=-0.000
min0.061-0.065=-0.004
max0.072-0.077=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.364-1756.365=-0.001
σ0.365-0.365=0.000
min1755.789-1755.791=-0.002
max1756.957-1756.955=0.002
mean1645.250-1645.750=-0.500
σ634.024-595.881=38.142
min626.000-679.000=-53.000
max2828.000-2458.000=370.000
mean2.349-2.342=0.006
σ0.086-0.114=-0.028
min2.251-2.150=0.101
max2.609-2.616=-0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.586-324.576=0.010
σ0.052-0.054=-0.002
min324.496-324.481=0.015
max324.625-324.610=0.014
mean2828.000-2458.000=370.000
σ0.000
min2828.000-2458.000=370.000
max2828.000-2458.000=370.000
mean0.429-0.423=0.006
σ0.006-0.001=0.005
min0.423-0.422=0.001
max0.438-0.425=0.013
iters=5
new-facts=1
prior-facts=6402
mean1985.140-1985.145=-0.004
σ0.013-0.011=0.001
min1985.125-1985.125=-0.001
max1985.157-1985.153=0.004
mean2828.000-2458.000=370.000
σ0.000
min2828.000-2458.000=370.000
max2828.000-2458.000=370.000
mean2.753-2.671=0.082
σ0.144-0.146=-0.002
min2.557-2.549=0.008
max2.929-2.895=0.034
iters=5
new-facts=6402
prior-facts=1
mean4808.744-4808.541=0.203
σ7.673-7.780=-0.107
min4805.262-4804.684=0.578
max4822.469-4822.444=0.025
mean2828.000-2458.000=370.000
σ0.000
min2828.000-2458.000=370.000
max2828.000-2458.000=370.000
mean8.950-8.395=0.555
σ0.130-0.400=-0.270
min8.807-7.954=0.853
max9.104-8.909=0.195
iters=5
new-facts=6402
prior-facts=6402
mean4996.351-4996.269=0.082
σ0.023-0.147=-0.124
min4996.327-4996.007=0.320
max4996.376-4996.357=0.019
mean3047.400-2956.600=90.800
σ230.004-428.221=-198.217
min2828.000-2472.000=356.000
max3286.000-3539.000=-253.000
mean8.645-8.499=0.145
σ0.113-0.122=-0.009
min8.490-8.429=0.062
max8.785-8.715=0.069

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.000-1.722=-0.722
σ0.065-0.098=-0.033
min0.920-1.561=-0.641
max1.054-1.810=-0.756

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.976-462.946=0.029
σ574.253-574.245=0.009
min175.838-175.819=0.020
max1324.355-1324.313=0.042
mean86.250
σ8.500
min82.000
max99.000
mean2828.000-2458.000=370.000
σ0.000
min2828.000-2458.000=370.000
max2828.000-2458.000=370.000
mean0.432-0.565=-0.133
σ0.298-0.581=-0.282
min0.279-0.272=0.007
max0.879-1.436=-0.557
policies=20
mean1758.730-1758.520=0.209
σ0.347-0.348=-0.001
min1758.477-1758.282=0.195
max1759.242-1759.036=0.207
mean820.000
σ0.000
min820.000
max820.000
mean2828.000-2458.000=370.000
σ0.000
min2828.000-2458.000=370.000
max2828.000-2458.000=370.000
mean2.811-2.717=0.094
σ0.036-0.004=0.032
min2.778-2.711=0.067
max2.851-2.721=0.130
policies=200
mean17593.147-17592.348=0.799
σ0.637-0.587=0.049
min17592.229-17592.005=0.224
max17593.588-17593.223=0.366
mean8200.000
σ0.000
min8200.000
max8200.000
mean2828.000-2458.000=370.000
σ0.000
min2828.000-2458.000=370.000
max2828.000-2458.000=370.000
mean27.885-27.448=0.437
σ0.353-0.181=0.172
min27.552-27.263=0.290
max28.266-27.668=0.598