Compare commits

Home / Compare 2ff7e46f .. ee6d315a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.780-70.781=-0.001
σ0.044-0.055=-0.012
min70.757-70.746=0.011
max70.901-70.935=-0.033
mean412.000
σ0.000
min412.000
max412.000
mean0.157-0.159=-0.002
σ0.010-0.004=0.006
min0.130-0.151=-0.021
max0.167-0.165=0.002
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=-0.001
σ0.003-0.003=0.000
min21.489-21.489=-0.001
max21.497-21.497=-0.000
mean412.000
σ0.000
min412.000
max412.000
mean0.063-0.064=-0.001
σ0.003-0.002=0.001
min0.059-0.060=-0.000
max0.069-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.091-1751.880=2.211
σ0.362-0.360=0.002
min1753.530-1751.314=2.216
max1754.672-1752.470=2.203
mean1665.700-1663.400=2.300
σ634.022-625.968=8.053
min666.000-649.000=17.000
max2724.000-2503.000=221.000
mean2.770-2.787=-0.017
σ0.240-0.200=0.040
min2.161-2.146=0.015
max3.005-3.160=-0.155

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.927-269.377=2.550
σ0.007-0.003=0.004
min271.918-269.373=2.545
max271.934-269.380=2.554
mean2724.000-2503.000=221.000
σ0.000
min2724.000-2503.000=221.000
max2724.000-2503.000=221.000
mean0.384-0.378=0.005
σ0.008-0.004=0.004
min0.377-0.374=0.003
max0.396-0.383=0.013
iters=5
new-facts=1
prior-facts=6402
mean1932.330-1929.743=2.587
σ0.010-0.017=-0.007
min1932.318-1929.724=2.594
max1932.343-1929.769=2.575
mean2724.000-2503.000=221.000
σ0.000
min2724.000-2503.000=221.000
max2724.000-2503.000=221.000
mean2.997-3.011=-0.014
σ0.071-0.047=0.024
min2.894-2.979=-0.085
max3.094-3.094=-0.000
iters=5
new-facts=6402
prior-facts=1
mean4753.079-4750.525=2.554
σ0.943-0.873=0.070
min4752.514-4750.058=2.455
max4754.752-4752.080=2.672
mean2724.000-2503.000=221.000
σ0.000
min2724.000-2503.000=221.000
max2724.000-2503.000=221.000
mean8.688-8.425=0.264
σ0.493-0.480=0.013
min7.968-7.634=0.334
max9.242-8.874=0.368
iters=5
new-facts=6402
prior-facts=6402
mean4943.557-4940.986=2.570
σ0.022-0.013=0.009
min4943.524-4940.969=2.555
max4943.575-4940.997=2.577
mean2996.600-2961.000=35.600
σ230.965-315.448=-84.483
min2724.000-2503.000=221.000
max3294.000-3348.000=-54.000
mean8.460-8.499=-0.039
σ0.121-0.106=0.015
min8.321-8.405=-0.084
max8.609-8.668=-0.059

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.022-1.688=-0.665
σ0.140-0.262=-0.122
min0.927-1.248=-0.321
max1.244-1.876=-0.632

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.655-466.056=2.599
σ574.925-574.928=-0.003
min181.185-178.590=2.595
max1331.042-1328.447=2.595
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2724.000-2503.000=221.000
σ0.000
min2724.000-2503.000=221.000
max2724.000-2503.000=221.000
mean0.570-0.563=0.008
σ0.568-0.558=0.009
min0.284-0.279=0.005
max1.422-1.400=0.021
policies=20
mean1812.177-1786.154=26.023
σ0.379-0.367=0.012
min1811.924-1785.929=25.995
max1812.738-1786.702=26.036
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2724.000-2503.000=221.000
σ0.000
min2724.000-2503.000=221.000
max2724.000-2503.000=221.000
mean2.836-2.777=0.059
σ0.010-0.006=0.005
min2.822-2.772=0.050
max2.845-2.784=0.061
policies=200
mean18128.940-17868.477=260.463
σ0.554-0.603=-0.049
min18128.353-17868.150=260.203
max18129.654-17869.380=260.273
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2724.000-2503.000=221.000
σ0.000
min2724.000-2503.000=221.000
max2724.000-2503.000=221.000
mean28.425-27.895=0.531
σ0.076-0.065=0.011
min28.345-27.817=0.527
max28.527-27.974=0.553