Compare commits

Home / Compare 6a62bd22 .. 323a4ddb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.561-70.388=0.173
σ0.046-0.044=0.002
min70.539-70.362=0.177
max70.690-70.510=0.181
mean414.400-415.000=-0.600
σ0.516-0.000=0.516
min414.000-415.000=-1.000
max415.000
mean0.156-0.159=-0.002
σ0.005-0.003=0.002
min0.149-0.155=-0.005
max0.166-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.292-21.144=0.148
σ0.011-0.003=0.008
min21.284-21.140=0.144
max21.323-21.150=0.173
mean415.000
σ0.000
min415.000
max415.000
mean0.065-0.064=0.001
σ0.003-0.002=0.001
min0.063-0.062=0.001
max0.072-0.070=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.568-1752.395=1.172
σ0.361-0.362=-0.001
min1752.998-1751.824=1.175
max1754.141-1752.984=1.158
mean1642.800-1649.450=-6.650
σ630.591-627.418=3.173
min628.000-619.000=9.000
max2851.000-2662.000=189.000
mean2.796-2.849=-0.053
σ0.154-0.133=0.021
min2.323-2.584=-0.261
max3.016-3.074=-0.059

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.015-270.141=1.874
σ0.004-0.007=-0.003
min272.011-270.135=1.876
max272.020-270.152=1.868
mean2851.000-2662.000=189.000
σ0.000
min2851.000-2662.000=189.000
max2851.000-2662.000=189.000
mean0.382-0.377=0.005
σ0.012-0.003=0.009
min0.370-0.372=-0.002
max0.402-0.379=0.023
iters=5
new-facts=1
prior-facts=6402
mean1932.442-1930.597=1.845
σ0.010-0.017=-0.007
min1932.428-1930.573=1.854
max1932.457-1930.618=1.839
mean2851.000-2662.000=189.000
σ0.000
min2851.000-2662.000=189.000
max2851.000-2662.000=189.000
mean3.146-2.567=0.579
σ0.267-0.121=0.146
min2.985-2.434=0.550
max3.613-2.721=0.892
iters=5
new-facts=6402
prior-facts=1
mean4753.171-4751.127=2.044
σ0.811-0.754=0.057
min4752.698-4750.344=2.354
max4754.609-4752.372=2.237
mean2851.000-2662.000=189.000
σ0.000
min2851.000-2662.000=189.000
max2851.000-2662.000=189.000
mean8.449-8.266=0.183
σ0.541-0.515=0.026
min7.631-7.660=-0.029
max8.943-8.932=0.011
iters=5
new-facts=6402
prior-facts=6402
mean4943.635-4941.696=1.939
σ0.026-0.163=-0.136
min4943.603-4941.409=2.194
max4943.665-4941.795=1.870
mean3080.800-2996.600=84.200
σ232.578-363.796=-131.217
min2851.000-2662.000=189.000
max3316.000-3511.000=-195.000
mean8.752-8.584=0.168
σ0.361-0.352=0.009
min8.364-8.304=0.060
max9.309-9.176=0.133

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.082-1.156=-0.074
σ0.265-0.323=-0.058
min0.933-0.931=0.002
max1.545-1.640=-0.094

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.080-466.378=6.701
σ575.914-575.951=-0.037
min185.117-178.399=6.718
max1336.951-1330.305=6.646
mean88.250-84.250=4.000
σ8.500
min84.000-80.000=4.000
max101.000-97.000=4.000
mean2851.000-2662.000=189.000
σ0.000
min2851.000-2662.000=189.000
max2851.000-2662.000=189.000
mean0.448-0.554=-0.106
σ0.302-0.548=-0.246
min0.296-0.277=0.020
max0.900-1.375=-0.475
policies=20
mean1851.432-1784.322=67.109
σ0.377-0.348=0.030
min1851.155-1784.095=67.060
max1851.984-1784.839=67.145
mean840.000-800.000=40.000
σ0.000
min840.000-800.000=40.000
max840.000-800.000=40.000
mean2851.000-2662.000=189.000
σ0.000
min2851.000-2662.000=189.000
max2851.000-2662.000=189.000
mean2.924-2.816=0.108
σ0.019-0.046=-0.027
min2.901-2.772=0.130
max2.947-2.877=0.070
policies=200
mean18521.073-17849.742=671.331
σ0.573-0.518=0.054
min18520.735-17849.436=671.299
max18521.927-17850.517=671.410
mean8400.000-8000.000=400.000
σ0.000
min8400.000-8000.000=400.000
max8400.000-8000.000=400.000
mean2851.000-2662.000=189.000
σ0.000
min2851.000-2662.000=189.000
max2851.000-2662.000=189.000
mean29.007-28.063=0.944
σ0.431-0.171=0.260
min28.674-27.953=0.720
max29.621-28.316=1.305