Compare commits

Home / Compare 054777a3 .. 52854751

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.564-70.563=0.002
σ0.045-0.047=-0.002
min70.540-70.535=0.005
max70.691-70.694=-0.003
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.161-0.158=0.004
σ0.004-0.006=-0.001
min0.158-0.153=0.005
max0.169-0.168=0.001
cache=y
dps=1
iters=10
policies=100
mean21.291-21.291=-0.000
σ0.012-0.009=0.003
min21.284-21.284=0.001
max21.325-21.317=0.009
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.061-0.066=-0.005
σ0.003-0.003=0.000
min0.059-0.064=-0.005
max0.068-0.073=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.174-1715.262=37.912
σ0.358-169.622=-169.264
min1752.604-994.618=757.986
max1753.729-1753.759=-0.030
mean1664.250-1616.700=47.550
σ651.085-602.590=48.495
min629.000-634.000=-5.000
max2836.000-2435.000=401.000
mean2.853-2.760=0.093
σ0.122-0.320=-0.197
min2.447-1.492=0.955
max3.011-3.000=0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.625-271.620=0.004
σ0.007-0.008=-0.001
min271.617-271.609=0.007
max271.635-271.631=0.004
mean2836.000-2435.000=401.000
σ0.000
min2836.000-2435.000=401.000
max2836.000-2435.000=401.000
mean0.384-0.389=-0.005
σ0.009-0.011=-0.001
min0.379-0.381=-0.002
max0.400-0.407=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1932.044-1932.046=-0.002
σ0.016-0.008=0.008
min1932.030-1932.033=-0.003
max1932.071-1932.055=0.016
mean2836.000-2435.000=401.000
σ0.000
min2836.000-2435.000=401.000
max2836.000-2435.000=401.000
mean2.943-3.041=-0.097
σ0.278-0.125=0.153
min2.465-2.918=-0.453
max3.161-3.195=-0.033
iters=5
new-facts=6402
prior-facts=1
mean4752.833-4752.791=0.042
σ0.793-0.837=-0.044
min4752.434-4752.307=0.127
max4754.249-4754.281=-0.032
mean2836.000-2435.000=401.000
σ0.000
min2836.000-2435.000=401.000
max2836.000-2435.000=401.000
mean8.016-8.493=-0.478
σ0.406-0.406=-0.000
min7.655-7.823=-0.168
max8.453-8.917=-0.463
iters=5
new-facts=6402
prior-facts=6402
mean4943.231-4943.230=0.001
σ0.008-0.032=-0.024
min4943.220-4943.195=0.026
max4943.239-4943.271=-0.031
mean3069.000-3026.400=42.600
σ304.982-315.184=-10.202
min2836.000-2606.000=230.000
max3538.000-3431.000=107.000
mean8.409-8.691=-0.282
σ0.101-0.287=-0.186
min8.338-8.414=-0.076
max8.574-9.139=-0.565

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.995-1.785=-0.790
σ0.141-0.112=0.028
min0.927-1.665=-0.737
max1.246-1.938=-0.692

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.296-472.282=0.014
σ575.926-575.910=0.016
min184.321-184.323=-0.002
max1336.185-1336.147=0.038
mean88.250
σ8.500
min84.000
max101.000
mean2836.000-2435.000=401.000
σ0.000
min2836.000-2435.000=401.000
max2836.000-2435.000=401.000
mean0.451-0.563=-0.112
σ0.305-0.548=-0.243
min0.298-0.284=0.014
max0.909-1.385=-0.476
policies=20
mean1843.577-1843.548=0.029
σ0.382-0.383=-0.002
min1843.291-1843.284=0.007
max1844.128-1844.113=0.015
mean840.000
σ0.000
min840.000
max840.000
mean2836.000-2435.000=401.000
σ0.000
min2836.000-2435.000=401.000
max2836.000-2435.000=401.000
mean3.006-2.876=0.130
σ0.042-0.015=0.028
min2.960-2.855=0.105
max3.050-2.888=0.162
policies=200
mean18442.177-18442.092=0.085
σ0.537-0.611=-0.075
min18441.835-18441.670=0.164
max18442.977-18442.999=-0.022
mean8400.000
σ0.000
min8400.000
max8400.000
mean2836.000-2435.000=401.000
σ0.000
min2836.000-2435.000=401.000
max2836.000-2435.000=401.000
mean29.094-29.024=0.070
σ0.510-0.162=0.348
min28.813-28.810=0.003
max29.859-29.203=0.656