Compare commits

Home / Compare e8f41c51 .. 910249c9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.702-70.700=0.001
σ0.045-0.046=-0.001
min70.674-70.672=0.002
max70.827-70.828=-0.002
mean417.000-412.800=4.200
σ0.000-0.422=-0.422
min417.000-412.000=5.000
max417.000-413.000=4.000
mean0.159-0.161=-0.001
σ0.003-0.004=-0.000
min0.155-0.157=-0.002
max0.164-0.167=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.408-21.409=-0.000
σ0.002-0.002=0.001
min21.404-21.407=-0.003
max21.411-21.412=-0.001
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.065-0.066=-0.000
σ0.002-0.003=-0.001
min0.063-0.064=-0.001
max0.071-0.075=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.930=0.001
σ0.361-0.361=-0.000
min1754.357-1754.356=0.001
max1755.513-1755.519=-0.006
mean1648.500-1655.500=-7.000
σ632.479-620.093=12.386
min625.000-680.000=-55.000
max2774.000-2771.000=3.000
mean2.814-2.821=-0.007
σ0.208-0.180=0.028
min2.136-2.319=-0.183
max3.124-3.053=0.072

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.794-272.795=-0.001
σ0.006-0.007=-0.001
min272.786-272.786=0.000
max272.802-272.803=-0.001
mean2774.000-2771.000=3.000
σ0.000
min2774.000-2771.000=3.000
max2774.000-2771.000=3.000
mean0.377-0.382=-0.005
σ0.003-0.005=-0.002
min0.374-0.378=-0.004
max0.381-0.389=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1933.226-1933.227=-0.001
σ0.006-0.011=-0.005
min1933.218-1933.211=0.007
max1933.234-1933.239=-0.005
mean2774.000-2771.000=3.000
σ0.000
min2774.000-2771.000=3.000
max2774.000-2771.000=3.000
mean3.099-3.199=-0.100
σ0.102-0.058=0.044
min3.017-3.121=-0.104
max3.238-3.278=-0.040
iters=5
new-facts=6402
prior-facts=1
mean4756.938-4757.049=-0.112
σ7.601-7.545=0.056
min4753.507-4753.554=-0.047
max4770.535-4770.545=-0.010
mean2774.000-2771.000=3.000
σ0.000
min2774.000-2771.000=3.000
max2774.000-2771.000=3.000
mean8.502-7.931=0.571
σ0.246-0.414=-0.168
min8.095-7.616=0.479
max8.739-8.627=0.112
iters=5
new-facts=6402
prior-facts=6402
mean4944.456-4944.394=0.063
σ0.009-0.162=-0.153
min4944.443-4944.105=0.339
max4944.468-4944.479=-0.011
mean3049.000-2969.200=79.800
σ266.364-259.429=6.936
min2774.000-2771.000=3.000
max3419.000-3347.000=72.000
mean8.729-8.626=0.104
σ0.352-0.264=0.087
min8.404-8.349=0.056
max9.226-8.999=0.227

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.031-1.008=0.023
σ0.126-0.145=-0.018
min0.916-0.913=0.003
max1.222-1.246=-0.024

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.314-468.311=0.004
σ574.227-574.233=-0.006
min181.192-181.184=0.008
max1329.655-1329.660=-0.006
mean88.250
σ8.500
min84.000
max101.000
mean2774.000-2771.000=3.000
σ0.000
min2774.000-2771.000=3.000
max2774.000-2771.000=3.000
mean0.442-0.439=0.003
σ0.302-0.291=0.011
min0.288-0.290=-0.002
max0.895-0.876=0.019
policies=20
mean1812.220-1812.203=0.017
σ0.385-0.394=-0.010
min1811.952-1811.935=0.017
max1812.785-1812.784=0.001
mean840.000
σ0.000
min840.000
max840.000
mean2774.000-2771.000=3.000
σ0.000
min2774.000-2771.000=3.000
max2774.000-2771.000=3.000
mean2.875-2.883=-0.007
σ0.019-0.013=0.006
min2.852-2.864=-0.012
max2.897-2.892=0.005
policies=200
mean18129.025-18129.075=-0.049
σ0.501-0.482=0.020
min18128.720-18128.740=-0.020
max18129.775-18129.789=-0.014
mean8400.000
σ0.000
min8400.000
max8400.000
mean2774.000-2771.000=3.000
σ0.000
min2774.000-2771.000=3.000
max2774.000-2771.000=3.000
mean28.356-28.366=-0.010
σ0.287-0.211=0.075
min28.147-28.207=-0.060
max28.755-28.673=0.082