Compare commits

Home / Compare db6f2d4e .. a9f75895

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.948-53.947=0.000
σ0.369-0.368=0.002
min53.806-53.805=0.000
max54.998-54.993=0.006
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.139-0.141=-0.002
σ0.004-0.004=-0.000
min0.135-0.137=-0.002
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.321-43.322=-0.001
σ0.007-0.007=-0.000
min43.310-43.308=0.002
max43.334-43.331=0.002
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.118-0.123=-0.004
σ0.009-0.003=0.006
min0.094-0.119=-0.025
max0.126-0.127=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1010.697-1010.696=0.001
σ1.154-1.153=0.001
min1010.129-1010.127=0.002
max1015.523-1015.519=0.004
mean1050.900-1039.450=11.450
σ309.437-293.780=15.656
min566.000-560.000=6.000
max1645.000-1457.000=188.000
mean1.517-1.507=0.010
σ0.089-0.081=0.008
min1.434-1.386=0.048
max1.739-1.747=-0.008

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean300.939-300.852=0.087
σ0.300-0.304=-0.004
min300.686-300.665=0.021
max301.748-301.655=0.092
mean2017.000-1936.000=81.000
σ0.000
min2017.000-1936.000=81.000
max2017.000-1936.000=81.000
mean0.549-0.591=-0.042
σ0.026-0.043=-0.017
min0.509-0.552=-0.043
max0.589-0.701=-0.112

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean299.176-299.191=-0.015
σ0.052-0.043=0.009
min299.099-299.150=-0.050
max299.226-299.255=-0.028
mean1645.000-1457.000=188.000
σ0.000
min1645.000-1457.000=188.000
max1645.000-1457.000=188.000
mean0.384-0.385=-0.002
σ0.001-0.001=-0.000
min0.382-0.384=-0.001
max0.385-0.387=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1309.621-1309.613=0.008
σ0.104-0.093=0.010
min1309.492-1309.497=-0.005
max1309.744-1309.725=0.019
mean1645.000-1457.000=188.000
σ0.000
min1645.000-1457.000=188.000
max1645.000-1457.000=188.000
mean1.900-1.854=0.046
σ0.092-0.071=0.021
min1.793-1.782=0.012
max2.006-1.957=0.049
iters=5
new-facts=6402
prior-facts=1
mean1553.705-1553.691=0.014
σ6.862-6.880=-0.018
min1550.388-1550.348=0.040
max1565.974-1565.992=-0.019
mean1645.000-1457.000=188.000
σ0.000
min1645.000-1457.000=188.000
max1645.000-1457.000=188.000
mean2.339-2.222=0.116
σ0.275-0.269=0.006
min2.070-2.060=0.010
max2.641-2.699=-0.059
iters=5
new-facts=6402
prior-facts=6402
mean1871.492-1871.489=0.003
σ0.051-0.048=0.003
min1871.433-1871.437=-0.004
max1871.536-1871.534=0.002
mean1782.800-1738.800=44.000
σ161.174-209.861=-48.687
min1645.000-1457.000=188.000
max2017.000-1936.000=81.000
mean3.076-2.908=0.168
σ0.327-0.114=0.213
min2.845-2.801=0.045
max3.616-3.081=0.534

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.083-1.736=-0.653
σ0.149-0.079=0.070
min0.909-1.672=-0.763
max1.256-1.850=-0.594

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.456-444.440=0.016
σ575.147-575.128=0.019
min156.873-156.876=-0.003
max1307.177-1307.133=0.045
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1457.000=188.000
σ0.000
min1645.000-1457.000=188.000
max1645.000-1457.000=188.000
mean0.537-0.537=0.001
σ0.567-0.537=0.030
min0.234-0.266=-0.032
max1.388-1.342=0.046
policies=20
mean1569.034-1569.017=0.018
σ0.327-0.329=-0.003
min1568.845-1568.803=0.041
max1569.523-1569.508=0.015
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1457.000=188.000
σ0.000
min1645.000-1457.000=188.000
max1645.000-1457.000=188.000
mean2.618-2.612=0.007
σ0.006-0.014=-0.008
min2.611-2.597=0.014
max2.625-2.627=-0.003
policies=200
mean15697.974-15698.018=-0.044
σ0.108-0.070=0.039
min15697.842-15697.950=-0.108
max15698.090-15698.103=-0.013
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1457.000=188.000
σ0.000
min1645.000-1457.000=188.000
max1645.000-1457.000=188.000
mean26.445-26.464=-0.019
σ0.171-0.152=0.020
min26.298-26.312=-0.014
max26.653-26.613=0.040