Compare commits

Home / Compare 48f58b46 .. 15db5c43

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.837-53.834=0.003
σ0.367-0.368=-0.001
min53.688-53.689=-0.001
max54.881-54.880=0.000
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.140-0.139=0.001
σ0.008-0.005=0.003
min0.130-0.134=-0.005
max0.159-0.145=0.014
cache=y
dps=1
iters=10
policies=100
mean43.211-43.209=0.002
σ0.008-0.004=0.003
min43.200-43.201=-0.001
max43.229-43.216=0.013
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.129-0.122=0.007
σ0.008-0.004=0.004
min0.118-0.119=-0.001
max0.138-0.129=0.010

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.205-1016.206=-0.001
σ1.186-1.160=0.026
min1015.630-1015.630=-0.001
max1021.173-1021.064=0.109
mean1046.250-1044.150=2.100
σ311.460-311.235=0.225
min554.000-580.000=-26.000
max1511.000-1631.000=-120.000
mean1.525-1.546=-0.021
σ0.060-0.095=-0.035
min1.445-1.436=0.009
max1.652-1.804=-0.152

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.363-301.285=0.079
σ0.218-0.212=0.006
min301.231-301.115=0.116
max301.958-301.851=0.107
mean2013.000-2020.000=-7.000
σ0.000
min2013.000-2020.000=-7.000
max2013.000-2020.000=-7.000
mean0.537-0.567=-0.030
σ0.031-0.044=-0.013
min0.506-0.504=0.003
max0.581-0.609=-0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.475-300.725=0.750
σ0.063-0.026=0.037
min301.374-300.694=0.680
max301.534-300.762=0.772
mean1511.000-1631.000=-120.000
σ0.000
min1511.000-1631.000=-120.000
max1511.000-1631.000=-120.000
mean0.395-0.395=-0.000
σ0.006-0.006=0.001
min0.391-0.391=0.001
max0.406-0.403=0.003
iters=5
new-facts=1
prior-facts=6402
mean1324.060-1322.882=1.178
σ0.110-0.095=0.016
min1323.924-1322.837=1.086
max1324.198-1323.052=1.146
mean1511.000-1631.000=-120.000
σ0.000
min1511.000-1631.000=-120.000
max1511.000-1631.000=-120.000
mean1.881-1.881=0.000
σ0.058-0.085=-0.027
min1.820-1.765=0.055
max1.965-1.976=-0.010
iters=5
new-facts=6402
prior-facts=1
mean1562.077-1561.387=0.690
σ6.911-6.887=0.024
min1558.798-1558.000=0.798
max1574.436-1573.700=0.736
mean1511.000-1631.000=-120.000
σ0.000
min1511.000-1631.000=-120.000
max1511.000-1631.000=-120.000
mean2.300-2.477=-0.177
σ0.290-0.392=-0.102
min2.027-2.037=-0.010
max2.639-2.867=-0.228
iters=5
new-facts=6402
prior-facts=6402
mean1891.978-1890.818=1.160
σ0.067-0.024=0.043
min1891.859-1890.785=1.074
max1892.016-1890.846=1.170
mean1731.200-1763.600=-32.400
σ209.771-164.798=44.973
min1511.000-1631.000=-120.000
max2013.000-2020.000=-7.000
mean2.903-2.927=-0.024
σ0.033-0.121=-0.088
min2.876-2.856=0.020
max2.957-3.142=-0.185

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.561-1.236=0.326
σ0.254-0.315=-0.060
min1.234-0.914=0.320
max1.748-1.727=0.021

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.480-443.492=-0.012
σ574.238-574.239=-0.001
min156.360-156.366=-0.006
max1304.837-1304.851=-0.014
mean96.250
σ8.500
min92.000
max109.000
mean1511.000-1631.000=-120.000
σ0.000
min1511.000-1631.000=-120.000
max1511.000-1631.000=-120.000
mean0.545-0.533=0.012
σ0.569-0.541=0.027
min0.252-0.261=-0.009
max1.398-1.345=0.053
policies=20
mean1563.887-1563.907=-0.020
σ0.344-0.335=0.009
min1563.664-1563.717=-0.053
max1564.400-1564.409=-0.009
mean920.000
σ0.000
min920.000
max920.000
mean1511.000-1631.000=-120.000
σ0.000
min1511.000-1631.000=-120.000
max1511.000-1631.000=-120.000
mean2.620-2.632=-0.012
σ0.009-0.036=-0.027
min2.608-2.597=0.011
max2.629-2.677=-0.049
policies=200
mean15647.016-15647.013=0.003
σ0.097-0.058=0.039
min15646.889-15646.960=-0.071
max15647.125-15647.087=0.038
mean9200.000
σ0.000
min9200.000
max9200.000
mean1511.000-1631.000=-120.000
σ0.000
min1511.000-1631.000=-120.000
max1511.000-1631.000=-120.000
mean26.562-26.565=-0.003
σ0.122-0.247=-0.125
min26.423-26.313=0.110
max26.692-26.883=-0.191