Compare commits

Home / Compare f8560223 .. cb79bfda

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.971-53.970=0.001
σ0.370-0.369=0.001
min53.832-53.829=0.003
max55.023-55.020=0.003
mean417.000-419.400=-2.400
σ0.000-0.966=-0.966
min417.000-418.000=-1.000
max417.000-420.000=-3.000
mean0.137-0.137=-0.000
σ0.004-0.005=-0.000
min0.132-0.130=0.002
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.342-43.342=-0.000
σ0.007-0.006=0.000
min43.329-43.334=-0.005
max43.352-43.355=-0.002
mean417.800-420.000=-2.200
σ0.422-0.000=0.422
min417.000-420.000=-3.000
max418.000-420.000=-2.000
mean0.119-0.121=-0.002
σ0.004-0.004=0.001
min0.114-0.116=-0.002
max0.127-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.896-1016.898=-0.003
σ1.162-1.138=0.024
min1016.320-1016.316=0.004
max1021.761-1021.653=0.108
mean1063.300-1055.950=7.350
σ319.819-309.424=10.395
min583.000-591.000=-8.000
max1634.000-1630.000=4.000
mean1.523-1.501=0.022
σ0.086-0.087=-0.001
min1.430-1.334=0.096
max1.731-1.797=-0.066

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.912-301.962=-0.051
σ0.224-0.248=-0.024
min301.777-301.812=-0.035
max302.522-302.651=-0.129
mean2070.000-2035.000=35.000
σ0.000
min2070.000-2035.000=35.000
max2070.000-2035.000=35.000
mean0.581-0.588=-0.007
σ0.038-0.029=0.009
min0.509-0.509=0.001
max0.607-0.605=0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.505-303.515=-0.010
σ0.070-0.045=0.024
min303.390-303.447=-0.057
max303.560-303.561=-0.002
mean1634.000-1630.000=4.000
σ0.000
min1634.000-1630.000=4.000
max1634.000-1630.000=4.000
mean0.390-0.389=0.001
σ0.001-0.002=-0.000
min0.389-0.388=0.001
max0.392-0.392=0.000
iters=5
new-facts=1
prior-facts=6402
mean1326.062-1326.051=0.011
σ0.107-0.100=0.007
min1325.928-1325.926=0.002
max1326.199-1326.183=0.015
mean1634.000-1630.000=4.000
σ0.000
min1634.000-1630.000=4.000
max1634.000-1630.000=4.000
mean1.914-1.913=0.001
σ0.079-0.109=-0.030
min1.823-1.817=0.006
max2.015-2.077=-0.062
iters=5
new-facts=6402
prior-facts=1
mean1564.105-1564.127=-0.022
σ6.925-6.909=0.015
min1560.776-1560.840=-0.063
max1576.487-1576.482=0.004
mean1634.000-1630.000=4.000
σ0.000
min1634.000-1630.000=4.000
max1634.000-1630.000=4.000
mean2.261-2.360=-0.099
σ0.251-0.325=-0.074
min2.069-2.067=0.002
max2.695-2.745=-0.050
iters=5
new-facts=6402
prior-facts=6402
mean1894.013-1894.004=0.008
σ0.070-0.069=0.002
min1893.887-1893.882=0.005
max1894.054-1894.045=0.009
mean1799.800-1771.800=28.000
σ191.215-171.862=19.353
min1634.000-1630.000=4.000
max2070.000-2035.000=35.000
mean3.090-2.904=0.186
σ0.155-0.035=0.120
min2.978-2.878=0.100
max3.348-2.963=0.384

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.085-1.253=-0.169
σ0.216-0.316=-0.100
min0.895-1.045=-0.150
max1.386-1.805=-0.419

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.711-444.705=0.006
σ575.143-575.146=-0.003
min157.125-157.124=0.001
max1307.426-1307.424=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1634.000-1630.000=4.000
σ0.000
min1634.000-1630.000=4.000
max1634.000-1630.000=4.000
mean0.534-0.532=0.003
σ0.544-0.545=-0.002
min0.262-0.258=0.004
max1.350-1.350=-0.000
policies=20
mean1571.560-1571.538=0.022
σ0.322-0.334=-0.012
min1571.383-1571.340=0.043
max1572.042-1572.038=0.004
mean920.000
σ0.000
min920.000
max920.000
mean1634.000-1630.000=4.000
σ0.000
min1634.000-1630.000=4.000
max1634.000-1630.000=4.000
mean2.616-2.618=-0.002
σ0.014-0.030=-0.016
min2.602-2.590=0.013
max2.630-2.660=-0.030
policies=200
mean15723.305-15723.274=0.031
σ0.045-0.038=0.006
min15723.279-15723.232=0.047
max15723.371-15723.324=0.048
mean9200.000
σ0.000
min9200.000
max9200.000
mean1634.000-1630.000=4.000
σ0.000
min1634.000-1630.000=4.000
max1634.000-1630.000=4.000
mean26.525-26.530=-0.005
σ0.285-0.143=0.142
min26.247-26.421=-0.174
max26.877-26.732=0.145