Compare commits

Home / Compare bdfa72fd .. 17a2a48c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.015=-0.001
σ0.371-0.370=0.001
min53.873-53.877=-0.003
max55.069-55.068=0.001
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.138-0.139=-0.001
σ0.003-0.006=-0.002
min0.135-0.131=0.004
max0.144-0.148=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.321-43.322=-0.001
σ0.007-0.006=0.001
min43.308-43.313=-0.004
max43.336-43.334=0.001
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.117-0.119=-0.002
σ0.004-0.004=0.001
min0.112-0.114=-0.002
max0.125-0.126=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1011.001-1011.000=0.001
σ1.165-1.158=0.007
min1010.432-1010.467=-0.035
max1015.880-1015.849=0.031
mean1043.900-1048.850=-4.950
σ292.674-316.100=-23.426
min593.000-591.000=2.000
max1426.000-1654.000=-228.000
mean1.555-1.557=-0.002
σ0.086-0.133=-0.048
min1.452-1.463=-0.011
max1.741-2.049=-0.307

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.073-301.046=0.027
σ0.179-0.263=-0.084
min300.881-300.850=0.031
max301.514-301.772=-0.258
mean1941.000-1954.000=-13.000
σ0.000
min1941.000-1954.000=-13.000
max1941.000-1954.000=-13.000
mean0.548-0.538=0.010
σ0.032-0.030=0.002
min0.503-0.498=0.006
max0.578-0.573=0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean299.456-299.445=0.011
σ0.038-0.050=-0.012
min299.414-299.372=0.042
max299.505-299.499=0.006
mean1426.000-1654.000=-228.000
σ0.000
min1426.000-1654.000=-228.000
max1426.000-1654.000=-228.000
mean0.389-0.386=0.003
σ0.008-0.006=0.002
min0.384-0.382=0.002
max0.403-0.397=0.006
iters=5
new-facts=1
prior-facts=6402
mean1309.877-1309.875=0.003
σ0.087-0.087=-0.000
min1309.766-1309.768=-0.002
max1309.999-1310.003=-0.004
mean1426.000-1654.000=-228.000
σ0.000
min1426.000-1654.000=-228.000
max1426.000-1654.000=-228.000
mean1.914-1.887=0.027
σ0.069-0.051=0.018
min1.808-1.801=0.007
max2.000-1.924=0.076
iters=5
new-facts=6402
prior-facts=1
mean1553.969-1553.989=-0.020
σ6.863-6.892=-0.030
min1550.653-1550.686=-0.033
max1566.239-1566.312=-0.073
mean1426.000-1654.000=-228.000
σ0.000
min1426.000-1654.000=-228.000
max1426.000-1654.000=-228.000
mean2.279-2.344=-0.065
σ0.207-0.281=-0.074
min2.043-2.039=0.004
max2.542-2.653=-0.111
iters=5
new-facts=6402
prior-facts=6402
mean1871.763-1871.763=0.000
σ0.044-0.052=-0.008
min1871.709-1871.699=0.010
max1871.801-1871.806=-0.005
mean1721.400-1768.000=-46.600
σ159.500-123.966=35.534
min1524.000-1654.000=-130.000
max1941.000-1954.000=-13.000
mean2.911-2.914=-0.004
σ0.068-0.098=-0.030
min2.831-2.797=0.034
max2.982-3.060=-0.078

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.699-1.192=0.507
σ0.178-0.303=-0.125
min1.389-0.932=0.457
max1.846-1.691=0.155

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.793-447.807=-0.013
σ581.214-581.237=-0.023
min157.183-157.186=-0.002
max1319.615-1319.662=-0.048
mean96.250
σ8.500
min92.000
max109.000
mean1426.000-1654.000=-228.000
σ0.000
min1426.000-1654.000=-228.000
max1426.000-1654.000=-228.000
mean0.534-0.534=0.000
σ0.535-0.561=-0.026
min0.260-0.237=0.023
max1.337-1.375=-0.038
policies=20
mean1572.115-1572.135=-0.020
σ0.343-0.334=0.009
min1571.901-1571.955=-0.055
max1572.628-1572.635=-0.008
mean920.000
σ0.000
min920.000
max920.000
mean1426.000-1654.000=-228.000
σ0.000
min1426.000-1654.000=-228.000
max1426.000-1654.000=-228.000
mean2.633-2.631=0.002
σ0.011-0.010=0.001
min2.623-2.616=0.007
max2.648-2.639=0.009
policies=200
mean15728.940-15728.992=-0.051
σ0.144-0.141=0.003
min15728.769-15728.856=-0.087
max15729.077-15729.184=-0.108
mean9200.000
σ0.000
min9200.000
max9200.000
mean1426.000-1654.000=-228.000
σ0.000
min1426.000-1654.000=-228.000
max1426.000-1654.000=-228.000
mean26.686-26.667=0.018
σ0.377-0.102=0.274
min26.394-26.541=-0.147
max27.228-26.757=0.471