Compare commits

Home / Compare eb72af3e .. 27b0310e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.047-54.048=-0.001
σ0.368-0.369=-0.001
min53.910-53.903=0.007
max55.094-55.097=-0.004
mean418.700-421.000=-2.300
σ0.483-0.000=0.483
min418.000-421.000=-3.000
max419.000-421.000=-2.000
mean0.139-0.138=0.001
σ0.003-0.004=-0.000
min0.135-0.134=0.001
max0.144-0.144=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.342-43.342=-0.000
σ0.006-0.006=0.000
min43.336-43.334=0.002
max43.353-43.351=0.002
mean419.000-421.000=-2.000
σ0.000
min419.000-421.000=-2.000
max419.000-421.000=-2.000
mean0.120-0.121=-0.001
σ0.004-0.003=0.001
min0.114-0.118=-0.004
max0.127-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.199-1017.201=-0.002
σ1.200-1.165=0.035
min1016.639-1016.625=0.014
max1022.231-1022.080=0.151
mean1061.250-1059.150=2.100
σ316.409-310.517=5.892
min563.000-567.000=-4.000
max1519.000-1517.000=2.000
mean1.529-1.512=0.017
σ0.093-0.052=0.041
min1.450-1.452=-0.003
max1.862-1.625=0.237

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.030-301.994=0.036
σ0.232-0.220=0.012
min301.848-301.849=-0.000
max302.664-302.594=0.070
mean2083.000-1966.000=117.000
σ0.000
min2083.000-1966.000=117.000
max2083.000-1966.000=117.000
mean0.576-0.598=-0.021
σ0.030-0.009=0.022
min0.524-0.581=-0.056
max0.609-0.606=0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.789-303.792=-0.003
σ0.058-0.043=0.016
min303.695-303.726=-0.031
max303.845-303.837=0.008
mean1519.000-1517.000=2.000
σ0.000
min1519.000-1517.000=2.000
max1519.000-1517.000=2.000
mean0.394-0.391=0.003
σ0.005-0.001=0.005
min0.390-0.390=0.000
max0.404-0.392=0.011
iters=5
new-facts=1
prior-facts=6402
mean1326.328-1326.331=-0.002
σ0.100-0.110=-0.009
min1326.199-1326.195=0.004
max1326.453-1326.487=-0.034
mean1519.000-1517.000=2.000
σ0.000
min1519.000-1517.000=2.000
max1519.000-1517.000=2.000
mean1.931-1.966=-0.035
σ0.074-0.114=-0.040
min1.845-1.817=0.028
max1.996-2.084=-0.088
iters=5
new-facts=6402
prior-facts=1
mean1564.409-1564.394=0.015
σ6.921-6.934=-0.013
min1561.106-1561.068=0.038
max1576.785-1576.792=-0.006
mean1519.000-1517.000=2.000
σ0.000
min1519.000-1517.000=2.000
max1519.000-1517.000=2.000
mean2.393-2.334=0.059
σ0.337-0.299=0.038
min2.070-2.104=-0.034
max2.821-2.853=-0.032
iters=5
new-facts=6402
prior-facts=6402
mean1894.276-1894.294=-0.018
σ0.063-0.087=-0.023
min1894.164-1894.144=0.020
max1894.318-1894.369=-0.051
mean1754.400-1761.800=-7.400
σ226.042-156.391=69.650
min1519.000-1529.000=-10.000
max2083.000-1966.000=117.000
mean2.982-3.000=-0.018
σ0.143-0.144=-0.000
min2.872-2.873=-0.002
max3.197-3.206=-0.009

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.543-1.551=-0.008
σ0.269-0.300=-0.031
min1.251-1.070=0.182
max1.845-1.864=-0.019

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.171-448.172=-0.001
σ581.465-581.463=0.002
min157.435-157.435=0.000
max1320.368-1320.366=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1519.000-1517.000=2.000
σ0.000
min1519.000-1517.000=2.000
max1519.000-1517.000=2.000
mean0.554-0.546=0.008
σ0.581-0.570=0.011
min0.261-0.257=0.004
max1.425-1.401=0.025
policies=20
mean1574.615-1574.634=-0.019
σ0.337-0.343=-0.006
min1574.398-1574.412=-0.014
max1575.118-1575.146=-0.028
mean920.000
σ0.000
min920.000
max920.000
mean1519.000-1517.000=2.000
σ0.000
min1519.000-1517.000=2.000
max1519.000-1517.000=2.000
mean2.618-2.627=-0.008
σ0.007-0.006=0.001
min2.608-2.619=-0.011
max2.625-2.634=-0.009
policies=200
mean15754.474-15754.505=-0.031
σ0.067-0.065=0.002
min15754.420-15754.445=-0.025
max15754.571-15754.595=-0.024
mean9200.000
σ0.000
min9200.000
max9200.000
mean1519.000-1517.000=2.000
σ0.000
min1519.000-1517.000=2.000
max1519.000-1517.000=2.000
mean26.669-26.637=0.033
σ0.166-0.204=-0.038
min26.488-26.437=0.051
max26.855-26.850=0.005