Compare commits

Home / Compare 7dbc09f6 .. fb0e0403

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.047-53.971=0.076
σ0.368-0.369=-0.001
min53.903-53.824=0.078
max55.095-55.021=0.074
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.138-0.141=-0.003
σ0.004-0.004=0.000
min0.132-0.135=-0.003
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.341-43.342=-0.001
σ0.005-0.007=-0.002
min43.333-43.329=0.004
max43.351-43.354=-0.004
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.120-0.123=-0.002
σ0.004-0.003=0.001
min0.114-0.119=-0.005
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.200-1016.895=0.305
σ1.156-1.159=-0.002
min1016.627-1016.320=0.306
max1022.041-1021.745=0.296
mean1063.350-1058.050=5.300
σ312.940-311.231=1.709
min593.000-588.000=5.000
max1633.000-1617.000=16.000
mean1.511-1.508=0.003
σ0.067-0.046=0.021
min1.313-1.451=-0.137
max1.629-1.589=0.040

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.074-301.942=0.132
σ0.209-0.234=-0.025
min301.945-301.764=0.181
max302.657-302.584=0.073
mean1949.000-2032.000=-83.000
σ0.000
min1949.000-2032.000=-83.000
max1949.000-2032.000=-83.000
mean0.558-0.568=-0.010
σ0.042-0.032=0.010
min0.499-0.534=-0.035
max0.596-0.609=-0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.801-303.505=0.296
σ0.034-0.072=-0.038
min303.762-303.388=0.374
max303.842-303.568=0.274
mean1633.000-1617.000=16.000
σ0.000
min1633.000-1617.000=16.000
max1633.000-1617.000=16.000
mean0.390-0.391=-0.001
σ0.002-0.001=0.001
min0.389-0.390=-0.001
max0.393-0.393=0.000
iters=5
new-facts=1
prior-facts=6402
mean1326.326-1326.062=0.264
σ0.098-0.109=-0.010
min1326.191-1325.931=0.260
max1326.442-1326.200=0.242
mean1633.000-1617.000=16.000
σ0.000
min1633.000-1617.000=16.000
max1633.000-1617.000=16.000
mean2.037-1.901=0.136
σ0.159-0.056=0.102
min1.878-1.849=0.030
max2.264-1.965=0.300
iters=5
new-facts=6402
prior-facts=1
mean1564.413-1564.122=0.291
σ6.921-6.930=-0.009
min1561.088-1560.824=0.264
max1576.788-1576.513=0.274
mean1633.000-1617.000=16.000
σ0.000
min1633.000-1617.000=16.000
max1633.000-1617.000=16.000
mean2.420-2.332=0.088
σ0.284-0.294=-0.010
min2.161-2.071=0.089
max2.887-2.748=0.139
iters=5
new-facts=6402
prior-facts=6402
mean1894.289-1894.003=0.286
σ0.090-0.062=0.028
min1894.132-1893.894=0.238
max1894.356-1894.043=0.313
mean1780.000-1763.200=16.800
σ114.164-173.701=-59.537
min1633.000-1617.000=16.000
max1949.000-2032.000=-83.000
mean2.958-2.932=0.026
σ0.161-0.169=-0.008
min2.819-2.717=0.102
max3.216-3.160=0.056

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.193-1.198=-0.004
σ0.281-0.362=-0.081
min0.947-0.915=0.032
max1.630-1.798=-0.169

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.177-444.706=3.471
σ581.476-575.144=6.331
min157.434-157.123=0.311
max1320.391-1307.422=12.969
mean96.250
σ8.500
min92.000
max109.000
mean1633.000-1617.000=16.000
σ0.000
min1633.000-1617.000=16.000
max1633.000-1617.000=16.000
mean0.552-0.547=0.005
σ0.571-0.556=0.015
min0.263-0.264=-0.001
max1.409-1.381=0.028
policies=20
mean1574.630-1571.532=3.098
σ0.338-0.330=0.008
min1574.442-1571.343=3.100
max1575.138-1572.027=3.111
mean920.000
σ0.000
min920.000
max920.000
mean1633.000-1617.000=16.000
σ0.000
min1633.000-1617.000=16.000
max1633.000-1617.000=16.000
mean2.634-2.618=0.016
σ0.011-0.011=0.000
min2.623-2.606=0.017
max2.649-2.633=0.016
policies=200
mean15754.171-15723.276=30.895
σ0.050-0.072=-0.022
min15754.098-15723.226=30.872
max15754.212-15723.382=30.830
mean9200.000
σ0.000
min9200.000
max9200.000
mean1633.000-1617.000=16.000
σ0.000
min1633.000-1617.000=16.000
max1633.000-1617.000=16.000
mean26.619-26.444=0.175
σ0.146-0.141=0.004
min26.501-26.286=0.214
max26.801-26.582=0.219