Compare commits

Home / Compare 9aa8a80f .. bdfa72fd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.040=-0.025
σ0.370-0.370=-0.000
min53.877-53.894=-0.018
max55.068-55.094=-0.026
mean419.000-414.000=5.000
σ0.000
min419.000-414.000=5.000
max419.000-414.000=5.000
mean0.139-0.139=0.000
σ0.006-0.003=0.002
min0.131-0.135=-0.004
max0.148-0.146=0.002
cache=y
dps=1
iters=10
policies=100
mean43.322-43.343=-0.021
σ0.006-0.006=-0.000
min43.313-43.334=-0.021
max43.334-43.357=-0.023
mean419.000-414.600=4.400
σ0.000-0.516=-0.516
min419.000-414.000=5.000
max419.000-415.000=4.000
mean0.119-0.125=-0.006
σ0.004-0.010=-0.006
min0.114-0.115=-0.001
max0.126-0.142=-0.016

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1011.000-1017.198=-6.199
σ1.158-1.192=-0.034
min1010.467-1016.655=-6.188
max1015.849-1022.196=-6.347
mean1048.850-1052.850=-4.000
σ316.100-310.326=5.774
min591.000-562.000=29.000
max1654.000-1510.000=144.000
mean1.557-1.559=-0.001
σ0.133-0.054=0.079
min1.463-1.472=-0.009
max2.049-1.658=0.391

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.046-302.035=-0.990
σ0.263-0.248=0.015
min300.850-301.778=-0.928
max301.772-302.685=-0.913
mean1954.000-2042.000=-88.000
σ0.000
min1954.000-2042.000=-88.000
max1954.000-2042.000=-88.000
mean0.538-0.580=-0.042
σ0.030-0.041=-0.011
min0.498-0.499=-0.002
max0.573-0.612=-0.039

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean299.445-303.782=-4.337
σ0.050-0.061=-0.011
min299.372-303.684=-4.312
max299.499-303.836=-4.337
mean1654.000-1510.000=144.000
σ0.000
min1654.000-1510.000=144.000
max1654.000-1510.000=144.000
mean0.386-0.393=-0.008
σ0.006-0.001=0.005
min0.382-0.392=-0.010
max0.397-0.395=0.001
iters=5
new-facts=1
prior-facts=6402
mean1309.875-1326.328=-16.454
σ0.087-0.106=-0.019
min1309.768-1326.199=-16.431
max1310.003-1326.461=-16.459
mean1654.000-1510.000=144.000
σ0.000
min1654.000-1510.000=144.000
max1654.000-1510.000=144.000
mean1.887-1.928=-0.041
σ0.051-0.146=-0.095
min1.801-1.791=0.010
max1.924-2.130=-0.205
iters=5
new-facts=6402
prior-facts=1
mean1553.989-1564.375=-10.387
σ6.892-6.912=-0.020
min1550.686-1561.081=-10.395
max1566.312-1576.735=-10.424
mean1654.000-1510.000=144.000
σ0.000
min1654.000-1510.000=144.000
max1654.000-1510.000=144.000
mean2.344-2.297=0.047
σ0.281-0.261=0.020
min2.039-2.040=-0.002
max2.653-2.619=0.034
iters=5
new-facts=6402
prior-facts=6402
mean1871.763-1894.277=-22.514
σ0.052-0.068=-0.016
min1871.699-1894.156=-22.457
max1871.806-1894.316=-22.509
mean1768.000-1735.200=32.800
σ123.966-217.188=-93.222
min1654.000-1510.000=144.000
max1954.000-2042.000=-88.000
mean2.914-2.947=-0.032
σ0.098-0.114=-0.016
min2.797-2.879=-0.081
max3.060-3.150=-0.089

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.192-1.515=-0.323
σ0.303-0.276=0.027
min0.932-1.217=-0.285
max1.691-1.810=-0.119

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.807-448.051=-0.244
σ581.237-581.227=0.010
min157.186-157.432=-0.246
max1319.662-1319.891=-0.229
mean96.250
σ8.500
min92.000
max109.000
mean1654.000-1510.000=144.000
σ0.000
min1654.000-1510.000=144.000
max1654.000-1510.000=144.000
mean0.534-0.551=-0.017
σ0.561-0.563=-0.002
min0.237-0.266=-0.029
max1.375-1.396=-0.021
policies=20
mean1572.135-1574.599=-2.464
σ0.334-0.358=-0.024
min1571.955-1574.367=-2.411
max1572.635-1575.133=-2.498
mean920.000
σ0.000
min920.000
max920.000
mean1654.000-1510.000=144.000
σ0.000
min1654.000-1510.000=144.000
max1654.000-1510.000=144.000
mean2.631-2.649=-0.018
σ0.010-0.042=-0.032
min2.616-2.611=0.005
max2.639-2.707=-0.068
policies=200
mean15728.992-15754.092=-25.100
σ0.141-0.048=0.093
min15728.856-15754.041=-25.185
max15729.184-15754.148=-24.963
mean9200.000
σ0.000
min9200.000
max9200.000
mean1654.000-1510.000=144.000
σ0.000
min1654.000-1510.000=144.000
max1654.000-1510.000=144.000
mean26.667-26.849=-0.181
σ0.102-0.172=-0.070
min26.541-26.716=-0.175
max26.757-27.089=-0.332