Compare commits

Home / Compare c23b1e04 .. b13b9cb5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.014=0.001
σ0.367-0.371=-0.004
min53.868-53.873=-0.005
max55.059-55.069=-0.010
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.135-0.138=-0.004
σ0.005-0.003=0.002
min0.130-0.135=-0.005
max0.143-0.144=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.323-43.321=0.003
σ0.006-0.007=-0.001
min43.314-43.308=0.006
max43.334-43.336=-0.001
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.123-0.117=0.005
σ0.003-0.004=-0.001
min0.119-0.112=0.007
max0.128-0.125=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1011.001-1011.001=0.001
σ1.213-1.165=0.048
min1010.463-1010.432=0.031
max1016.095-1015.880=0.215
mean1054.700-1043.900=10.800
σ312.814-292.674=20.139
min589.000-593.000=-4.000
max1509.000-1426.000=83.000
mean1.588-1.555=0.032
σ0.101-0.086=0.016
min1.491-1.452=0.039
max1.895-1.741=0.154

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean300.887-301.073=-0.186
σ0.213-0.179=0.034
min300.727-300.881=-0.154
max301.460-301.514=-0.055
mean2019.000-1941.000=78.000
σ0.000
min2019.000-1941.000=78.000
max2019.000-1941.000=78.000
mean0.562-0.548=0.014
σ0.030-0.032=-0.002
min0.512-0.503=0.009
max0.601-0.578=0.023

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean299.437-299.456=-0.019
σ0.056-0.038=0.018
min299.351-299.414=-0.063
max299.489-299.505=-0.016
mean1509.000-1426.000=83.000
σ0.000
min1509.000-1426.000=83.000
max1509.000-1426.000=83.000
mean0.388-0.389=-0.001
σ0.007-0.008=-0.000
min0.383-0.384=-0.001
max0.401-0.403=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1309.887-1309.877=0.010
σ0.102-0.087=0.015
min1309.755-1309.766=-0.011
max1309.990-1309.999=-0.008
mean1509.000-1426.000=83.000
σ0.000
min1509.000-1426.000=83.000
max1509.000-1426.000=83.000
mean1.822-1.914=-0.092
σ0.093-0.069=0.024
min1.694-1.808=-0.114
max1.921-2.000=-0.079
iters=5
new-facts=6402
prior-facts=1
mean1553.963-1553.969=-0.006
σ6.873-6.863=0.011
min1550.615-1550.653=-0.038
max1566.254-1566.239=0.014
mean1509.000-1426.000=83.000
σ0.000
min1509.000-1426.000=83.000
max1509.000-1426.000=83.000
mean2.282-2.279=0.004
σ0.272-0.207=0.065
min2.119-2.043=0.076
max2.762-2.542=0.220
iters=5
new-facts=6402
prior-facts=6402
mean1871.778-1871.763=0.015
σ0.072-0.044=0.028
min1871.695-1871.709=-0.014
max1871.864-1871.801=0.063
mean1719.600-1721.400=-1.800
σ203.661-159.500=44.161
min1541.000-1524.000=17.000
max2019.000-1941.000=78.000
mean2.877-2.911=-0.034
σ0.069-0.068=0.001
min2.801-2.831=-0.030
max2.952-2.982=-0.030

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.457-1.699=-0.242
σ0.197-0.178=0.019
min1.253-1.389=-0.136
max1.680-1.846=-0.166

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.797-447.793=0.004
σ581.226-581.214=0.012
min157.183-157.183=-0.001
max1319.637-1319.615=0.022
mean96.250
σ8.500
min92.000
max109.000
mean1509.000-1426.000=83.000
σ0.000
min1509.000-1426.000=83.000
max1509.000-1426.000=83.000
mean0.555-0.534=0.021
σ0.588-0.535=0.053
min0.259-0.260=-0.001
max1.438-1.337=0.100
policies=20
mean1572.120-1572.115=0.005
σ0.337-0.343=-0.006
min1571.913-1571.901=0.012
max1572.624-1572.628=-0.004
mean920.000
σ0.000
min920.000
max920.000
mean1509.000-1426.000=83.000
σ0.000
min1509.000-1426.000=83.000
max1509.000-1426.000=83.000
mean2.629-2.633=-0.003
σ0.014-0.011=0.003
min2.612-2.623=-0.011
max2.642-2.648=-0.006
policies=200
mean15728.945-15728.940=0.005
σ0.066-0.144=-0.077
min15728.859-15728.769=0.090
max15729.010-15729.077=-0.067
mean9200.000
σ0.000
min9200.000
max9200.000
mean1509.000-1426.000=83.000
σ0.000
min1509.000-1426.000=83.000
max1509.000-1426.000=83.000
mean26.677-26.686=-0.009
σ0.196-0.377=-0.181
min26.462-26.394=0.069
max26.871-27.228=-0.357