Compare commits

Home / Compare cf5deb6c .. 99f260e9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.822-53.825=-0.003
σ0.367-0.369=-0.002
min53.679-53.681=-0.002
max54.866-54.874=-0.008
mean417.000-420.000=-3.000
σ0.000
min417.000-420.000=-3.000
max417.000-420.000=-3.000
mean0.136-0.140=-0.005
σ0.003-0.004=-0.002
min0.131-0.136=-0.005
max0.140-0.148=-0.008
cache=y
dps=1
iters=10
policies=100
mean43.209-43.208=0.001
σ0.006-0.006=-0.001
min43.202-43.202=-0.001
max43.218-43.223=-0.005
mean417.000-420.000=-3.000
σ0.000
min417.000-420.000=-3.000
max417.000-420.000=-3.000
mean0.119-0.119=-0.000
σ0.003-0.004=-0.001
min0.114-0.114=0.000
max0.122-0.128=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.175-1016.179=-0.004
σ1.181-1.150=0.030
min1015.629-1015.621=0.008
max1021.117-1020.987=0.129
mean1049.250-1045.750=3.500
σ310.218-311.342=-1.124
min583.000-591.000=-8.000
max1670.000-1638.000=32.000
mean1.592-1.541=0.051
σ0.080-0.106=-0.026
min1.519-1.391=0.128
max1.806-1.822=-0.016

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.462-301.314=0.148
σ0.247-0.244=0.003
min301.242-301.158=0.083
max302.108-301.992=0.116
mean1963.000-2021.000=-58.000
σ0.000
min1963.000-2021.000=-58.000
max1963.000-2021.000=-58.000
mean0.559-0.548=0.012
σ0.039-0.034=0.005
min0.505-0.504=0.001
max0.605-0.589=0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.702-300.686=0.016
σ0.025-0.038=-0.014
min300.669-300.621=0.047
max300.736-300.719=0.016
mean1670.000-1638.000=32.000
σ0.000
min1670.000-1638.000=32.000
max1670.000-1638.000=32.000
mean0.397-0.401=-0.003
σ0.007-0.007=-0.001
min0.389-0.392=-0.003
max0.404-0.408=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1322.873-1322.870=0.003
σ0.100-0.098=0.002
min1322.812-1322.816=-0.004
max1323.049-1323.044=0.005
mean1670.000-1638.000=32.000
σ0.000
min1670.000-1638.000=32.000
max1670.000-1638.000=32.000
mean1.924-1.929=-0.005
σ0.062-0.107=-0.045
min1.848-1.824=0.024
max2.016-2.076=-0.060
iters=5
new-facts=6402
prior-facts=1
mean1561.309-1561.329=-0.021
σ6.885-6.854=0.031
min1557.993-1558.033=-0.040
max1573.619-1573.584=0.034
mean1670.000-1638.000=32.000
σ0.000
min1670.000-1638.000=32.000
max1670.000-1638.000=32.000
mean2.295-2.334=-0.038
σ0.233-0.163=0.070
min2.086-2.095=-0.009
max2.692-2.516=0.177
iters=5
new-facts=6402
prior-facts=6402
mean1890.805-1890.786=0.019
σ0.032-0.014=0.019
min1890.781-1890.777=0.004
max1890.861-1890.810=0.051
mean1800.800-1776.400=24.400
σ110.710-165.425=-54.715
min1670.000-1638.000=32.000
max1963.000-2021.000=-58.000
mean3.003-3.010=-0.007
σ0.223-0.191=0.032
min2.722-2.850=-0.128
max3.321-3.284=0.037

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.213-1.187=0.026
σ0.228-0.293=-0.065
min0.908-0.928=-0.019
max1.463-1.674=-0.210

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.323-443.322=0.001
σ573.971-573.970=0.001
min156.334-156.336=-0.002
max1304.280-1304.277=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1670.000-1638.000=32.000
σ0.000
min1670.000-1638.000=32.000
max1670.000-1638.000=32.000
mean0.520-0.545=-0.025
σ0.510-0.565=-0.055
min0.261-0.260=0.001
max1.285-1.392=-0.108
policies=20
mean1563.620-1563.624=-0.004
σ0.338-0.329=0.010
min1563.417-1563.449=-0.032
max1564.126-1564.117=0.009
mean920.000
σ0.000
min920.000
max920.000
mean1670.000-1638.000=32.000
σ0.000
min1670.000-1638.000=32.000
max1670.000-1638.000=32.000
mean2.627-2.620=0.007
σ0.011-0.010=0.001
min2.618-2.614=0.004
max2.642-2.635=0.007
policies=200
mean15644.150-15644.103=0.047
σ0.109-0.156=-0.047
min15644.004-15643.934=0.070
max15644.252-15644.270=-0.018
mean9200.000
σ0.000
min9200.000
max9200.000
mean1670.000-1638.000=32.000
σ0.000
min1670.000-1638.000=32.000
max1670.000-1638.000=32.000
mean26.698-26.574=0.124
σ0.296-0.164=0.132
min26.436-26.434=0.002
max27.089-26.769=0.320