Compare commits

Home / Compare e20bbbea .. 5e21ed3a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.647-53.647=0.000
σ0.368-0.365=0.002
min53.522-53.515=0.006
max54.694-54.687=0.007
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.138-0.139=-0.001
σ0.004-0.004=0.001
min0.135-0.136=-0.002
max0.146-0.146=0.000
cache=y
dps=1
iters=10
policies=100
mean42.945-42.943=0.002
σ0.013-0.006=0.006
min42.929-42.931=-0.002
max42.976-42.954=0.022
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.120-0.122=-0.001
σ0.009-0.003=0.005
min0.113-0.119=-0.006
max0.143-0.129=0.014

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.793-991.806=-0.012
σ1.253-1.244=0.009
min991.240-991.225=0.014
max997.070-997.038=0.033
mean1069.050-1069.600=-0.550
σ328.393-316.415=11.978
min567.000-615.000=-48.000
max1643.000-1632.000=11.000
mean1.540-1.525=0.015
σ0.102-0.048=0.054
min1.420-1.473=-0.053
max1.805-1.617=0.188

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.393-285.388=0.005
σ0.014-0.009=0.005
min285.372-285.373=-0.001
max285.406-285.395=0.011
mean1643.000-1632.000=11.000
σ0.000
min1643.000-1632.000=11.000
max1643.000-1632.000=11.000
mean0.378-0.378=0.000
σ0.009-0.005=0.003
min0.373-0.373=-0.000
max0.394-0.384=0.009
iters=5
new-facts=1
prior-facts=6402
mean1285.356-1285.342=0.014
σ0.140-0.096=0.044
min1285.288-1285.295=-0.007
max1285.605-1285.513=0.092
mean1643.000-1632.000=11.000
σ0.000
min1643.000-1632.000=11.000
max1643.000-1632.000=11.000
mean1.965-2.054=-0.089
σ0.139-0.279=-0.141
min1.807-1.820=-0.014
max2.089-2.494=-0.405
iters=5
new-facts=6402
prior-facts=1
mean1807.668-1807.732=-0.065
σ6.990-6.938=0.051
min1804.291-1804.408=-0.117
max1820.153-1820.129=0.023
mean1643.000-1632.000=11.000
σ0.000
min1643.000-1632.000=11.000
max1643.000-1632.000=11.000
mean4.064-4.190=-0.125
σ0.235-0.177=0.059
min3.818-4.039=-0.222
max4.384-4.473=-0.090
iters=5
new-facts=6402
prior-facts=6402
mean2070.175-2070.178=-0.003
σ0.012-0.013=-0.002
min2070.163-2070.166=-0.003
max2070.194-2070.200=-0.006
mean1855.600-1836.200=19.400
σ192.449-187.328=5.122
min1643.000-1632.000=11.000
max2077.000-2094.000=-17.000
mean4.523-4.496=0.027
σ0.086-0.061=0.025
min4.454-4.445=0.009
max4.665-4.592=0.074

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.272-1.230=0.042
σ0.352-0.321=0.031
min0.917-0.922=-0.006
max1.827-1.630=0.196

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.773-436.779=-0.006
σ572.358-572.360=-0.002
min150.589-150.594=-0.004
max1295.310-1295.319=-0.008
mean90.250
σ8.500
min86.000
max103.000
mean1643.000-1632.000=11.000
σ0.000
min1643.000-1632.000=11.000
max1643.000-1632.000=11.000
mean0.516-0.504=0.012
σ0.532-0.511=0.021
min0.247-0.248=-0.001
max1.315-1.271=0.043
policies=20
mean1506.172-1506.164=0.008
σ0.247-0.230=0.017
min1506.007-1506.002=0.005
max1506.539-1506.504=0.035
mean860.000
σ0.000
min860.000
max860.000
mean1643.000-1632.000=11.000
σ0.000
min1643.000-1632.000=11.000
max1643.000-1632.000=11.000
mean2.525-2.508=0.017
σ0.018-0.026=-0.008
min2.505-2.484=0.022
max2.549-2.545=0.004
policies=200
mean15069.533-15069.467=0.065
σ0.045-0.162=-0.117
min15069.498-15069.304=0.193
max15069.599-15069.690=-0.092
mean8600.000
σ0.000
min8600.000
max8600.000
mean1643.000-1632.000=11.000
σ0.000
min1643.000-1632.000=11.000
max1643.000-1632.000=11.000
mean25.431-25.465=-0.033
σ0.085-0.133=-0.048
min25.340-25.328=0.013
max25.514-25.579=-0.065