Compare commits

Home / Compare f09ec5ba .. 08dc788d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.916=-0.002
σ0.367-0.366=0.001
min53.785-53.791=-0.007
max54.959-54.958=0.001
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.139-0.141=-0.001
σ0.003-0.010=-0.007
min0.136-0.130=0.007
max0.144-0.161=-0.017
cache=y
dps=1
iters=10
policies=100
mean43.142-43.144=-0.002
σ0.006-0.011=-0.006
min43.135-43.131=0.004
max43.151-43.169=-0.018
mean413.000
σ0.000
min413.000
max413.000
mean0.121-0.131=-0.010
σ0.003-0.011=-0.008
min0.118-0.119=-0.000
max0.127-0.147=-0.020

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.075-992.068=0.007
σ1.246-1.215=0.031
min991.504-991.496=0.008
max997.316-997.177=0.139
mean1070.850-1064.700=6.150
σ317.276-319.527=-2.251
min600.000-567.000=33.000
max1631.000-1645.000=-14.000
mean1.527-1.497=0.030
σ0.078-0.064=0.013
min1.399-1.352=0.046
max1.778-1.637=0.141

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.652-285.675=-0.024
σ0.011-0.013=-0.002
min285.634-285.657=-0.023
max285.662-285.691=-0.029
mean1631.000-1645.000=-14.000
σ0.000
min1631.000-1645.000=-14.000
max1631.000-1645.000=-14.000
mean0.375-0.375=0.000
σ0.005-0.002=0.003
min0.371-0.374=-0.002
max0.384-0.379=0.005
iters=5
new-facts=1
prior-facts=6402
mean1285.635-1285.637=-0.002
σ0.123-0.129=-0.006
min1285.576-1285.576=0.001
max1285.855-1285.868=-0.013
mean1631.000-1645.000=-14.000
σ0.000
min1631.000-1645.000=-14.000
max1631.000-1645.000=-14.000
mean2.043-1.874=0.169
σ0.251-0.023=0.228
min1.829-1.847=-0.018
max2.428-1.908=0.520
iters=5
new-facts=6402
prior-facts=1
mean1807.963-1807.974=-0.011
σ7.014-7.012=0.002
min1804.596-1804.615=-0.019
max1820.495-1820.502=-0.007
mean1631.000-1645.000=-14.000
σ0.000
min1631.000-1645.000=-14.000
max1631.000-1645.000=-14.000
mean4.176-4.202=-0.026
σ0.241-0.214=0.027
min3.839-3.981=-0.142
max4.509-4.468=0.041
iters=5
new-facts=6402
prior-facts=6402
mean2070.458-2070.463=-0.005
σ0.014-0.012=0.001
min2070.445-2070.450=-0.006
max2070.479-2070.483=-0.005
mean1831.200-1862.200=-31.000
σ174.649-198.375=-23.726
min1631.000-1645.000=-14.000
max2067.000-2092.000=-25.000
mean4.529-4.524=0.006
σ0.043-0.104=-0.060
min4.485-4.426=0.060
max4.588-4.653=-0.065

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.210-1.218=-0.009
σ0.359-0.368=-0.009
min0.909-0.911=-0.001
max1.821-1.839=-0.017

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.385-437.384=0.001
σ572.358-572.363=-0.004
min151.195-151.194=0.001
max1295.923-1295.928=-0.005
mean90.250
σ8.500
min86.000
max103.000
mean1631.000-1645.000=-14.000
σ0.000
min1631.000-1645.000=-14.000
max1631.000-1645.000=-14.000
mean0.523-0.510=0.013
σ0.534-0.515=0.018
min0.251-0.251=0.000
max1.323-1.283=0.040
policies=20
mean1512.212-1512.212=0.001
σ0.246-0.247=-0.001
min1512.056-1512.052=0.004
max1512.578-1512.580=-0.001
mean860.000
σ0.000
min860.000
max860.000
mean1631.000-1645.000=-14.000
σ0.000
min1631.000-1645.000=-14.000
max1631.000-1645.000=-14.000
mean2.521-2.530=-0.009
σ0.007-0.013=-0.005
min2.513-2.519=-0.006
max2.531-2.545=-0.014
policies=200
mean15129.738-15129.711=0.027
σ0.067-0.071=-0.004
min15129.655-15129.617=0.038
max15129.813-15129.786=0.027
mean8600.000
σ0.000
min8600.000
max8600.000
mean1631.000-1645.000=-14.000
σ0.000
min1631.000-1645.000=-14.000
max1631.000-1645.000=-14.000
mean25.653-25.548=0.105
σ0.107-0.128=-0.020
min25.527-25.416=0.111
max25.743-25.665=0.077