Compare commits

Home / Compare a9244635 .. 8d9ebfa3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.916-53.913=0.003
σ0.367-0.367=0.001
min53.787-53.778=0.009
max54.961-54.956=0.004
mean413.300-415.100=-1.800
σ0.483-0.316=0.167
min413.000-415.000=-2.000
max414.000-416.000=-2.000
mean0.141-0.138=0.003
σ0.008-0.006=0.003
min0.134-0.130=0.004
max0.161-0.147=0.014
cache=y
dps=1
iters=10
policies=100
mean43.141-43.140=0.001
σ0.004-0.007=-0.003
min43.134-43.132=0.003
max43.146-43.152=-0.006
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.120-0.119=0.001
σ0.004-0.004=0.000
min0.112-0.113=-0.001
max0.127-0.126=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.813-991.811=0.002
σ1.260-1.221=0.039
min991.253-991.230=0.023
max997.115-996.938=0.176
mean1063.400-1068.150=-4.750
σ322.733-320.870=1.863
min565.000-576.000=-11.000
max1636.000-1643.000=-7.000
mean1.565-1.515=0.049
σ0.115-0.046=0.070
min1.475-1.459=0.016
max1.898-1.612=0.286

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-285.409=0.002
σ0.013-0.010=0.003
min285.391-285.396=-0.005
max285.426-285.420=0.006
mean1636.000-1643.000=-7.000
σ0.000
min1636.000-1643.000=-7.000
max1636.000-1643.000=-7.000
mean0.376-0.380=-0.004
σ0.006-0.008=-0.003
min0.371-0.371=-0.000
max0.385-0.389=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1285.375-1285.366=0.008
σ0.135-0.121=0.015
min1285.307-1285.310=-0.003
max1285.617-1285.583=0.034
mean1636.000-1643.000=-7.000
σ0.000
min1636.000-1643.000=-7.000
max1636.000-1643.000=-7.000
mean1.878-1.976=-0.098
σ0.068-0.120=-0.052
min1.804-1.830=-0.026
max1.974-2.140=-0.166
iters=5
new-facts=6402
prior-facts=1
mean1807.691-1807.741=-0.050
σ7.002-6.999=0.003
min1804.330-1804.380=-0.050
max1820.201-1820.244=-0.043
mean1636.000-1643.000=-7.000
σ0.000
min1636.000-1643.000=-7.000
max1636.000-1643.000=-7.000
mean4.137-4.266=-0.129
σ0.221-0.181=0.040
min3.940-4.082=-0.142
max4.403-4.489=-0.087
iters=5
new-facts=6402
prior-facts=6402
mean2070.195-2070.201=-0.006
σ0.010-0.009=0.001
min2070.188-2070.195=-0.007
max2070.211-2070.216=-0.005
mean1850.600-1864.200=-13.600
σ204.106-198.291=5.815
min1636.000-1643.000=-7.000
max2073.000-2091.000=-18.000
mean4.600-4.501=0.099
σ0.223-0.061=0.162
min4.421-4.435=-0.014
max4.929-4.586=0.343

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.204-1.242=-0.039
σ0.262-0.348=-0.086
min0.917-0.928=-0.011
max1.610-1.826=-0.215

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.787-436.786=0.001
σ572.360-572.360=0.000
min150.597-150.595=0.001
max1295.328-1295.326=0.002
mean90.250
σ8.500
min86.000
max103.000
mean1636.000-1643.000=-7.000
σ0.000
min1636.000-1643.000=-7.000
max1636.000-1643.000=-7.000
mean0.522-0.523=-0.001
σ0.542-0.544=-0.002
min0.250-0.248=0.001
max1.335-1.339=-0.003
policies=20
mean1506.256-1506.249=0.008
σ0.240-0.249=-0.009
min1506.104-1506.086=0.019
max1506.615-1506.619=-0.005
mean860.000
σ0.000
min860.000
max860.000
mean1636.000-1643.000=-7.000
σ0.000
min1636.000-1643.000=-7.000
max1636.000-1643.000=-7.000
mean2.523-2.520=0.003
σ0.003-0.008=-0.005
min2.519-2.509=0.010
max2.526-2.526=0.000
policies=200
mean15070.376-15070.327=0.049
σ0.045-0.125=-0.080
min15070.339-15070.177=0.161
max15070.435-15070.446=-0.011
mean8600.000
σ0.000
min8600.000
max8600.000
mean1636.000-1643.000=-7.000
σ0.000
min1636.000-1643.000=-7.000
max1636.000-1643.000=-7.000
mean25.458-25.548=-0.090
σ0.150-0.155=-0.005
min25.279-25.336=-0.057
max25.607-25.704=-0.097