Compare commits

Home / Compare 1ae4efbd .. 4671dcdf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.914=-0.001
σ0.366-0.366=0.000
min53.777-53.786=-0.009
max54.956-54.955=0.001
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.138-0.141=-0.002
σ0.003-0.005=-0.001
min0.135-0.136=-0.002
max0.144-0.149=-0.005
cache=y
dps=1
iters=10
policies=100
mean43.146-43.141=0.005
σ0.010-0.007=0.004
min43.137-43.128=0.009
max43.171-43.153=0.018
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.126-0.118=0.008
σ0.008-0.003=0.005
min0.119-0.114=0.005
max0.140-0.122=0.018

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.808-991.810=-0.003
σ1.270-1.230=0.040
min991.257-991.231=0.026
max997.158-996.979=0.179
mean1064.150-1063.000=1.150
σ322.248-322.455=-0.207
min569.000-566.000=3.000
max1639.000-1636.000=3.000
mean1.542-1.522=0.020
σ0.097-0.082=0.015
min1.451-1.408=0.044
max1.770-1.791=-0.020

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-285.413=-0.001
σ0.007-0.013=-0.006
min285.402-285.392=0.010
max285.421-285.423=-0.003
mean1639.000-1636.000=3.000
σ0.000
min1639.000-1636.000=3.000
max1639.000-1636.000=3.000
mean0.380-0.379=0.001
σ0.008-0.006=0.002
min0.373-0.375=-0.002
max0.389-0.390=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1285.366-1285.376=-0.011
σ0.121-0.141=-0.020
min1285.306-1285.310=-0.003
max1285.581-1285.628=-0.046
mean1639.000-1636.000=3.000
σ0.000
min1639.000-1636.000=3.000
max1639.000-1636.000=3.000
mean1.838-1.939=-0.100
σ0.090-0.164=-0.074
min1.714-1.735=-0.021
max1.927-2.135=-0.208
iters=5
new-facts=6402
prior-facts=1
mean1807.694-1807.747=-0.053
σ7.005-6.999=0.006
min1804.337-1804.392=-0.054
max1820.212-1820.251=-0.039
mean1639.000-1636.000=3.000
σ0.000
min1639.000-1636.000=3.000
max1639.000-1636.000=3.000
mean4.164-4.290=-0.126
σ0.230-0.176=0.055
min3.911-4.096=-0.185
max4.484-4.488=-0.005
iters=5
new-facts=6402
prior-facts=6402
mean2070.200-2070.193=0.007
σ0.009-0.005=0.004
min2070.194-2070.187=0.007
max2070.216-2070.198=0.019
mean1862.800-1849.600=13.200
σ200.379-188.816=11.563
min1639.000-1636.000=3.000
max2093.000-2086.000=7.000
mean4.555-4.516=0.039
σ0.121-0.087=0.034
min4.421-4.435=-0.014
max4.675-4.647=0.028

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.220-1.230=-0.010
σ0.236-0.316=-0.079
min0.909-0.920=-0.011
max1.476-1.747=-0.271

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.788-436.789=-0.002
σ572.360-572.360=-0.000
min150.599-150.598=0.001
max1295.327-1295.329=-0.002
mean90.250
σ8.500
min86.000
max103.000
mean1639.000-1636.000=3.000
σ0.000
min1639.000-1636.000=3.000
max1639.000-1636.000=3.000
mean0.527-0.514=0.012
σ0.554-0.531=0.023
min0.249-0.245=0.003
max1.358-1.310=0.047
policies=20
mean1506.272-1506.276=-0.004
σ0.242-0.249=-0.008
min1506.120-1506.117=0.003
max1506.633-1506.648=-0.016
mean860.000
σ0.000
min860.000
max860.000
mean1639.000-1636.000=3.000
σ0.000
min1639.000-1636.000=3.000
max1639.000-1636.000=3.000
mean2.524-2.531=-0.007
σ0.004-0.018=-0.014
min2.519-2.515=0.005
max2.529-2.548=-0.019
policies=200
mean15070.295-15070.402=-0.107
σ0.096-0.053=0.042
min15070.160-15070.337=-0.178
max15070.386-15070.468=-0.082
mean8600.000
σ0.000
min8600.000
max8600.000
mean1639.000-1636.000=3.000
σ0.000
min1639.000-1636.000=3.000
max1639.000-1636.000=3.000
mean25.492-25.518=-0.026
σ0.171-0.097=0.074
min25.276-25.413=-0.137
max25.665-25.645=0.019