Compare commits

Home / Compare d099336a .. f000cd55

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.914=-0.000
σ0.368-0.366=0.002
min53.787-53.778=0.008
max54.961-54.956=0.004
mean416.600-415.000=1.600
σ0.516-0.000=0.516
min416.000-415.000=1.000
max417.000-415.000=2.000
mean0.138-0.141=-0.003
σ0.003-0.010=-0.006
min0.134-0.131=0.004
max0.143-0.164=-0.021
cache=y
dps=1
iters=10
policies=100
mean43.140-43.140=-0.000
σ0.006-0.006=0.000
min43.131-43.132=-0.002
max43.151-43.149=0.002
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.119-0.119=0.000
σ0.004-0.004=0.000
min0.114-0.113=0.001
max0.126-0.125=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.792-992.083=-0.290
σ1.265-1.233=0.032
min991.248-991.499=-0.251
max997.117-997.260=-0.143
mean1065.150-1065.800=-0.650
σ321.640-322.713=-1.073
min569.000-603.000=-34.000
max1629.000-1639.000=-10.000
mean1.570-1.525=0.044
σ0.146-0.095=0.051
min1.428-1.420=0.008
max1.995-1.796=0.199

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.409-285.589=-0.180
σ0.015-0.006=0.009
min285.383-285.583=-0.200
max285.422-285.597=-0.175
mean1629.000-1639.000=-10.000
σ0.000
min1629.000-1639.000=-10.000
max1629.000-1639.000=-10.000
mean0.380-0.381=-0.001
σ0.009-0.008=0.001
min0.373-0.374=-0.001
max0.393-0.394=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1285.376-1285.570=-0.194
σ0.136-0.135=0.000
min1285.307-1285.504=-0.196
max1285.619-1285.811=-0.193
mean1629.000-1639.000=-10.000
σ0.000
min1629.000-1639.000=-10.000
max1629.000-1639.000=-10.000
mean1.938-1.869=0.069
σ0.119-0.098=0.021
min1.832-1.808=0.023
max2.123-2.041=0.082
iters=5
new-facts=6402
prior-facts=1
mean1807.728-1807.920=-0.192
σ6.961-7.017=-0.056
min1804.381-1804.534=-0.153
max1820.163-1820.456=-0.293
mean1629.000-1639.000=-10.000
σ0.000
min1629.000-1639.000=-10.000
max1629.000-1639.000=-10.000
mean4.198-4.233=-0.034
σ0.156-0.194=-0.038
min4.073-3.981=0.092
max4.466-4.457=0.009
iters=5
new-facts=6402
prior-facts=6402
mean2070.196-2070.388=-0.192
σ0.008-0.012=-0.003
min2070.184-2070.378=-0.194
max2070.205-2070.408=-0.203
mean1835.400-1852.600=-17.200
σ181.182-176.021=5.161
min1629.000-1639.000=-10.000
max2073.000-2097.000=-24.000
mean4.491-4.480=0.012
σ0.025-0.056=-0.031
min4.475-4.429=0.047
max4.536-4.565=-0.029

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.165-1.256=-0.091
σ0.248-0.367=-0.119
min0.902-0.884=0.018
max1.502-1.650=-0.148

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.785-437.386=-0.601
σ572.366-572.365=0.001
min150.596-151.197=-0.601
max1295.333-1295.933=-0.600
mean90.250
σ8.500
min86.000
max103.000
mean1629.000-1639.000=-10.000
σ0.000
min1629.000-1639.000=-10.000
max1629.000-1639.000=-10.000
mean0.519-0.521=-0.002
σ0.537-0.526=0.012
min0.248-0.255=-0.008
max1.325-1.310=0.015
policies=20
mean1506.256-1512.206=-5.950
σ0.221-0.238=-0.017
min1506.109-1512.049=-5.940
max1506.585-1512.561=-5.976
mean860.000
σ0.000
min860.000
max860.000
mean1629.000-1639.000=-10.000
σ0.000
min1629.000-1639.000=-10.000
max1629.000-1639.000=-10.000
mean2.497-2.515=-0.018
σ0.007-0.009=-0.001
min2.489-2.509=-0.020
max2.507-2.528=-0.021
policies=200
mean15070.287-15129.748=-59.461
σ0.082-0.062=0.020
min15070.177-15129.656=-59.479
max15070.364-15129.793=-59.429
mean8600.000
σ0.000
min8600.000
max8600.000
mean1629.000-1639.000=-10.000
σ0.000
min1629.000-1639.000=-10.000
max1629.000-1639.000=-10.000
mean25.383-25.653=-0.270
σ0.066-0.129=-0.063
min25.328-25.475=-0.147
max25.469-25.776=-0.307