Compare commits

Home / Compare 5fa39602 .. 895d2ea9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.915=-0.001
σ0.367-0.368=-0.000
min53.785-53.787=-0.001
max54.959-54.961=-0.002
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.137-0.140=-0.003
σ0.004-0.004=0.000
min0.132-0.136=-0.004
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.142-43.141=0.001
σ0.006-0.006=0.000
min43.130-43.130=0.000
max43.152-43.149=0.004
mean413.000-415.800=-2.800
σ0.000-0.422=-0.422
min413.000-415.000=-2.000
max413.000-416.000=-3.000
mean0.121-0.121=-0.000
σ0.004-0.003=0.001
min0.114-0.119=-0.005
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.811-991.814=-0.003
σ1.272-1.227=0.045
min991.226-991.230=-0.004
max997.168-996.970=0.199
mean1063.950-1075.900=-11.950
σ322.950-319.158=3.792
min566.000-615.000=-49.000
max1636.000-1639.000=-3.000
mean1.542-1.504=0.039
σ0.092-0.050=0.042
min1.417-1.447=-0.030
max1.786-1.632=0.153

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.389-285.411=-0.022
σ0.009-0.013=-0.003
min285.377-285.398=-0.020
max285.400-285.424=-0.024
mean1636.000-1639.000=-3.000
σ0.000
min1636.000-1639.000=-3.000
max1636.000-1639.000=-3.000
mean0.382-0.378=0.004
σ0.012-0.009=0.003
min0.374-0.368=0.006
max0.402-0.388=0.014
iters=5
new-facts=1
prior-facts=6402
mean1285.373-1285.368=0.005
σ0.133-0.129=0.003
min1285.303-1285.305=-0.001
max1285.610-1285.599=0.011
mean1636.000-1639.000=-3.000
σ0.000
min1636.000-1639.000=-3.000
max1636.000-1639.000=-3.000
mean1.858-1.867=-0.009
σ0.023-0.090=-0.066
min1.842-1.804=0.038
max1.899-2.013=-0.114
iters=5
new-facts=6402
prior-facts=1
mean1807.743-1807.718=0.024
σ6.958-6.960=-0.002
min1804.355-1804.353=0.003
max1820.178-1820.152=0.025
mean1636.000-1639.000=-3.000
σ0.000
min1636.000-1639.000=-3.000
max1636.000-1639.000=-3.000
mean4.290-4.197=0.093
σ0.299-0.179=0.119
min4.085-4.027=0.057
max4.766-4.421=0.345
iters=5
new-facts=6402
prior-facts=6402
mean2070.194-2070.197=-0.003
σ0.015-0.009=0.006
min2070.176-2070.189=-0.013
max2070.216-2070.213=0.004
mean1850.600-1878.600=-28.000
σ208.260-227.992=-19.732
min1636.000-1639.000=-3.000
max2088.000-2180.000=-92.000
mean4.560-4.504=0.056
σ0.281-0.084=0.197
min4.408-4.432=-0.025
max5.062-4.642=0.420

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.192-1.152=0.039
σ0.233-0.322=-0.090
min0.908-0.895=0.012
max1.523-1.678=-0.154

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.785-436.785=-0.000
σ572.363-572.365=-0.002
min150.599-150.597=0.002
max1295.329-1295.332=-0.003
mean90.250
σ8.500
min86.000
max103.000
mean1636.000-1639.000=-3.000
σ0.000
min1636.000-1639.000=-3.000
max1636.000-1639.000=-3.000
mean0.521-0.520=0.001
σ0.538-0.539=-0.002
min0.248-0.248=0.000
max1.328-1.329=-0.001
policies=20
mean1506.269-1506.262=0.007
σ0.235-0.240=-0.005
min1506.115-1506.115=0.001
max1506.619-1506.620=-0.002
mean860.000
σ0.000
min860.000
max860.000
mean1636.000-1639.000=-3.000
σ0.000
min1636.000-1639.000=-3.000
max1636.000-1639.000=-3.000
mean2.516-2.514=0.002
σ0.003-0.011=-0.008
min2.513-2.503=0.010
max2.520-2.529=-0.009
policies=200
mean15070.360-15070.414=-0.054
σ0.047-0.044=0.003
min15070.304-15070.368=-0.064
max15070.419-15070.467=-0.049
mean8600.000
σ0.000
min8600.000
max8600.000
mean1636.000-1639.000=-3.000
σ0.000
min1636.000-1639.000=-3.000
max1636.000-1639.000=-3.000
mean25.520-25.514=0.006
σ0.087-0.095=-0.009
min25.449-25.374=0.074
max25.639-25.584=0.055