Compare commits

Home / Compare 626a7971 .. d86aa26f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.109-54.108=0.002
σ0.363-0.365=-0.002
min53.971-53.967=0.004
max55.142-55.145=-0.003
mean415.800-415.400=0.400
σ0.422-0.516=-0.095
min415.000
max416.000
mean0.140-0.141=-0.001
σ0.004-0.004=-0.000
min0.135-0.135=-0.000
max0.146-0.149=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.378-43.379=-0.001
σ0.005-0.005=0.000
min43.369-43.370=-0.002
max43.386-43.386=0.000
mean416.000
σ0.000
min416.000
max416.000
mean0.121-0.123=-0.002
σ0.003-0.006=-0.002
min0.119-0.119=-0.001
max0.127-0.138=-0.011

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean997.444-997.446=-0.002
σ1.196-1.196=-0.000
min996.915-996.914=0.000
max1002.458-1002.465=-0.008
mean1053.050-1051.850=1.200
σ304.512-308.647=-4.135
min607.000-593.000=14.000
max1653.000-1643.000=10.000
mean1.442-1.448=-0.005
σ0.072-0.083=-0.011
min1.375-1.367=0.008
max1.660-1.678=-0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean302.786-302.792=-0.005
σ0.024-0.009=0.015
min302.747-302.785=-0.038
max302.810-302.808=0.002
mean1653.000-1643.000=10.000
σ0.000
min1653.000-1643.000=10.000
max1653.000-1643.000=10.000
mean0.395-0.403=-0.008
σ0.007-0.012=-0.005
min0.391-0.389=0.002
max0.408-0.414=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1304.393-1304.401=-0.008
σ0.081-0.054=0.027
min1304.252-1304.309=-0.058
max1304.440-1304.437=0.003
mean1653.000-1643.000=10.000
σ0.000
min1653.000-1643.000=10.000
max1653.000-1643.000=10.000
mean2.002-2.057=-0.055
σ0.260-0.267=-0.007
min1.838-1.859=-0.021
max2.462-2.506=-0.044
iters=5
new-facts=6402
prior-facts=1
mean1724.653-1724.651=0.002
σ6.899-6.919=-0.021
min1721.439-1721.458=-0.019
max1736.989-1737.025=-0.037
mean1653.000-1643.000=10.000
σ0.000
min1653.000-1643.000=10.000
max1653.000-1643.000=10.000
mean3.039-2.952=0.087
σ0.328-0.378=-0.050
min2.535-2.435=0.100
max3.404-3.501=-0.096
iters=5
new-facts=6402
prior-facts=6402
mean1987.405-1987.394=0.011
σ0.015-0.029=-0.015
min1987.380-1987.359=0.022
max1987.417-1987.419=-0.002
mean1838.600-1836.000=2.600
σ189.347-191.519=-2.172
min1653.000-1643.000=10.000
max2088.000
mean3.132-3.171=-0.038
σ0.106-0.060=0.046
min2.947-3.105=-0.157
max3.213-3.243=-0.030

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.173-1.210=-0.036
σ0.277-0.198=0.078
min0.903-1.005=-0.102
max1.626-1.498=0.128

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.602-442.598=0.004
σ573.041-573.043=-0.002
min156.072-156.067=0.005
max1302.164-1302.163=0.000
mean94.250
σ8.500
min90.000
max107.000
mean1653.000-1643.000=10.000
σ0.000
min1653.000-1643.000=10.000
max1653.000-1643.000=10.000
mean0.541-0.529=0.012
σ0.567-0.545=0.023
min0.255-0.256=-0.001
max1.392-1.346=0.046
policies=20
mean1561.051-1561.039=0.012
σ0.311-0.320=-0.009
min1560.858-1560.842=0.015
max1561.514-1561.515=-0.000
mean900.000
σ0.000
min900.000
max900.000
mean1653.000-1643.000=10.000
σ0.000
min1653.000-1643.000=10.000
max1653.000-1643.000=10.000
mean2.585-2.585=0.001
σ0.028-0.019=0.009
min2.568-2.559=0.009
max2.627-2.604=0.023
policies=200
mean15618.354-15618.268=0.085
σ0.092-0.128=-0.035
min15618.273-15618.080=0.193
max15618.437-15618.355=0.082
mean9000.000
σ0.000
min9000.000
max9000.000
mean1653.000-1643.000=10.000
σ0.000
min1653.000-1643.000=10.000
max1653.000-1643.000=10.000
mean26.026-26.206=-0.181
σ0.154-0.198=-0.044
min25.876-25.926=-0.050
max26.224-26.379=-0.155