Compare commits

Home / Compare 3b654f40 .. 04cb104c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.007-54.005=0.002
σ0.367-0.366=0.001
min53.878-53.870=0.008
max55.052-55.047=0.004
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.139-0.140=-0.001
σ0.005-0.004=0.001
min0.131-0.136=-0.005
max0.147-0.147=0.001
cache=y
dps=1
iters=10
policies=100
mean43.212-43.215=-0.003
σ0.005-0.013=-0.008
min43.207-43.200=0.006
max43.220-43.246=-0.026
mean419.100-416.000=3.100
σ0.316-0.000=0.316
min419.000-416.000=3.000
max420.000-416.000=4.000
mean0.121-0.120=0.001
σ0.004-0.004=-0.001
min0.119-0.114=0.005
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.349-992.353=-0.004
σ1.260-1.282=-0.022
min991.797-991.796=0.001
max997.654-997.754=-0.100
mean1066.300-1073.850=-7.550
σ295.687-321.654=-25.967
min669.000-565.000=104.000
max1600.000-1632.000=-32.000
mean1.553-1.545=0.008
σ0.110-0.085=0.025
min1.456-1.449=0.007
max1.820-1.765=0.055

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean287.359-287.360=-0.001
σ0.014-0.015=-0.001
min287.339-287.335=0.003
max287.373-287.373=-0.000
mean1600.000-1632.000=-32.000
σ0.000
min1600.000-1632.000=-32.000
max1600.000-1632.000=-32.000
mean0.373-0.378=-0.005
σ0.004-0.006=-0.002
min0.370-0.372=-0.002
max0.379-0.386=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1287.321-1287.323=-0.001
σ0.136-0.132=0.004
min1287.256-1287.260=-0.005
max1287.564-1287.559=0.005
mean1600.000-1632.000=-32.000
σ0.000
min1600.000-1632.000=-32.000
max1600.000-1632.000=-32.000
mean1.854-1.936=-0.081
σ0.035-0.123=-0.089
min1.808-1.812=-0.004
max1.886-2.140=-0.254
iters=5
new-facts=6402
prior-facts=1
mean1809.698-1809.670=0.027
σ6.988-7.002=-0.014
min1806.327-1806.294=0.033
max1822.180-1822.178=0.002
mean1600.000-1632.000=-32.000
σ0.000
min1600.000-1632.000=-32.000
max1600.000-1632.000=-32.000
mean4.293-4.221=0.073
σ0.203-0.193=0.010
min4.102-3.974=0.127
max4.582-4.443=0.140
iters=5
new-facts=6402
prior-facts=6402
mean2072.161-2072.165=-0.004
σ0.008-0.021=-0.014
min2072.154-2072.153=0.002
max2072.174-2072.203=-0.029
mean1863.800-1837.000=26.800
σ212.296-171.971=40.325
min1600.000-1632.000=-32.000
max2097.000-2074.000=23.000
mean4.894-4.917=-0.023
σ0.172-0.052=0.120
min4.644-4.837=-0.193
max5.120-4.978=0.142

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.233-1.277=-0.044
σ0.376-0.357=0.019
min0.903-0.914=-0.011
max1.823-1.841=-0.017

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.414-437.405=0.009
σ572.402-572.403=-0.001
min151.205-151.200=0.005
max1296.017-1296.010=0.007
mean90.250
σ8.500
min86.000
max103.000
mean1600.000-1632.000=-32.000
σ0.000
min1600.000-1632.000=-32.000
max1600.000-1632.000=-32.000
mean0.547-0.515=0.032
σ0.585-0.525=0.060
min0.254-0.250=0.004
max1.424-1.302=0.122
policies=20
mean1512.315-1512.322=-0.007
σ0.230-0.251=-0.021
min1512.169-1512.157=0.012
max1512.659-1512.696=-0.037
mean860.000
σ0.000
min860.000
max860.000
mean1600.000-1632.000=-32.000
σ0.000
min1600.000-1632.000=-32.000
max1600.000-1632.000=-32.000
mean2.511-2.526=-0.015
σ0.020-0.015=0.005
min2.488-2.506=-0.018
max2.537-2.538=-0.001
policies=200
mean15130.779-15130.772=0.006
σ0.126-0.043=0.084
min15130.656-15130.727=-0.071
max15130.915-15130.822=0.094
mean8600.000
σ0.000
min8600.000
max8600.000
mean1600.000-1632.000=-32.000
σ0.000
min1600.000-1632.000=-32.000
max1600.000-1632.000=-32.000
mean25.689-25.477=0.212
σ0.284-0.189=0.094
min25.435-25.321=0.114
max26.076-25.751=0.325