Compare commits

Home / Compare 9ceef037 .. 7d114c1b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.647-53.646=0.000
σ0.366-0.365=0.001
min53.514-53.512=0.002
max54.687-54.684=0.003
mean412.800-413.600=-0.800
σ0.422-0.516=-0.095
min412.000-413.000=-1.000
max413.000-414.000=-1.000
mean0.137-0.138=-0.001
σ0.004-0.003=0.001
min0.130-0.134=-0.004
max0.144-0.143=0.000
cache=y
dps=1
iters=10
policies=100
mean42.944-42.942=0.002
σ0.013-0.006=0.008
min42.933-42.932=0.001
max42.979-42.950=0.028
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.120-0.121=-0.001
σ0.004-0.002=0.001
min0.114-0.118=-0.003
max0.125-0.125=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.862-991.863=-0.001
σ1.221-1.215=0.006
min991.329-991.329=-0.001
max996.984-996.947=0.037
mean1051.450-1043.450=8.000
σ311.072-301.273=9.798
min586.000-581.000=5.000
max1520.000-1447.000=73.000
mean1.508-1.557=-0.048
σ0.064-0.130=-0.066
min1.366-1.375=-0.009
max1.638-1.876=-0.237

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.437-285.441=-0.004
σ0.013-0.007=0.005
min285.417-285.429=-0.011
max285.453-285.448=0.005
mean1520.000-1447.000=73.000
σ0.000
min1520.000-1447.000=73.000
max1520.000-1447.000=73.000
mean0.377-0.379=-0.002
σ0.006-0.007=-0.001
min0.373-0.374=-0.001
max0.388-0.391=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1285.509-1285.502=0.007
σ0.087-0.087=0.000
min1285.355-1285.354=0.001
max1285.562-1285.569=-0.006
mean1520.000-1447.000=73.000
σ0.000
min1520.000-1447.000=73.000
max1520.000-1447.000=73.000
mean1.908-1.902=0.007
σ0.087-0.059=0.028
min1.810-1.826=-0.017
max2.027-1.981=0.046
iters=5
new-facts=6402
prior-facts=1
mean1705.826-1705.829=-0.003
σ6.852-6.867=-0.015
min1702.644-1702.643=0.001
max1718.080-1718.108=-0.028
mean1520.000-1447.000=73.000
σ0.000
min1520.000-1447.000=73.000
max1520.000-1447.000=73.000
mean2.994-3.043=-0.049
σ0.204-0.210=-0.005
min2.814-2.836=-0.022
max3.284-3.298=-0.014
iters=5
new-facts=6402
prior-facts=6402
mean1968.397-1968.394=0.003
σ0.039-0.057=-0.018
min1968.355-1968.319=0.035
max1968.447-1968.444=0.003
mean1784.400-1788.600=-4.200
σ188.248-194.418=-6.170
min1535.000-1533.000=2.000
max2014.000-2027.000=-13.000
mean3.223-3.344=-0.121
σ0.362-0.475=-0.113
min3.043-2.871=0.171
max3.871-3.962=-0.091

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.585-1.702=-0.117
σ0.209-0.054=0.154
min1.328-1.607=-0.279
max1.765-1.746=0.018

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.767-436.762=0.005
σ572.352-572.342=0.010
min150.585-150.588=-0.002
max1295.295-1295.275=0.020
mean90.250
σ8.500
min86.000
max103.000
mean1520.000-1447.000=73.000
σ0.000
min1520.000-1447.000=73.000
max1520.000-1447.000=73.000
mean0.515-0.528=-0.013
σ0.524-0.554=-0.030
min0.250-0.248=0.002
max1.301-1.359=-0.058
policies=20
mean1506.162-1506.166=-0.004
σ0.242-0.236=0.006
min1505.997-1506.001=-0.004
max1506.520-1506.515=0.005
mean860.000
σ0.000
min860.000
max860.000
mean1520.000-1447.000=73.000
σ0.000
min1520.000-1447.000=73.000
max1520.000-1447.000=73.000
mean2.516-2.511=0.005
σ0.022-0.011=0.012
min2.496-2.503=-0.007
max2.546-2.526=0.020
policies=200
mean15069.465-15069.553=-0.088
σ0.023-0.054=-0.031
min15069.439-15069.478=-0.039
max15069.489-15069.602=-0.113
mean8600.000
σ0.000
min8600.000
max8600.000
mean1520.000-1447.000=73.000
σ0.000
min1520.000-1447.000=73.000
max1520.000-1447.000=73.000
mean25.408-25.434=-0.027
σ0.084-0.173=-0.090
min25.285-25.225=0.060
max25.473-25.589=-0.116