Compare commits

Home / Compare a962b003 .. 11ec3819

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.393=-0.003
σ0.045-0.046=-0.000
min70.365-70.361=0.003
max70.516-70.519=-0.003
mean413.600-415.000=-1.400
σ0.516-0.000=0.516
min413.000-415.000=-2.000
max414.000-415.000=-1.000
mean0.162-0.169=-0.006
σ0.003-0.011=-0.008
min0.160-0.158=0.001
max0.168-0.187=-0.019
cache=y
dps=1
iters=10
policies=100
mean21.145-21.144=0.000
σ0.002-0.003=-0.000
min21.141-21.141=-0.000
max21.147-21.149=-0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.065-0.065=0.000
σ0.002-0.002=-0.000
min0.063-0.063=-0.001
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.696-1752.699=-0.003
σ0.361-0.362=-0.000
min1752.129-1752.129=0.000
max1753.281-1753.282=-0.001
mean1646.900-1661.300=-14.400
σ635.954-635.753=0.201
min632.000-620.000=12.000
max2839.000-2796.000=43.000
mean2.786-2.833=-0.046
σ0.211-0.153=0.058
min2.263-2.282=-0.019
max3.036-3.053=-0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.517-270.512=0.005
σ0.007-0.007=0.000
min270.505-270.504=0.002
max270.523-270.522=0.001
mean2839.000-2796.000=43.000
σ0.000
min2839.000-2796.000=43.000
max2839.000-2796.000=43.000
mean0.382-0.382=0.001
σ0.009-0.004=0.005
min0.378-0.378=-0.001
max0.398-0.389=0.009
iters=5
new-facts=1
prior-facts=6402
mean1930.943-1930.953=-0.010
σ0.008-0.007=0.001
min1930.933-1930.945=-0.012
max1930.954-1930.961=-0.007
mean2839.000-2796.000=43.000
σ0.000
min2839.000-2796.000=43.000
max2839.000-2796.000=43.000
mean2.947-3.030=-0.083
σ0.135-0.163=-0.029
min2.760-2.800=-0.040
max3.120-3.203=-0.084
iters=5
new-facts=6402
prior-facts=1
mean4751.683-4751.681=0.001
σ0.841-0.834=0.007
min4751.234-4751.174=0.060
max4753.184-4753.161=0.023
mean2839.000-2796.000=43.000
σ0.000
min2839.000-2796.000=43.000
max2839.000-2796.000=43.000
mean8.375-8.383=-0.007
σ0.372-0.489=-0.117
min7.822-7.733=0.089
max8.795-8.971=-0.176
iters=5
new-facts=6402
prior-facts=6402
mean4942.140-4942.000=0.140
σ0.022-0.204=-0.183
min4942.113-4941.767=0.346
max4942.161-4942.162=-0.001
mean3025.000-3039.200=-14.200
σ199.167-232.394=-33.227
min2839.000-2796.000=43.000
max3319.000-3338.000=-19.000
mean8.565-8.631=-0.065
σ0.155-0.330=-0.175
min8.416-8.315=0.101
max8.822-9.126=-0.303

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.997-1.097=-0.100
σ0.141-0.178=-0.037
min0.925-0.929=-0.003
max1.249-1.316=-0.067

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.823-466.829=-0.006
σ575.930-575.934=-0.005
min178.852-178.853=-0.000
max1330.717-1330.730=-0.013
mean84.000
σ8.000
min80.000
max96.000
mean2839.000-2796.000=43.000
σ0.000
min2839.000-2796.000=43.000
max2839.000-2796.000=43.000
mean0.443-0.440=0.003
σ0.303-0.299=0.004
min0.290-0.289=0.001
max0.898-0.889=0.009
policies=20
mean1788.862-1788.821=0.041
σ0.373-0.344=0.030
min1788.613-1788.573=0.041
max1789.414-1789.319=0.095
mean800.000
σ0.000
min800.000
max800.000
mean2839.000-2796.000=43.000
σ0.000
min2839.000-2796.000=43.000
max2839.000-2796.000=43.000
mean2.898-2.847=0.051
σ0.056-0.110=-0.054
min2.842-2.780=0.062
max2.959-3.011=-0.052
policies=200
mean17894.762-17894.714=0.048
σ0.460-0.554=-0.094
min17894.482-17894.286=0.195
max17895.449-17895.523=-0.073
mean8000.000
σ0.000
min8000.000
max8000.000
mean2839.000-2796.000=43.000
σ0.000
min2839.000-2796.000=43.000
max2839.000-2796.000=43.000
mean28.370-28.096=0.274
σ0.348-0.132=0.216
min28.021-27.979=0.042
max28.726-28.257=0.469