Compare commits

Home / Compare 33a4a050 .. 79ed00a2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.783-70.783=-0.000
σ0.047-0.047=-0.000
min70.751-70.752=-0.001
max70.914-70.913=0.001
mean415.000-412.900=2.100
σ0.000-0.316=-0.316
min415.000-412.000=3.000
max415.000-413.000=2.000
mean0.160-0.163=-0.003
σ0.003-0.004=-0.002
min0.158-0.159=-0.001
max0.164-0.171=-0.006
cache=y
dps=1
iters=10
policies=100
mean21.493-21.492=0.001
σ0.003-0.002=0.000
min21.490-21.488=0.002
max21.498-21.495=0.003
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.063-0.063=-0.001
σ0.004-0.003=0.001
min0.059-0.060=-0.001
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.092-1754.095=-0.002
σ0.361-0.360=0.001
min1753.529-1753.520=0.008
max1754.679-1754.671=0.008
mean1667.750-1645.850=21.900
σ630.113-632.743=-2.630
min669.000-627.000=42.000
max2621.000-2769.000=-148.000
mean2.756-2.810=-0.054
σ0.217-0.202=0.015
min2.254-2.206=0.048
max3.017-3.209=-0.192

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.955-271.952=0.003
σ0.006-0.004=0.003
min271.948-271.947=0.001
max271.961-271.956=0.005
mean2621.000-2769.000=-148.000
σ0.000
min2621.000-2769.000=-148.000
max2621.000-2769.000=-148.000
mean0.383-0.381=0.002
σ0.005-0.001=0.004
min0.380-0.380=0.000
max0.392-0.382=0.010
iters=5
new-facts=1
prior-facts=6402
mean1932.333-1932.329=0.004
σ0.007-0.009=-0.003
min1932.327-1932.320=0.007
max1932.344-1932.344=-0.000
mean2621.000-2769.000=-148.000
σ0.000
min2621.000-2769.000=-148.000
max2621.000-2769.000=-148.000
mean2.926-3.009=-0.084
σ0.255-0.073=0.182
min2.599-2.918=-0.320
max3.238-3.093=0.144
iters=5
new-facts=6402
prior-facts=1
mean4753.046-4752.861=0.185
σ0.919-1.032=-0.113
min4752.589-4752.095=0.495
max4754.688-4754.616=0.072
mean2621.000-2769.000=-148.000
σ0.000
min2621.000-2769.000=-148.000
max2621.000-2769.000=-148.000
mean8.645-8.392=0.253
σ0.483-0.527=-0.043
min7.797-7.791=0.006
max8.963-9.014=-0.051
iters=5
new-facts=6402
prior-facts=6402
mean4943.551-4943.556=-0.005
σ0.017-0.016=0.001
min4943.533-4943.536=-0.003
max4943.574-4943.581=-0.007
mean2970.400-3050.200=-79.800
σ264.146-326.338=-62.192
min2621.000-2769.000=-148.000
max3324.000-3496.000=-172.000
mean8.503-8.665=-0.163
σ0.092-0.221=-0.129
min8.431-8.412=0.019
max8.641-8.901=-0.260

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.174-1.039=0.135
σ0.255-0.182=0.073
min0.926-0.929=-0.003
max1.536-1.351=0.185

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.639-468.655=-0.017
σ574.891-574.893=-0.002
min181.189-181.204=-0.016
max1330.976-1330.995=-0.019
mean88.250
σ8.500
min84.000
max101.000
mean2621.000-2769.000=-148.000
σ0.000
min2621.000-2769.000=-148.000
max2621.000-2769.000=-148.000
mean0.571-0.490=0.081
σ0.557-0.384=0.173
min0.286-0.296=-0.010
max1.407-1.067=0.340
policies=20
mean1812.203-1812.299=-0.095
σ0.382-0.354=0.028
min1811.950-1812.090=-0.141
max1812.768-1812.828=-0.060
mean840.000
σ0.000
min840.000
max840.000
mean2621.000-2769.000=-148.000
σ0.000
min2621.000-2769.000=-148.000
max2621.000-2769.000=-148.000
mean2.868-2.911=-0.043
σ0.050-0.078=-0.028
min2.837-2.838=-0.001
max2.942-3.012=-0.070
policies=200
mean18129.220-18129.212=0.008
σ0.509-0.452=0.057
min18128.954-18128.888=0.066
max18129.983-18129.879=0.104
mean8400.000
σ0.000
min8400.000
max8400.000
mean2621.000-2769.000=-148.000
σ0.000
min2621.000-2769.000=-148.000
max2621.000-2769.000=-148.000
mean28.635-28.661=-0.025
σ0.125-0.046=0.079
min28.535-28.627=-0.092
max28.806-28.729=0.077