Compare commits

Home / Compare 88e121a1 .. d3bac918

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.781=0.000
σ0.047-0.047=-0.000
min70.753-70.751=0.002
max70.911-70.911=0.000
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.160-0.158=0.001
σ0.003-0.005=-0.002
min0.157-0.150=0.007
max0.165-0.165=0.000
cache=y
dps=1
iters=10
policies=100
mean21.493-21.492=0.000
σ0.003-0.002=0.001
min21.487-21.489=-0.002
max21.496-21.496=0.000
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.065-0.065=-0.000
σ0.003-0.003=-0.001
min0.063-0.063=-0.000
max0.072-0.074=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.896-1754.897=-0.001
σ0.360-0.362=-0.002
min1754.332-1754.333=-0.001
max1755.483-1755.490=-0.007
mean1640.350-1638.750=1.600
σ636.779-629.784=6.995
min661.000-625.000=36.000
max2847.000-2786.000=61.000
mean2.794-2.831=-0.037
σ0.225-0.180=0.045
min2.156-2.318=-0.163
max3.016-3.131=-0.115

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.756-272.759=-0.003
σ0.007-0.004=0.003
min272.744-272.751=-0.007
max272.764-272.763=0.001
mean2847.000-2786.000=61.000
σ0.000
min2847.000-2786.000=61.000
max2847.000-2786.000=61.000
mean0.382-0.387=-0.005
σ0.001-0.005=-0.003
min0.380-0.381=-0.001
max0.384-0.394=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1933.130-1933.132=-0.002
σ0.011-0.012=-0.001
min1933.114-1933.115=-0.001
max1933.140-1933.145=-0.005
mean2847.000-2786.000=61.000
σ0.000
min2847.000-2786.000=61.000
max2847.000-2786.000=61.000
mean3.025-3.085=-0.060
σ0.211-0.285=-0.074
min2.758-2.661=0.097
max3.350-3.439=-0.090
iters=5
new-facts=6402
prior-facts=1
mean4753.876-4753.801=0.075
σ0.911-1.024=-0.113
min4753.388-4752.814=0.574
max4755.501-4755.535=-0.034
mean2847.000-2786.000=61.000
σ0.000
min2847.000-2786.000=61.000
max2847.000-2786.000=61.000
mean8.624-8.326=0.298
σ0.552-0.645=-0.094
min7.796-7.666=0.130
max9.155-9.033=0.122
iters=5
new-facts=6402
prior-facts=6402
mean4944.290-4944.367=-0.077
σ0.172-0.019=0.153
min4943.983-4944.343=-0.360
max4944.390-4944.385=0.005
mean3019.600-3024.400=-4.800
σ237.901-300.725=-62.824
min2847.000-2786.000=61.000
max3396.000-3478.000=-82.000
mean8.438-8.510=-0.072
σ0.119-0.197=-0.078
min8.332-8.345=-0.013
max8.614-8.737=-0.123

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.992-1.012=-0.019
σ0.139-0.146=-0.007
min0.928-0.945=-0.016
max1.241-1.272=-0.031

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.649-468.649=-0.000
σ574.885-574.912=-0.027
min181.199-181.191=0.008
max1330.977-1331.017=-0.040
mean88.250
σ8.500
min84.000
max101.000
mean2847.000-2786.000=61.000
σ0.000
min2847.000-2786.000=61.000
max2847.000-2786.000=61.000
mean0.440-0.487=-0.047
σ0.288-0.401=-0.113
min0.291-0.286=0.004
max0.872-1.088=-0.216
policies=20
mean1812.374-1812.218=0.156
σ0.389-0.387=0.002
min1812.096-1811.951=0.145
max1812.942-1812.789=0.153
mean840.000
σ0.000
min840.000
max840.000
mean2847.000-2786.000=61.000
σ0.000
min2847.000-2786.000=61.000
max2847.000-2786.000=61.000
mean2.919-2.848=0.071
σ0.010-0.027=-0.017
min2.907-2.814=0.093
max2.929-2.878=0.051
policies=200
mean18129.910-18129.228=0.682
σ0.651-0.513=0.139
min18128.988-18128.936=0.052
max18130.398-18129.996=0.402
mean8400.000
σ0.000
min8400.000
max8400.000
mean2847.000-2786.000=61.000
σ0.000
min2847.000-2786.000=61.000
max2847.000-2786.000=61.000
mean29.023-28.550=0.473
σ0.488-0.020=0.468
min28.558-28.522=0.036
max29.447-28.565=0.882