Compare commits

Home / Compare 8d8f4fa5 .. 2a031efd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.799=-0.001
σ0.106-0.107=-0.001
min35.750-35.753=-0.003
max36.098-36.101=-0.003
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.075-0.074=0.001
σ0.005-0.005=-0.000
min0.070-0.069=0.000
max0.083-0.082=0.000
cache=y
dps=1
iters=10
policies=100
mean26.065-26.064=0.001
σ0.003-0.003=-0.000
min26.061-26.058=0.003
max26.071-26.068=0.003
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.061-0.061=-0.000
σ0.003-0.003=-0.001
min0.059-0.059=-0.001
max0.068-0.070=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.923-1755.922=0.002
σ0.367-0.366=0.002
min1755.346-1755.343=0.003
max1756.516-1756.511=0.005
mean1646.600-1668.400=-21.800
σ626.326-629.585=-3.259
min610.000-671.000=-61.000
max2660.000
mean2.888-2.837=0.051
σ0.098-0.117=-0.018
min2.686-2.623=0.063
max3.050-3.086=-0.036

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.194-277.196=-0.001
σ0.005-0.005=-0.000
min277.189-277.189=-0.000
max277.200-277.203=-0.003
mean2660.000
σ0.000
min2660.000
max2660.000
mean0.397-0.398=-0.001
σ0.007-0.008=-0.001
min0.391-0.394=-0.003
max0.407-0.412=-0.005
iters=5
new-facts=1
prior-facts=6402
mean2174.445-2174.438=0.007
σ0.025-0.024=0.001
min2174.416-2174.414=0.003
max2174.476-2174.465=0.011
mean2660.000
σ0.000
min2660.000
max2660.000
mean2.860-2.952=-0.092
σ0.159-0.139=0.020
min2.760-2.774=-0.014
max3.141-3.123=0.017
iters=5
new-facts=6402
prior-facts=1
mean5052.514-5052.625=-0.111
σ1.068-0.976=0.092
min5051.646-5051.998=-0.352
max5054.364-5054.356=0.008
mean2660.000
σ0.000
min2660.000
max2660.000
mean8.755-8.673=0.082
σ0.646-0.599=0.046
min8.154-8.120=0.034
max9.598-9.518=0.080
iters=5
new-facts=6402
prior-facts=6402
mean5188.421-5188.431=-0.010
σ0.085-0.083=0.003
min5188.354-5188.363=-0.009
max5188.517-5188.522=-0.005
mean3214.000-3231.400=-17.400
σ468.632-366.155=102.477
min2660.000-2702.000=-42.000
max3834.000-3688.000=146.000
mean8.755-8.981=-0.226
σ0.161-0.315=-0.154
min8.670-8.707=-0.038
max9.042-9.367=-0.325

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.084-1.115=-0.031
σ0.201-0.180=0.020
min0.933-0.949=-0.016
max1.348-1.346=0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.855-464.862=-0.007
σ572.655-572.658=-0.003
min178.519-178.522=-0.003
max1323.837-1323.848=-0.011
mean79.500
σ7.000
min76.000
max90.000
mean2660.000
σ0.000
min2660.000
max2660.000
mean0.561-0.556=0.005
σ0.558-0.548=0.010
min0.279-0.281=-0.002
max1.398-1.378=0.020
policies=20
mean1785.454-1785.492=-0.039
σ0.354-0.354=0.000
min1785.215-1785.260=-0.045
max1785.979-1786.018=-0.038
mean760.000
σ0.000
min760.000
max760.000
mean2660.000
σ0.000
min2660.000
max2660.000
mean2.790-2.807=-0.017
σ0.010-0.011=-0.000
min2.776-2.797=-0.021
max2.799-2.820=-0.020
policies=200
mean17861.444-17861.537=-0.093
σ0.540-0.466=0.073
min17861.064-17861.295=-0.231
max17862.234-17862.236=-0.002
mean7600.000
σ0.000
min7600.000
max7600.000
mean2660.000
σ0.000
min2660.000
max2660.000
mean28.133-28.318=-0.185
σ0.101-0.178=-0.076
min28.038-28.174=-0.136
max28.223-28.548=-0.325