Compare commits

Home / Compare a569748d .. 169cd317

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.799=-0.001
σ0.108-0.107=0.000
min35.751-35.751=-0.000
max36.104-36.104=-0.000
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.076-0.075=0.001
σ0.003-0.004=-0.001
min0.074-0.070=0.004
max0.084-0.082=0.002
cache=y
dps=1
iters=10
policies=100
mean26.065-26.065=0.000
σ0.004-0.004=0.001
min26.058-26.060=-0.002
max26.072-26.071=0.001
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.060-0.061=-0.001
σ0.003-0.002=0.001
min0.057-0.060=-0.002
max0.068-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.924-1755.924=-0.001
σ0.367-0.365=0.002
min1755.354-1755.351=0.004
max1756.514-1756.513=0.002
mean1658.400-1666.300=-7.900
σ637.852-629.443=8.409
min620.000-671.000=-51.000
max2699.000-2663.000=36.000
mean2.772-2.797=-0.025
σ0.202-0.159=0.043
min2.297-2.320=-0.023
max3.077-2.977=0.100

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.198-277.196=0.002
σ0.008-0.006=0.002
min277.188-277.190=-0.002
max277.208-277.205=0.003
mean2699.000-2663.000=36.000
σ0.000
min2699.000-2663.000=36.000
max2699.000-2663.000=36.000
mean0.407-0.407=-0.001
σ0.008-0.008=0.001
min0.399-0.399=-0.000
max0.419-0.416=0.003
iters=5
new-facts=1
prior-facts=6402
mean2174.432-2174.427=0.005
σ0.011-0.017=-0.006
min2174.421-2174.410=0.011
max2174.448-2174.451=-0.003
mean2699.000-2663.000=36.000
σ0.000
min2699.000-2663.000=36.000
max2699.000-2663.000=36.000
mean2.987-3.126=-0.139
σ0.138-0.214=-0.076
min2.771-2.836=-0.065
max3.096-3.433=-0.337
iters=5
new-facts=6402
prior-facts=1
mean5052.644-5052.602=0.042
σ0.995-0.941=0.054
min5051.999-5051.991=0.009
max5054.404-5054.268=0.136
mean2699.000-2663.000=36.000
σ0.000
min2699.000-2663.000=36.000
max2699.000-2663.000=36.000
mean8.682-8.833=-0.151
σ0.730-0.591=0.139
min8.083-8.172=-0.089
max9.807-9.372=0.435
iters=5
new-facts=6402
prior-facts=6402
mean5188.424-5188.413=0.011
σ0.089-0.073=0.016
min5188.350-5188.359=-0.008
max5188.521-5188.526=-0.004
mean3283.000-3282.600=0.400
σ426.320-423.635=2.685
min2699.000-2684.000=15.000
max3680.000-3672.000=8.000
mean9.025-8.978=0.047
σ0.321-0.317=0.004
min8.826-8.700=0.126
max9.582-9.493=0.089

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.092-1.189=-0.097
σ0.137-0.272=-0.135
min0.958-0.947=0.011
max1.260-1.501=-0.241

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.859-464.863=-0.004
σ572.656-572.671=-0.014
min178.526-178.524=0.002
max1323.843-1323.869=-0.026
mean79.500
σ7.000
min76.000
max90.000
mean2699.000-2663.000=36.000
σ0.000
min2699.000-2663.000=36.000
max2699.000-2663.000=36.000
mean0.567-0.552=0.015
σ0.570-0.528=0.041
min0.276-0.282=-0.006
max1.421-1.344=0.077
policies=20
mean1785.487-1785.485=0.001
σ0.352-0.348=0.004
min1785.250-1785.262=-0.012
max1786.010-1786.003=0.007
mean760.000
σ0.000
min760.000
max760.000
mean2699.000-2663.000=36.000
σ0.000
min2699.000-2663.000=36.000
max2699.000-2663.000=36.000
mean2.787-2.780=0.007
σ0.013-0.011=0.002
min2.769-2.766=0.002
max2.798-2.793=0.005
policies=200
mean17861.517-17861.522=-0.005
σ0.510-0.393=0.116
min17861.236-17861.314=-0.078
max17862.281-17862.112=0.169
mean7600.000
σ0.000
min7600.000
max7600.000
mean2699.000-2663.000=36.000
σ0.000
min2699.000-2663.000=36.000
max2699.000-2663.000=36.000
mean28.178-28.109=0.069
σ0.143-0.386=-0.243
min28.037-27.592=0.446
max28.311-28.478=-0.167