Compare commits

Home / Compare 66a17a56 .. 75052ac9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.974-35.973=0.001
σ0.106-0.104=0.002
min35.924-35.923=0.001
max36.275-36.269=0.006
mean417.000-414.600=2.400
σ0.000-0.516=-0.516
min417.000-414.000=3.000
max417.000-415.000=2.000
mean0.078-0.075=0.003
σ0.003-0.005=-0.002
min0.075-0.070=0.006
max0.084-0.086=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.208-26.209=-0.001
σ0.003-0.004=-0.002
min26.205-26.203=0.002
max26.213-26.215=-0.002
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.062-0.061=0.000
σ0.003-0.002=0.001
min0.060-0.059=0.001
max0.070-0.068=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.379-1758.377=0.002
σ0.369-0.371=-0.002
min1757.803-1757.802=0.000
max1758.976-1758.965=0.010
mean1661.150-1641.450=19.700
σ623.507-627.591=-4.083
min690.000-642.000=48.000
max2771.000-2836.000=-65.000
mean2.394-2.369=0.025
σ0.105-0.098=0.007
min2.270-2.289=-0.019
max2.599-2.711=-0.112

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.556-279.558=-0.002
σ0.004-0.009=-0.005
min279.550-279.546=0.004
max279.560-279.568=-0.008
mean2771.000-2836.000=-65.000
σ0.000
min2771.000-2836.000=-65.000
max2771.000-2836.000=-65.000
mean0.409-0.410=-0.001
σ0.004-0.006=-0.002
min0.406-0.405=0.001
max0.415-0.419=-0.004
iters=5
new-facts=1
prior-facts=6402
mean2178.494-2178.496=-0.002
σ0.015-0.020=-0.005
min2178.474-2178.468=0.006
max2178.509-2178.517=-0.008
mean2771.000-2836.000=-65.000
σ0.000
min2771.000-2836.000=-65.000
max2771.000-2836.000=-65.000
mean3.249-3.353=-0.104
σ0.282-0.198=0.084
min2.783-3.039=-0.255
max3.525-3.538=-0.013
iters=5
new-facts=6402
prior-facts=1
mean5056.443-5056.426=0.016
σ0.897-0.977=-0.081
min5055.975-5055.808=0.167
max5058.045-5058.162=-0.116
mean2771.000-2836.000=-65.000
σ0.000
min2771.000-2836.000=-65.000
max2771.000-2836.000=-65.000
mean8.938-8.939=-0.001
σ0.459-0.645=-0.186
min8.378-8.192=0.186
max9.490-9.596=-0.106
iters=5
new-facts=6402
prior-facts=6402
mean5193.655-5193.804=-0.149
σ0.284-0.082=0.202
min5193.162-5193.738=-0.575
max5193.898-5193.902=-0.005
mean3273.800-3302.000=-28.200
σ422.829-357.387=65.442
min2771.000-2836.000=-65.000
max3850.000-3650.000=200.000
mean8.823-9.068=-0.245
σ0.274-0.367=-0.093
min8.620-8.781=-0.161
max9.280-9.690=-0.409

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.973-1.099=-0.126
σ0.057-0.195=-0.138
min0.939-0.948=-0.010
max1.074-1.433=-0.358

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.539-465.535=0.004
σ572.657-572.647=0.010
min179.199-179.199=-0.001
max1324.524-1324.506=0.018
mean79.500
σ7.000
min76.000
max90.000
mean2771.000-2836.000=-65.000
σ0.000
min2771.000-2836.000=-65.000
max2771.000-2836.000=-65.000
mean0.484-0.443=0.041
σ0.291-0.303=-0.012
min0.279-0.289=-0.010
max0.899-0.898=0.001
policies=20
mean1792.313-1792.308=0.004
σ0.318-0.357=-0.040
min1792.071-1792.068=0.004
max1792.779-1792.833=-0.054
mean760.000
σ0.000
min760.000
max760.000
mean2771.000-2836.000=-65.000
σ0.000
min2771.000-2836.000=-65.000
max2771.000-2836.000=-65.000
mean2.810-2.889=-0.079
σ0.018-0.006=0.012
min2.787-2.881=-0.094
max2.830-2.893=-0.064
policies=200
mean17929.489-17929.464=0.025
σ0.403-0.427=-0.024
min17929.205-17929.153=0.052
max17930.085-17930.092=-0.007
mean7600.000
σ0.000
min7600.000
max7600.000
mean2771.000-2836.000=-65.000
σ0.000
min2771.000-2836.000=-65.000
max2771.000-2836.000=-65.000
mean28.244-28.583=-0.339
σ0.094-0.430=-0.336
min28.110-28.134=-0.024
max28.324-29.071=-0.746