Compare commits

Home / Compare d955ac53 .. 0be957da

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=10
mean167.225
σ0.079
min167.192
max167.446
mean3761.000
σ0.000
min3761.000
max3761.000
mean0.056
σ0.000
min0.056
max0.057

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.114-1754.114=0.000
σ0.368-0.371=-0.003
min1753.539-1753.542=-0.002
max1754.708-1754.708=-0.000
mean1662.050-1669.000=-6.950
σ627.377-636.223=-8.846
min692.000-684.000=8.000
max2606.000-2623.000=-17.000
mean2.707-2.783=-0.077
σ0.190-0.118=0.071
min2.230-2.535=-0.305
max3.021-2.992=0.029

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean190.718-190.720=-0.002
σ0.006-0.005=0.002
min190.710-190.715=-0.005
max190.727-190.727=0.000
mean2606.000-2623.000=-17.000
σ0.000
min2606.000-2623.000=-17.000
max2606.000-2623.000=-17.000
mean0.281-0.278=0.003
σ0.005-0.000=0.004
min0.277-0.278=-0.000
max0.289-0.279=0.010
iters=5
new-facts=1
prior-facts=6402
mean1989.500-1989.495=0.005
σ0.005-0.013=-0.008
min1989.491-1989.485=0.006
max1989.503-1989.513=-0.010
mean2606.000-2623.000=-17.000
σ0.000
min2606.000-2623.000=-17.000
max2606.000-2623.000=-17.000
mean2.652-2.581=0.071
σ0.093-0.082=0.010
min2.513-2.470=0.043
max2.727-2.674=0.053
iters=5
new-facts=6402
prior-facts=1
mean4880.177-4880.169=0.009
σ0.622-0.626=-0.004
min4879.889-4879.883=0.006
max4881.291-4881.289=0.001
mean2606.000-2623.000=-17.000
σ0.000
min2606.000-2623.000=-17.000
max2606.000-2623.000=-17.000
mean8.202-8.064=0.138
σ0.188-0.241=-0.053
min8.000-7.774=0.226
max8.467-8.428=0.039
iters=5
new-facts=6402
prior-facts=6402
mean4891.792-4891.789=0.003
σ0.009-0.014=-0.005
min4891.777-4891.771=0.005
max4891.798-4891.805=-0.007
mean3276.000-3295.600=-19.600
σ512.562-499.103=13.459
min2606.000-2623.000=-17.000
max3761.000-3757.000=4.000
mean8.067-8.117=-0.049
σ0.121-0.158=-0.037
min7.965-7.992=-0.026
max8.215-8.312=-0.097

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.372-1.291=0.081
σ0.404-0.226=0.178
min0.952-1.070=-0.118
max1.816-1.553=0.263

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean456.477-456.478=-0.001
σ572.534-572.536=-0.001
min170.209-170.210=-0.000
max1315.279-1315.282=-0.003
mean79.500
σ7.000
min76.000
max90.000
mean432.000-433.000=-1.000
σ0.000
min432.000-433.000=-1.000
max432.000-433.000=-1.000
mean0.538-0.532=0.006
σ0.550-0.535=0.016
min0.258-0.262=-0.004
max1.363-1.334=0.029
policies=20
mean1702.609-1702.595=0.013
σ0.327-0.318=0.008
min1702.370-1702.358=0.012
max1703.088-1703.061=0.027
mean760.000
σ0.000
min760.000
max760.000
mean445.500-448.000=-2.500
σ11.561-12.463=-0.902
min433.000-435.000=-2.000
max461.000-465.000=-4.000
mean2.654-2.624=0.030
σ0.030-0.013=0.017
min2.613-2.613=-0.000
max2.682-2.641=0.042
policies=200
mean17035.425-17035.409=0.016
σ0.057-0.088=-0.031
min17035.366-17035.329=0.037
max17035.500-17035.535=-0.035
mean7600.000
σ0.000
min7600.000
max7600.000
mean492.000-494.500=-2.500
σ3.367-2.380=0.986
min488.000-492.000=-4.000
max496.000-497.000=-1.000
mean26.419-26.410=0.009
σ0.078-0.115=-0.038
min26.323-26.262=0.061
max26.495-26.523=-0.028