Compare commits

Home / Compare 02c50a44 .. 4eca3969

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.958-30.959=-0.001
σ0.047-0.051=-0.004
min30.921-30.921=-0.000
max31.086-31.101=-0.015
mean411.000-419.000=-8.000
σ0.000
min411.000-419.000=-8.000
max411.000-419.000=-8.000
mean0.076-0.079=-0.003
σ0.004-0.003=0.001
min0.070-0.076=-0.007
max0.084-0.084=0.000
cache=y
dps=1
iters=10
policies=100
mean21.061-21.061=0.000
σ0.003-0.003=0.000
min21.057-21.057=-0.000
max21.064-21.066=-0.001
mean411.000-419.000=-8.000
σ0.000
min411.000-419.000=-8.000
max411.000-419.000=-8.000
mean0.064-0.061=0.003
σ0.003-0.003=0.000
min0.062-0.058=0.004
max0.071-0.066=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.410=0.002
σ0.360-0.361=-0.000
min1750.843-1750.839=0.004
max1751.981-1751.976=0.005
mean1652.550-1641.350=11.200
σ647.458-617.141=30.317
min648.000-655.000=-7.000
max2848.000-2477.000=371.000
mean2.814-2.839=-0.026
σ0.153-0.124=0.029
min2.270-2.605=-0.336
max3.055-3.216=-0.161

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.047-279.072=-0.025
σ0.002-0.008=-0.006
min279.044-279.062=-0.018
max279.050-279.084=-0.035
mean2848.000-2477.000=371.000
σ0.000
min2848.000-2477.000=371.000
max2848.000-2477.000=371.000
mean0.393-0.390=0.004
σ0.007-0.007=0.000
min0.388-0.382=0.005
max0.404-0.397=0.008
iters=5
new-facts=1
prior-facts=6402
mean1939.512-1939.517=-0.005
σ0.008-0.016=-0.009
min1939.502-1939.503=-0.001
max1939.523-1939.544=-0.021
mean2848.000-2477.000=371.000
σ0.000
min2848.000-2477.000=371.000
max2848.000-2477.000=371.000
mean3.006-2.952=0.054
σ0.181-0.271=-0.090
min2.710-2.506=0.204
max3.191-3.204=-0.013
iters=5
new-facts=6402
prior-facts=1
mean4760.035-4760.073=-0.037
σ0.883-0.794=0.089
min4759.546-4759.663=-0.117
max4761.598-4761.487=0.111
mean2848.000-2477.000=371.000
σ0.000
min2848.000-2477.000=371.000
max2848.000-2477.000=371.000
mean8.359-8.112=0.247
σ0.672-0.284=0.388
min7.705-7.809=-0.104
max9.381-8.576=0.804
iters=5
new-facts=6402
prior-facts=6402
mean4950.323-4950.466=-0.143
σ0.367-0.088=0.278
min4949.683-4950.389=-0.706
max4950.568-4950.570=-0.001
mean3043.200-2943.200=100.000
σ265.819-390.611=-124.792
min2848.000-2477.000=371.000
max3461.000
mean8.398-8.511=-0.113
σ0.072-0.199=-0.127
min8.271-8.396=-0.126
max8.440-8.860=-0.420

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.057-1.812=-0.755
σ0.128-0.143=-0.015
min0.938-1.598=-0.660
max1.255-1.979=-0.724

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.338-463.333=0.005
σ572.195-572.193=0.003
min177.232-177.234=-0.002
max1321.631-1321.622=0.009
mean79.750
σ7.500
min76.000
max91.000
mean2848.000-2477.000=371.000
σ0.000
min2848.000-2477.000=371.000
max2848.000-2477.000=371.000
mean0.442-0.555=-0.113
σ0.301-0.554=-0.253
min0.289-0.273=0.017
max0.893-1.385=-0.492
policies=20
mean1772.631-1772.585=0.045
σ0.329-0.329=0.001
min1772.397-1772.355=0.042
max1773.114-1773.071=0.043
mean760.000
σ0.000
min760.000
max760.000
mean2848.000-2477.000=371.000
σ0.000
min2848.000-2477.000=371.000
max2848.000-2477.000=371.000
mean2.839-2.728=0.111
σ0.007-0.019=-0.011
min2.833-2.709=0.123
max2.849-2.747=0.102
policies=200
mean17732.497-17732.532=-0.035
σ0.333-0.485=-0.152
min17732.245-17732.267=-0.022
max17732.986-17733.259=-0.272
mean7600.000
σ0.000
min7600.000
max7600.000
mean2848.000-2477.000=371.000
σ0.000
min2848.000-2477.000=371.000
max2848.000-2477.000=371.000
mean28.171-27.781=0.389
σ0.605-0.188=0.417
min27.517-27.614=-0.097
max28.833-28.002=0.831