Compare commits

Home / Compare c0cc06e7 .. c7affa21

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.381=-0.007
σ0.056-0.059=-0.003
min70.335-70.347=-0.012
max70.531-70.546=-0.015
mean414.000
σ0.000
min414.000
max414.000
mean0.160-0.159=0.001
σ0.003-0.006=-0.002
min0.156-0.145=0.012
max0.167-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.147=-0.003
σ0.002-0.002=0.000
min21.139-21.143=-0.004
max21.146-21.150=-0.004
mean414.000
σ0.000
min414.000
max414.000
mean0.066-0.063=0.003
σ0.002-0.003=-0.001
min0.064-0.059=0.005
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.199-1752.198=0.001
σ0.361-0.362=-0.001
min1751.630-1751.622=0.008
max1752.786-1752.785=0.001
mean1652.600-1643.300=9.300
σ645.336-621.095=24.241
min630.000-646.000=-16.000
max2855.000-2484.000=371.000
mean2.777-2.789=-0.012
σ0.206-0.158=0.049
min2.186-2.278=-0.092
max2.979-3.035=-0.056

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.918-269.927=-0.009
σ0.011-0.009=0.003
min269.903-269.921=-0.018
max269.931-269.941=-0.010
mean2855.000-2484.000=371.000
σ0.000
min2855.000-2484.000=371.000
max2855.000-2484.000=371.000
mean0.374-0.373=0.002
σ0.007-0.007=0.000
min0.370-0.369=0.001
max0.386-0.384=0.002
iters=5
new-facts=1
prior-facts=6402
mean1930.399-1930.383=0.016
σ0.006-0.020=-0.014
min1930.392-1930.360=0.032
max1930.408-1930.399=0.010
mean2855.000-2484.000=371.000
σ0.000
min2855.000-2484.000=371.000
max2855.000-2484.000=371.000
mean2.477-2.556=-0.079
σ0.076-0.159=-0.082
min2.360-2.427=-0.068
max2.546-2.831=-0.285
iters=5
new-facts=6402
prior-facts=1
mean4750.916-4750.860=0.056
σ0.747-0.875=-0.128
min4750.545-4750.435=0.109
max4752.250-4752.424=-0.174
mean2855.000-2484.000=371.000
σ0.000
min2855.000-2484.000=371.000
max2855.000-2484.000=371.000
mean8.218-8.694=-0.476
σ0.325-0.401=-0.076
min7.739-8.275=-0.536
max8.503-9.133=-0.630
iters=5
new-facts=6402
prior-facts=6402
mean4941.263-4941.295=-0.031
σ0.125-0.152=-0.028
min4941.076-4941.065=0.011
max4941.426-4941.435=-0.008
mean3045.800-2997.200=48.600
σ195.782-283.625=-87.843
min2855.000-2606.000=249.000
max3319.000-3330.000=-11.000
mean8.522-8.621=-0.099
σ0.133-0.362=-0.229
min8.377-8.333=0.044
max8.654-9.215=-0.561

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.046-1.661=-0.615
σ0.128-0.181=-0.053
min0.933-1.472=-0.539
max1.247-1.859=-0.612

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.912-465.900=0.012
σ575.756-575.757=-0.001
min178.029-178.020=0.009
max1329.546-1329.535=0.010
mean81.750
σ7.500
min78.000
max93.000
mean2855.000-2484.000=371.000
σ0.000
min2855.000-2484.000=371.000
max2855.000-2484.000=371.000
mean0.444-0.564=-0.120
σ0.308-0.555=-0.247
min0.285-0.280=0.005
max0.906-1.397=-0.490
policies=20
mean1780.460-1780.417=0.043
σ0.335-0.358=-0.023
min1780.241-1780.187=0.053
max1780.956-1780.950=0.006
mean780.000
σ0.000
min780.000
max780.000
mean2855.000-2484.000=371.000
σ0.000
min2855.000-2484.000=371.000
max2855.000-2484.000=371.000
mean2.837-2.771=0.066
σ0.011-0.009=0.002
min2.827-2.761=0.066
max2.851-2.782=0.069
policies=200
mean17811.286-17811.047=0.240
σ0.542-0.564=-0.022
min17810.962-17810.683=0.279
max17812.097-17811.877=0.220
mean7800.000
σ0.000
min7800.000
max7800.000
mean2855.000-2484.000=371.000
σ0.000
min2855.000-2484.000=371.000
max2855.000-2484.000=371.000
mean28.357-28.001=0.356
σ0.441-0.063=0.378
min27.913-27.915=-0.001
max28.815-28.066=0.749