Compare commits

Home / Compare c14a8758 .. 7841c080

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-33.979=19.936
σ0.368-0.049=0.319
min53.788-33.952=19.837
max54.962-34.114=20.848
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.141-0.085=0.056
σ0.005-0.003=0.001
min0.135-0.082=0.053
max0.148-0.091=0.057
cache=y
dps=1
iters=10
policies=100
mean43.140-23.317=19.823
σ0.005-0.002=0.002
min43.131-23.314=19.817
max43.145-23.321=19.824
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.118-0.065=0.053
σ0.004-0.002=0.002
min0.113-0.064=0.050
max0.125-0.071=0.054

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.806-1757.429=-765.623
σ1.264-0.364=0.900
min991.250-1756.855=-765.606
max997.131-1758.016=-760.885
mean1062.350-1655.850=-593.500
σ322.325-642.846=-320.521
min567.000-623.000=-56.000
max1635.000-2737.000=-1102.000
mean1.550-2.374=-0.825
σ0.112-0.085=0.028
min1.371-2.277=-0.906
max1.842-2.567=-0.725

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.411-326.581=-41.170
σ0.010-0.027=-0.017
min285.395-326.535=-41.140
max285.421-326.606=-41.185
mean1635.000-2737.000=-1102.000
σ0.000
min1635.000-2737.000=-1102.000
max1635.000-2737.000=-1102.000
mean0.380-0.421=-0.041
σ0.009-0.001=0.008
min0.373-0.421=-0.048
max0.391-0.423=-0.032
iters=5
new-facts=1
prior-facts=6402
mean1285.370-1988.740=-703.369
σ0.127-0.014=0.113
min1285.309-1988.723=-703.414
max1285.597-1988.754=-703.157
mean1635.000-2737.000=-1102.000
σ0.000
min1635.000-2737.000=-1102.000
max1635.000-2737.000=-1102.000
mean1.992-2.672=-0.681
σ0.214-0.054=0.160
min1.853-2.614=-0.761
max2.367-2.762=-0.395
iters=5
new-facts=6402
prior-facts=1
mean1807.694-4813.457=-3005.763
σ7.013-7.767=-0.754
min1804.333-4809.546=-3005.213
max1820.225-4827.344=-3007.119
mean1635.000-2737.000=-1102.000
σ0.000
min1635.000-2737.000=-1102.000
max1635.000-2737.000=-1102.000
mean4.153-8.787=-4.634
σ0.210-0.293=-0.083
min3.813-8.323=-4.510
max4.392-9.072=-4.680
iters=5
new-facts=6402
prior-facts=6402
mean2070.196-5001.157=-2930.961
σ0.009-0.035=-0.026
min2070.187-5001.113=-2930.926
max2070.210-5001.200=-2930.990
mean1863.400-3014.800=-1151.400
σ197.657-230.554=-32.897
min1635.000-2737.000=-1102.000
max2085.000-3288.000=-1203.000
mean4.486-9.993=-5.507
σ0.080-0.189=-0.109
min4.414-9.674=-5.260
max4.605-10.173=-5.568

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.233-0.964=0.268
σ0.289-0.067=0.223
min0.915-0.905=0.010
max1.654-1.046=0.608

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.788-464.565=-27.777
σ572.359-574.771=-2.412
min150.598-177.173=-26.575
max1295.326-1326.721=-31.395
mean90.250-88.250=2.000
σ8.500
min86.000-84.000=2.000
max103.000-101.000=2.000
mean1635.000-2737.000=-1102.000
σ0.000
min1635.000-2737.000=-1102.000
max1635.000-2737.000=-1102.000
mean0.528-0.551=-0.023
σ0.555-0.556=-0.000
min0.249-0.271=-0.022
max1.361-1.384=-0.023
policies=20
mean1506.249-1772.053=-265.804
σ0.231-0.363=-0.132
min1506.099-1771.821=-265.722
max1506.593-1772.594=-266.001
mean860.000-840.000=20.000
σ0.000
min860.000-840.000=20.000
max860.000-840.000=20.000
mean1635.000-2737.000=-1102.000
σ0.000
min1635.000-2737.000=-1102.000
max1635.000-2737.000=-1102.000
mean2.510-2.750=-0.240
σ0.014-0.043=-0.030
min2.498-2.703=-0.206
max2.529-2.796=-0.267
policies=200
mean15070.343-17727.453=-2657.109
σ0.146-0.610=-0.464
min15070.213-17727.073=-2656.860
max15070.482-17728.363=-2657.881
mean8600.000-8400.000=200.000
σ0.000
min8600.000-8400.000=200.000
max8600.000-8400.000=200.000
mean1635.000-2737.000=-1102.000
σ0.000
min1635.000-2737.000=-1102.000
max1635.000-2737.000=-1102.000
mean25.530-27.494=-1.964
σ0.086-0.125=-0.039
min25.425-27.347=-1.922
max25.612-27.631=-2.019