Compare commits

Home / Compare f41c31da .. 4cf0abfc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.384-35.966=34.418
σ0.047-0.102=-0.055
min70.356-35.922=34.434
max70.517-36.255=34.261
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.159-0.077=0.082
σ0.003-0.004=-0.001
min0.155-0.074=0.081
max0.165-0.084=0.081
cache=y
dps=1
iters=10
policies=100
mean21.142-26.209=-5.067
σ0.002-0.005=-0.002
min21.137-26.202=-5.065
max21.146-26.215=-5.069
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.064-0.060=0.005
σ0.002-0.004=-0.002
min0.063-0.056=0.007
max0.069-0.069=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1756.315=-3.920
σ0.360-0.366=-0.006
min1751.824-1755.741=-3.917
max1752.975-1756.912=-3.937
mean1654.400-1646.250=8.150
σ627.581-634.080=-6.499
min618.000-609.000=9.000
max2769.000-2594.000=175.000
mean2.806-2.432=0.373
σ0.190-0.217=-0.027
min2.322-2.270=0.052
max2.981-3.024=-0.043

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.139-278.844=-8.705
σ0.009-0.008=0.001
min270.131-278.830=-8.699
max270.154-278.849=-8.695
mean2769.000-2594.000=175.000
σ0.000
min2769.000-2594.000=175.000
max2769.000-2594.000=175.000
mean0.377-0.413=-0.036
σ0.004-0.005=-0.001
min0.371-0.407=-0.036
max0.382-0.418=-0.037
iters=5
new-facts=1
prior-facts=6402
mean1930.607-2268.904=-338.297
σ0.007-0.018=-0.011
min1930.596-2268.874=-338.278
max1930.615-2268.917=-338.302
mean2769.000-2594.000=175.000
σ0.000
min2769.000-2594.000=175.000
max2769.000-2594.000=175.000
mean2.512-2.956=-0.444
σ0.085-0.178=-0.094
min2.431-2.835=-0.404
max2.654-3.270=-0.616
iters=5
new-facts=6402
prior-facts=1
mean4751.332-4954.131=-202.798
σ0.888-0.964=-0.076
min4750.819-4953.217=-202.398
max4752.914-4955.765=-202.851
mean2769.000-2594.000=175.000
σ0.000
min2769.000-2594.000=175.000
max2769.000-2594.000=175.000
mean8.413-8.048=0.364
σ0.465-0.292=0.173
min7.741-7.688=0.053
max8.979-8.382=0.597
iters=5
new-facts=6402
prior-facts=6402
mean4941.699-5168.811=-227.112
σ0.144-0.085=0.059
min4941.443-5168.748=-227.304
max4941.790-5168.909=-227.120
mean3044.400-3367.400=-323.000
σ235.302-461.935=-226.634
min2769.000-2764.000=5.000
max3371.000-3983.000=-612.000
mean8.680-9.361=-0.681
σ0.208-0.162=0.046
min8.394-9.130=-0.736
max8.925-9.587=-0.662

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.019-1.321=-0.302
σ0.117-0.449=-0.332
min0.940-0.944=-0.004
max1.209-1.839=-0.630

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.371-460.356=6.015
σ575.930-572.656=3.274
min178.400-174.023=4.377
max1330.266-1319.340=10.926
mean84.250-79.500=4.750
σ8.500-7.000=1.500
min80.000-76.000=4.000
max97.000-90.000=7.000
mean2769.000-2594.000=175.000
σ0.000
min2769.000-2594.000=175.000
max2769.000-2594.000=175.000
mean0.448-0.539=-0.091
σ0.304-0.539=-0.236
min0.293-0.267=0.026
max0.904-1.349=-0.445
policies=20
mean1784.336-1740.501=43.835
σ0.336-0.326=0.010
min1784.101-1740.301=43.800
max1784.823-1740.988=43.835
mean800.000-760.000=40.000
σ0.000
min800.000-760.000=40.000
max800.000-760.000=40.000
mean2769.000-2594.000=175.000
σ0.000
min2769.000-2594.000=175.000
max2769.000-2594.000=175.000
mean2.847-2.691=0.157
σ0.128-0.011=0.117
min2.780-2.677=0.103
max3.040-2.701=0.338
policies=200
mean17849.503-17411.956=437.547
σ0.490-0.512=-0.022
min17849.216-17411.668=437.548
max17850.235-17412.722=437.513
mean8000.000-7600.000=400.000
σ0.000
min8000.000-7600.000=400.000
max8000.000-7600.000=400.000
mean2769.000-2594.000=175.000
σ0.000
min2769.000-2594.000=175.000
max2769.000-2594.000=175.000
mean28.008-27.100=0.908
σ0.113-0.070=0.044
min27.882-27.031=0.852
max28.156-27.195=0.961