Compare commits

Home / Compare 12fc4b14 .. 62bf16c7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-35.956=34.418
σ0.058-0.102=-0.044
min70.336-35.905=34.431
max70.535-36.245=34.291
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.160-0.076=0.084
σ0.003-0.004=-0.000
min0.156-0.074=0.082
max0.165-0.083=0.081
cache=y
dps=1
iters=10
policies=100
mean21.143-26.203=-5.060
σ0.002-0.005=-0.002
min21.137-26.193=-5.056
max21.146-26.208=-5.063
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.062-0.061=0.001
σ0.003-0.003=0.001
min0.058-0.059=-0.001
max0.067-0.068=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.198-1756.305=-4.107
σ0.362-0.368=-0.006
min1751.633-1755.729=-4.096
max1752.787-1756.897=-4.110
mean1676.950-1655.050=21.900
σ626.465-630.068=-3.603
min669.000-619.000=50.000
max2622.000-2674.000=-52.000
mean2.790-2.370=0.419
σ0.154-0.079=0.075
min2.269-2.257=0.012
max2.966-2.561=0.405

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.932-278.824=-8.892
σ0.007-0.007=-0.000
min269.925-278.812=-8.887
max269.941-278.831=-8.891
mean2622.000-2674.000=-52.000
σ0.000
min2622.000-2674.000=-52.000
max2622.000-2674.000=-52.000
mean0.373-0.412=-0.039
σ0.005-0.004=0.001
min0.369-0.407=-0.038
max0.382-0.419=-0.038
iters=5
new-facts=1
prior-facts=6402
mean1930.390-2268.887=-338.497
σ0.020-0.007=0.014
min1930.360-2268.878=-338.518
max1930.409-2268.893=-338.484
mean2622.000-2674.000=-52.000
σ0.000
min2622.000-2674.000=-52.000
max2622.000-2674.000=-52.000
mean2.510-2.946=-0.437
σ0.068-0.092=-0.025
min2.457-2.881=-0.424
max2.611-3.105=-0.494
iters=5
new-facts=6402
prior-facts=1
mean4750.845-4954.156=-203.311
σ0.830-0.594=0.236
min4750.334-4953.836=-203.502
max4752.312-4955.215=-202.903
mean2622.000-2674.000=-52.000
σ0.000
min2622.000-2674.000=-52.000
max2622.000-2674.000=-52.000
mean8.653-7.947=0.706
σ0.200-0.239=-0.040
min8.469-7.708=0.762
max8.868-8.342=0.526
iters=5
new-facts=6402
prior-facts=6402
mean4941.264-5168.826=-227.562
σ0.202-0.092=0.110
min4940.926-5168.722=-227.796
max4941.423-5168.908=-227.484
mean2968.400-3363.200=-394.800
σ263.754-467.063=-203.309
min2622.000-2736.000=-114.000
max3316.000-3969.000=-653.000
mean8.456-9.089=-0.633
σ0.157-0.492=-0.335
min8.291-8.412=-0.121
max8.694-9.562=-0.869

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.287-1.091=0.196
σ0.372-0.265=0.107
min0.939-0.933=0.005
max1.823-1.556=0.267

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.907-459.818=6.089
σ575.765-571.583=4.182
min178.021-174.017=4.004
max1329.555-1317.193=12.362
mean81.750-79.500=2.250
σ7.500-7.000=0.500
min78.000-76.000=2.000
max93.000-90.000=3.000
mean2622.000-2674.000=-52.000
σ0.000
min2622.000-2674.000=-52.000
max2622.000-2674.000=-52.000
mean0.568-0.533=0.035
σ0.562-0.532=0.029
min0.280-0.263=0.016
max1.411-1.332=0.079
policies=20
mean1780.429-1740.426=40.003
σ0.353-0.335=0.018
min1780.191-1740.217=39.973
max1780.951-1740.926=40.026
mean780.000-760.000=20.000
σ0.000
min780.000-760.000=20.000
max780.000-760.000=20.000
mean2622.000-2674.000=-52.000
σ0.000
min2622.000-2674.000=-52.000
max2622.000-2674.000=-52.000
mean2.787-2.700=0.087
σ0.020-0.026=-0.007
min2.758-2.665=0.093
max2.800-2.728=0.072
policies=200
mean17811.251-17411.276=399.975
σ0.530-0.461=0.069
min17810.887-17411.022=399.864
max17812.036-17411.967=400.069
mean7800.000-7600.000=200.000
σ0.000
min7800.000-7600.000=200.000
max7800.000-7600.000=200.000
mean2622.000-2674.000=-52.000
σ0.000
min2622.000-2674.000=-52.000
max2622.000-2674.000=-52.000
mean27.916-27.096=0.820
σ0.118-0.125=-0.007
min27.807-27.001=0.806
max28.044-27.281=0.763