Compare commits

Home / Compare 121b8314 .. 8b1cb72e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-33.979=19.935
σ0.366-0.049=0.317
min53.787-33.953=19.835
max54.955-34.114=20.841
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.139-0.085=0.053
σ0.004-0.004=-0.001
min0.135-0.082=0.053
max0.146-0.094=0.052
cache=y
dps=1
iters=10
policies=100
mean43.141-23.318=19.823
σ0.007-0.002=0.005
min43.129-23.314=19.814
max43.151-23.322=19.828
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.121-0.066=0.055
σ0.003-0.003=0.000
min0.117-0.063=0.054
max0.128-0.072=0.056

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.081-1757.429=-765.348
σ1.232-0.365=0.867
min991.493-1756.854=-765.360
max997.252-1758.024=-760.771
mean1062.700-1662.000=-599.300
σ312.070-622.841=-310.771
min605.000-667.000=-62.000
max1598.000-2591.000=-993.000
mean1.539-2.364=-0.825
σ0.096-0.122=-0.026
min1.409-2.245=-0.836
max1.816-2.676=-0.860

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.665-326.571=-40.907
σ0.021-0.046=-0.025
min285.632-326.492=-40.860
max285.685-326.604=-40.919
mean1598.000-2591.000=-993.000
σ0.000
min1598.000-2591.000=-993.000
max1598.000-2591.000=-993.000
mean0.375-0.422=-0.047
σ0.001-0.001=-0.000
min0.374-0.420=-0.047
max0.376-0.423=-0.047
iters=5
new-facts=1
prior-facts=6402
mean1285.633-1988.726=-703.093
σ0.123-0.019=0.104
min1285.575-1988.710=-703.135
max1285.853-1988.748=-702.895
mean1598.000-2591.000=-993.000
σ0.000
min1598.000-2591.000=-993.000
max1598.000-2591.000=-993.000
mean1.882-2.671=-0.789
σ0.059-0.100=-0.041
min1.808-2.551=-0.744
max1.956-2.816=-0.859
iters=5
new-facts=6402
prior-facts=1
mean1807.994-4813.457=-3005.463
σ6.998-7.470=-0.471
min1804.649-4810.091=-3005.442
max1820.499-4826.819=-3006.321
mean1598.000-2591.000=-993.000
σ0.000
min1598.000-2591.000=-993.000
max1598.000-2591.000=-993.000
mean4.269-8.919=-4.649
σ0.171-0.194=-0.023
min4.078-8.606=-4.528
max4.481-9.114=-4.633
iters=5
new-facts=6402
prior-facts=6402
mean2070.467-5001.134=-2930.667
σ0.011-0.026=-0.015
min2070.459-5001.105=-2930.647
max2070.485-5001.168=-2930.682
mean1851.800-3003.200=-1151.400
σ209.992-318.399=-108.407
min1598.000-2591.000=-993.000
max2087.000-3408.000=-1321.000
mean4.541-9.722=-5.181
σ0.107-0.233=-0.125
min4.416-9.319=-4.904
max4.687-9.882=-5.196

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.318-1.350=-0.032
σ0.303-0.350=-0.046
min0.985-1.048=-0.062
max1.677-1.853=-0.176

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.378-464.564=-27.185
σ572.364-574.779=-2.415
min151.194-177.170=-25.976
max1295.924-1326.732=-30.808
mean90.250-88.250=2.000
σ8.500
min86.000-84.000=2.000
max103.000-101.000=2.000
mean1598.000-2591.000=-993.000
σ0.000
min1598.000-2591.000=-993.000
max1598.000-2591.000=-993.000
mean0.520-0.550=-0.030
σ0.533-0.551=-0.018
min0.250-0.272=-0.023
max1.320-1.376=-0.056
policies=20
mean1512.173-1772.019=-259.846
σ0.200-0.349=-0.149
min1512.026-1771.796=-259.771
max1512.468-1772.538=-260.070
mean860.000-840.000=20.000
σ0.000
min860.000-840.000=20.000
max860.000-840.000=20.000
mean1598.000-2591.000=-993.000
σ0.000
min1598.000-2591.000=-993.000
max1598.000-2591.000=-993.000
mean2.519-2.706=-0.188
σ0.023-0.012=0.011
min2.494-2.693=-0.199
max2.539-2.718=-0.180
policies=200
mean15129.511-17727.501=-2597.990
σ0.414-0.446=-0.032
min15128.898-17727.072=-2598.173
max15129.788-17728.128=-2598.340
mean8600.000-8400.000=200.000
σ0.000
min8600.000-8400.000=200.000
max8600.000-8400.000=200.000
mean1598.000-2591.000=-993.000
σ0.000
min1598.000-2591.000=-993.000
max1598.000-2591.000=-993.000
mean25.592-27.474=-1.882
σ0.116-0.232=-0.116
min25.474-27.270=-1.795
max25.740-27.785=-2.045