Compare commits

Home / Compare 332da7cb .. 5274087c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.958
σ0.049
min30.917
max31.093
mean414.000
σ0.000
min414.000
max414.000
mean0.077
σ0.004
min0.071
max0.085
cache=y
dps=1
iters=10
policies=100
mean21.060
σ0.003
min21.056
max21.064
mean414.000
σ0.000
min414.000
max414.000
mean0.061
σ0.004
min0.057
max0.067

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1755.329=-3.917
σ0.362-0.368=-0.006
min1750.842-1754.758=-3.916
max1752.006-1755.914=-3.908
mean1633.450-1658.700=-25.250
σ609.898-623.377=-13.478
min648.000-680.000=-32.000
max2451.000-2650.000=-199.000
mean2.853-2.274=0.579
σ0.181-0.107=0.074
min2.300-2.156=0.145
max3.263-2.522=0.741

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.402-277.711=-4.310
σ0.010-0.011=-0.000
min273.392-277.696=-4.303
max273.417-277.722=-4.305
mean2451.000-2650.000=-199.000
σ0.000
min2451.000-2650.000=-199.000
max2451.000-2650.000=-199.000
mean0.383-0.410=-0.027
σ0.008-0.002=0.005
min0.376-0.408=-0.032
max0.392-0.413=-0.021
iters=5
new-facts=1
prior-facts=6402
mean1933.832-2267.882=-334.050
σ0.012-0.019=-0.007
min1933.812-2267.849=-334.037
max1933.843-2267.896=-334.053
mean2451.000-2650.000=-199.000
σ0.000
min2451.000-2650.000=-199.000
max2451.000-2650.000=-199.000
mean3.044-3.208=-0.164
σ0.192-0.157=0.035
min2.732-2.945=-0.213
max3.238-3.340=-0.102
iters=5
new-facts=6402
prior-facts=1
mean4754.335-4955.046=-200.712
σ0.848-0.844=0.004
min4753.789-4954.567=-200.778
max4755.841-4956.549=-200.707
mean2451.000-2650.000=-199.000
σ0.000
min2451.000-2650.000=-199.000
max2451.000-2650.000=-199.000
mean8.676-8.003=0.672
σ0.504-0.349=0.155
min7.804-7.704=0.100
max9.058-8.507=0.552
iters=5
new-facts=6402
prior-facts=6402
mean4944.799-5169.786=-224.987
σ0.092-0.094=-0.002
min4944.720-5169.669=-224.950
max4944.909-5169.871=-224.961
mean2986.600-3355.000=-368.400
σ351.799-448.675=-96.876
min2485.000-2918.000=-433.000
max3294.000-3814.000=-520.000
mean8.733-9.383=-0.649
σ0.307-0.214=0.093
min8.435-9.150=-0.716
max9.082-9.623=-0.541

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.897-1.582=0.315
σ0.092-0.352=-0.260
min1.776-1.158=0.618
max1.993-1.850=0.143

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.331-456.318=7.013
σ572.199-572.592=-0.393
min177.230-170.021=7.209
max1321.630-1315.206=6.424
mean79.750-79.500=0.250
σ7.500-7.000=0.500
min76.000
max91.000-90.000=1.000
mean2451.000-432.000=2019.000
σ0.000
min2451.000-432.000=2019.000
max2451.000-432.000=2019.000
mean0.571-0.530=0.041
σ0.569-0.523=0.045
min0.283-0.263=0.020
max1.424-1.315=0.109
policies=20
mean1772.579-1700.727=71.852
σ0.334-0.297=0.036
min1772.354-1700.511=71.844
max1773.071-1701.162=71.909
mean760.000
σ0.000
min760.000
max760.000
mean2451.000-440.000=2011.000
σ0.000-9.626=-9.626
min2451.000-432.000=2019.000
max2451.000-454.000=1997.000
mean2.727-2.614=0.113
σ0.010-0.016=-0.006
min2.722-2.595=0.127
max2.742-2.631=0.111
policies=200
mean17732.401-17016.745=715.656
σ0.436-0.062=0.374
min17732.102-17016.657=715.445
max17733.035-17016.796=716.239
mean7600.000
σ0.000
min7600.000
max7600.000
mean2451.000-489.750=1961.250
σ0.000-2.217=-2.217
min2451.000-487.000=1964.000
max2451.000-492.000=1959.000
mean27.722-26.370=1.351
σ0.188-0.064=0.124
min27.598-26.328=1.270
max27.997-26.467=1.530