Compare commits

Home / Compare f15599c0 .. 48e27838

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.726
σ1.038
min35.921
max38.462
mean3961.000
σ0.000
min3961.000
max3961.000
mean0.076
σ0.003
min0.074
max0.082
cache=y
dps=1
iters=10
policies=100
mean26.585
σ0.844
min26.205
max28.711
mean3961.000
σ0.000
min3961.000
max3961.000
mean0.058
σ0.002
min0.056
max0.064

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.357-1756.309=0.048
σ0.372-0.368=0.005
min1755.784-1755.735=0.049
max1756.953-1756.903=0.050
mean1650.800-1657.600=-6.800
σ640.031-637.274=2.758
min627.000-610.000=17.000
max2855.000-2690.000=165.000
mean2.245-2.281=-0.036
σ0.141-0.142=-0.000
min2.127-2.139=-0.012
max2.772-2.765=0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.671-278.696=-0.025
σ0.014-0.015=-0.001
min278.658-278.680=-0.022
max278.695-278.713=-0.018
mean2855.000-2690.000=165.000
σ0.000
min2855.000-2690.000=165.000
max2855.000-2690.000=165.000
mean0.418-0.418=0.001
σ0.001-0.009=-0.008
min0.418-0.403=0.015
max0.419-0.423=-0.004
iters=5
new-facts=1
prior-facts=6402
mean2268.849-2268.839=0.010
σ0.006-0.021=-0.015
min2268.843-2268.815=0.028
max2268.858-2268.864=-0.006
mean2855.000-2690.000=165.000
σ0.000
min2855.000-2690.000=165.000
max2855.000-2690.000=165.000
mean3.013-3.418=-0.404
σ0.136-0.296=-0.160
min2.921-2.934=-0.013
max3.240-3.743=-0.503
iters=5
new-facts=6402
prior-facts=1
mean4952.241-4956.056=-3.815
σ0.843-0.843=0.000
min4951.483-4955.639=-4.156
max4953.692-4957.560=-3.868
mean2855.000-2690.000=165.000
σ0.000
min2855.000-2690.000=165.000
max2855.000-2690.000=165.000
mean7.754-7.908=-0.154
σ0.126-0.234=-0.108
min7.629-7.689=-0.060
max7.895-8.289=-0.394
iters=5
new-facts=6402
prior-facts=6402
mean5167.053-5170.768=-3.715
σ0.011-0.088=-0.077
min5167.043-5170.666=-3.623
max5167.066-5170.840=-3.773
mean3406.200-3500.600=-94.400
σ420.833-483.643=-62.810
min2855.000-2861.000=-6.000
max3961.000-4161.000=-200.000
mean9.413-9.239=0.174
σ0.408-0.244=0.163
min9.034-8.828=0.206
max10.020-9.420=0.600

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.017-1.033=-0.016
σ0.130-0.132=-0.002
min0.930-0.944=-0.014
max1.228-1.244=-0.016

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.254-460.252=0.002
σ572.608-572.606=0.002
min173.949-173.948=0.000
max1319.166-1319.162=0.005
mean79.500
σ7.000
min76.000
max90.000
mean435.000-437.000=-2.000
σ0.000
min435.000-437.000=-2.000
max435.000-437.000=-2.000
mean0.549-0.555=-0.006
σ0.547-0.559=-0.013
min0.274-0.270=0.004
max1.369-1.394=-0.025
policies=20
mean1740.001-1739.987=0.013
σ0.332-0.335=-0.004
min1739.765-1739.747=0.018
max1740.487-1740.479=0.008
mean760.000
σ0.000
min760.000
max760.000
mean445.500-446.750=-1.250
σ9.950-9.605=0.345
min435.000-437.000=-2.000
max454.000-455.000=-1.000
mean2.660-2.673=-0.013
σ0.015-0.017=-0.002
min2.640-2.650=-0.010
max2.676-2.691=-0.015
policies=200
mean17409.310-17409.256=0.053
σ0.053-0.164=-0.111
min17409.273-17409.034=0.239
max17409.389-17409.430=-0.041
mean7600.000
σ0.000
min7600.000
max7600.000
mean488.250-490.000=-1.750
σ2.217-2.944=-0.727
min486.000-487.000=-1.000
max491.000-493.000=-2.000
mean26.873-26.966=-0.094
σ0.077-0.126=-0.049
min26.766-26.807=-0.041
max26.949-27.090=-0.140