Compare commits

Home / Compare 4227a823 .. 10a129fc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.958-30.958=0.000
σ0.049-0.049=0.000
min30.916-30.913=0.003
max31.093-31.092=0.001
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.077-0.078=-0.001
σ0.005-0.003=0.002
min0.071-0.075=-0.004
max0.085-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean21.061-21.060=0.001
σ0.002-0.003=-0.000
min21.058-21.058=0.000
max21.064-21.065=-0.001
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.065-0.063=0.002
σ0.004-0.003=0.001
min0.062-0.059=0.003
max0.073-0.070=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.409-1751.412=-0.004
σ0.363-0.360=0.002
min1750.843-1750.847=-0.004
max1751.993-1751.982=0.011
mean1642.250-1663.300=-21.050
σ615.760-619.861=-4.101
min671.000-642.000=29.000
max2549.000-2504.000=45.000
mean2.827-2.819=0.008
σ0.169-0.166=0.003
min2.328-2.277=0.051
max3.035-3.063=-0.027

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.403-273.401=0.001
σ0.010-0.013=-0.003
min273.391-273.390=0.001
max273.412-273.417=-0.005
mean2549.000-2504.000=45.000
σ0.000
min2549.000-2504.000=45.000
max2549.000-2504.000=45.000
mean0.390-0.383=0.007
σ0.011-0.010=0.001
min0.379-0.376=0.003
max0.404-0.401=0.003
iters=5
new-facts=1
prior-facts=6402
mean1933.840-1933.839=0.002
σ0.005-0.012=-0.007
min1933.834-1933.825=0.008
max1933.847-1933.858=-0.012
mean2549.000-2504.000=45.000
σ0.000
min2549.000-2504.000=45.000
max2549.000-2504.000=45.000
mean3.004-2.870=0.134
σ0.143-0.121=0.022
min2.800-2.724=0.076
max3.199-3.017=0.182
iters=5
new-facts=6402
prior-facts=1
mean4754.232-4754.217=0.014
σ0.954-0.973=-0.019
min4753.388-4753.457=-0.069
max4755.863-4755.920=-0.057
mean2549.000-2504.000=45.000
σ0.000
min2549.000-2504.000=45.000
max2549.000-2504.000=45.000
mean8.591-8.542=0.049
σ0.593-0.746=-0.153
min7.869-7.629=0.239
max9.260-9.122=0.137
iters=5
new-facts=6402
prior-facts=6402
mean4944.784-4944.578=0.206
σ0.086-0.331=-0.244
min4944.715-4944.031=0.685
max4944.879-4944.882=-0.003
mean2980.000-2969.000=11.000
σ422.310-433.244=-10.934
min2549.000-2504.000=45.000
max3563.000-3559.000=4.000
mean8.460-8.430=0.030
σ0.143-0.149=-0.006
min8.329-8.319=0.010
max8.654-8.684=-0.030

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.500-1.755=-0.255
σ0.262-0.195=0.067
min1.224-1.430=-0.206
max1.815-1.893=-0.079

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.330-463.332=-0.002
σ572.200-572.196=0.004
min177.227-177.231=-0.004
max1321.630-1321.625=0.004
mean79.750
σ7.500
min76.000
max91.000
mean2549.000-2504.000=45.000
σ0.000
min2549.000-2504.000=45.000
max2549.000-2504.000=45.000
mean0.534-0.554=-0.020
σ0.510-0.553=-0.043
min0.275-0.277=-0.002
max1.299-1.383=-0.084
policies=20
mean1772.554-1772.589=-0.034
σ0.346-0.335=0.011
min1772.315-1772.366=-0.051
max1773.067-1773.086=-0.019
mean760.000
σ0.000
min760.000
max760.000
mean2549.000-2504.000=45.000
σ0.000
min2549.000-2504.000=45.000
max2549.000-2504.000=45.000
mean2.781-2.757=0.023
σ0.033-0.014=0.019
min2.760-2.740=0.020
max2.830-2.773=0.057
policies=200
mean17732.400-17732.493=-0.093
σ0.568-0.454=0.114
min17732.015-17732.224=-0.209
max17733.230-17733.171=0.059
mean7600.000
σ0.000
min7600.000
max7600.000
mean2549.000-2504.000=45.000
σ0.000
min2549.000-2504.000=45.000
max2549.000-2504.000=45.000
mean27.888-27.732=0.157
σ0.085-0.157=-0.072
min27.799-27.618=0.181
max28.002-27.963=0.039