Compare commits

Home / Compare a132e3e5 .. 80512615

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.389-70.395=-0.006
σ0.046-0.044=0.003
min70.362-70.370=-0.008
max70.519-70.515=0.004
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.157-0.176=-0.019
σ0.005-0.006=-0.001
min0.151-0.166=-0.015
max0.165-0.185=-0.021
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=-0.001
σ0.003-0.003=-0.000
min21.141-21.139=0.002
max21.148-21.149=-0.001
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.063-0.065=-0.001
σ0.002-0.002=-0.000
min0.058-0.062=-0.005
max0.066-0.071=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.393-1752.395=-0.002
σ0.359-0.361=-0.001
min1751.822-1751.827=-0.004
max1752.980-1752.979=0.000
mean1683.850-1657.100=26.750
σ632.442-631.122=1.320
min667.000-623.000=44.000
max2653.000-2770.000=-117.000
mean2.775-2.809=-0.034
σ0.148-0.186=-0.037
min2.464-2.191=0.273
max2.985-3.086=-0.101

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.141-270.143=-0.002
σ0.007-0.008=-0.001
min270.132-270.134=-0.002
max270.151-270.156=-0.005
mean2653.000-2770.000=-117.000
σ0.000
min2653.000-2770.000=-117.000
max2653.000-2770.000=-117.000
mean0.377-0.380=-0.002
σ0.005-0.001=0.004
min0.369-0.378=-0.009
max0.380-0.380=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1930.603-1930.607=-0.004
σ0.006-0.006=-0.000
min1930.597-1930.600=-0.003
max1930.611-1930.614=-0.003
mean2653.000-2770.000=-117.000
σ0.000
min2653.000-2770.000=-117.000
max2653.000-2770.000=-117.000
mean2.626-2.549=0.078
σ0.132-0.082=0.050
min2.446-2.480=-0.034
max2.817-2.686=0.131
iters=5
new-facts=6402
prior-facts=1
mean4751.201-4751.317=-0.116
σ0.974-0.925=0.049
min4750.277-4750.775=-0.498
max4752.849-4752.958=-0.110
mean2653.000-2770.000=-117.000
σ0.000
min2653.000-2770.000=-117.000
max2653.000-2770.000=-117.000
mean8.583-8.486=0.097
σ0.642-0.536=0.106
min7.611-7.664=-0.053
max9.393-9.062=0.330
iters=5
new-facts=6402
prior-facts=6402
mean4941.778-4941.699=0.079
σ0.030-0.152=-0.122
min4941.744-4941.428=0.316
max4941.819-4941.784=0.036
mean3061.000-3017.200=43.800
σ314.514-230.775=83.739
min2653.000-2770.000=-117.000
max3364.000-3320.000=44.000
mean8.939-8.619=0.320
σ0.451-0.241=0.209
min8.372-8.357=0.015
max9.455-8.963=0.491

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.277-1.031=0.246
σ0.379-0.122=0.258
min0.913-0.942=-0.029
max1.902-1.219=0.682

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.374-466.373=0.001
σ575.934-575.918=0.016
min178.405-178.406=-0.001
max1330.275-1330.250=0.025
mean84.000
σ8.000
min80.000
max96.000
mean2653.000-2770.000=-117.000
σ0.000
min2653.000-2770.000=-117.000
max2653.000-2770.000=-117.000
mean0.555-0.445=0.110
σ0.546-0.309=0.237
min0.280-0.288=-0.008
max1.374-0.909=0.465
policies=20
mean1784.324-1784.354=-0.030
σ0.353-0.344=0.010
min1784.096-1784.108=-0.012
max1784.850-1784.853=-0.003
mean800.000
σ0.000
min800.000
max800.000
mean2653.000-2770.000=-117.000
σ0.000
min2653.000-2770.000=-117.000
max2653.000-2770.000=-117.000
mean2.782-2.841=-0.059
σ0.031-0.125=-0.093
min2.745-2.768=-0.023
max2.821-3.028=-0.206
policies=200
mean17849.810-17849.737=0.074
σ0.406-0.545=-0.139
min17849.526-17849.310=0.216
max17850.410-17850.532=-0.122
mean8000.000
σ0.000
min8000.000
max8000.000
mean2653.000-2770.000=-117.000
σ0.000
min2653.000-2770.000=-117.000
max2653.000-2770.000=-117.000
mean27.923-28.006=-0.083
σ0.105-0.154=-0.049
min27.862-27.912=-0.050
max28.080-28.236=-0.156