Compare commits

Home / Compare 21640a27 .. 3f66f0e8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.389-70.390=-0.000
σ0.046-0.046=-0.000
min70.362-70.362=0.001
max70.519-70.519=-0.000
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.157-0.159=-0.001
σ0.005-0.003=0.002
min0.151-0.156=-0.005
max0.165-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=-0.000
σ0.003-0.003=-0.000
min21.141-21.140=0.001
max21.148-21.148=-0.000
mean412.000-417.000=-5.000
σ0.000
min412.000-417.000=-5.000
max412.000-417.000=-5.000
mean0.063-0.064=-0.000
σ0.002-0.003=-0.001
min0.058-0.059=-0.002
max0.066-0.071=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.393-1752.394=-0.001
σ0.359-0.362=-0.002
min1751.822-1751.821=0.001
max1752.980-1752.990=-0.010
mean1683.850-1640.650=43.200
σ632.442-614.594=17.848
min667.000-627.000=40.000
max2653.000-2474.000=179.000
mean2.775-2.829=-0.054
σ0.148-0.184=-0.036
min2.464-2.173=0.291
max2.985-3.100=-0.115

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.141-270.148=-0.007
σ0.007-0.008=-0.001
min270.132-270.136=-0.004
max270.151-270.157=-0.006
mean2653.000-2474.000=179.000
σ0.000
min2653.000-2474.000=179.000
max2653.000-2474.000=179.000
mean0.377-0.395=-0.017
σ0.005-0.008=-0.004
min0.369-0.380=-0.011
max0.380-0.400=-0.020
iters=5
new-facts=1
prior-facts=6402
mean1930.603-1930.610=-0.006
σ0.006-0.005=0.000
min1930.597-1930.601=-0.005
max1930.611-1930.616=-0.005
mean2653.000-2474.000=179.000
σ0.000
min2653.000-2474.000=179.000
max2653.000-2474.000=179.000
mean2.626-2.553=0.073
σ0.132-0.095=0.038
min2.446-2.449=-0.003
max2.817-2.665=0.153
iters=5
new-facts=6402
prior-facts=1
mean4751.201-4751.099=0.102
σ0.974-1.064=-0.090
min4750.277-4750.274=0.003
max4752.849-4752.943=-0.094
mean2653.000-2474.000=179.000
σ0.000
min2653.000-2474.000=179.000
max2653.000-2474.000=179.000
mean8.583-8.418=0.165
σ0.642-0.600=0.042
min7.611-7.570=0.041
max9.393-9.055=0.338
iters=5
new-facts=6402
prior-facts=6402
mean4941.778-4941.774=0.004
σ0.030-0.011=0.019
min4941.744-4941.759=-0.016
max4941.819-4941.788=0.032
mean3061.000-3012.200=48.800
σ314.514-326.452=-11.939
min2653.000-2583.000=70.000
max3364.000-3428.000=-64.000
mean8.939-8.541=0.398
σ0.451-0.108=0.343
min8.372-8.426=-0.055
max9.455-8.662=0.793

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.277-1.810=-0.533
σ0.379-0.146=0.233
min0.913-1.558=-0.645
max1.902-1.920=-0.018

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.374-466.368=0.006
σ575.934-575.924=0.010
min178.405-178.402=0.002
max1330.275-1330.254=0.021
mean84.000
σ8.000
min80.000
max96.000
mean2653.000-2474.000=179.000
σ0.000
min2653.000-2474.000=179.000
max2653.000-2474.000=179.000
mean0.555-0.543=0.012
σ0.546-0.530=0.016
min0.280-0.276=0.004
max1.374-1.339=0.036
policies=20
mean1784.324-1784.320=0.004
σ0.353-0.356=-0.002
min1784.096-1784.098=-0.002
max1784.850-1784.850=0.000
mean800.000
σ0.000
min800.000
max800.000
mean2653.000-2474.000=179.000
σ0.000
min2653.000-2474.000=179.000
max2653.000-2474.000=179.000
mean2.782-2.767=0.015
σ0.031-0.023=0.009
min2.745-2.743=0.002
max2.821-2.794=0.027
policies=200
mean17849.810-17849.893=-0.083
σ0.406-0.456=-0.051
min17849.526-17849.576=-0.050
max17850.410-17850.569=-0.158
mean8000.000
σ0.000
min8000.000
max8000.000
mean2653.000-2474.000=179.000
σ0.000
min2653.000-2474.000=179.000
max2653.000-2474.000=179.000
mean27.923-28.026=-0.103
σ0.105-0.021=0.084
min27.862-28.002=-0.140
max28.080-28.047=0.033