Compare commits

Home / Compare 9ad85fdd .. a132e3e5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.395-70.390=0.005
σ0.044-0.048=-0.004
min70.370-70.363=0.007
max70.515-70.523=-0.008
mean414.000-412.400=1.600
σ0.000-0.516=-0.516
min414.000-412.000=2.000
max414.000-413.000=1.000
mean0.176-0.159=0.017
σ0.006-0.005=0.001
min0.166-0.150=0.016
max0.185-0.167=0.018
cache=y
dps=1
iters=10
policies=100
mean21.144-21.145=-0.001
σ0.003-0.003=0.000
min21.139-21.141=-0.002
max21.149-21.149=-0.000
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.065-0.065=-0.000
σ0.002-0.003=-0.001
min0.062-0.063=-0.000
max0.071-0.074=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.395-1752.395=-0.000
σ0.361-0.361=-0.000
min1751.827-1751.824=0.002
max1752.979-1752.967=0.012
mean1657.100-1625.000=32.100
σ631.122-590.380=40.743
min623.000
max2770.000-2411.000=359.000
mean2.809-2.800=0.010
σ0.186-0.173=0.012
min2.191-2.301=-0.110
max3.086-3.060=0.026

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.143-270.122=0.020
σ0.008-0.006=0.002
min270.134-270.117=0.017
max270.156-270.132=0.024
mean2770.000-2411.000=359.000
σ0.000
min2770.000-2411.000=359.000
max2770.000-2411.000=359.000
mean0.380-0.385=-0.006
σ0.001-0.008=-0.007
min0.378-0.379=-0.002
max0.380-0.399=-0.019
iters=5
new-facts=1
prior-facts=6402
mean1930.607-1930.607=-0.000
σ0.006-0.006=-0.000
min1930.600-1930.598=0.002
max1930.614-1930.614=-0.001
mean2770.000-2411.000=359.000
σ0.000
min2770.000-2411.000=359.000
max2770.000-2411.000=359.000
mean2.549-2.554=-0.005
σ0.082-0.117=-0.035
min2.480-2.432=0.047
max2.686-2.686=0.000
iters=5
new-facts=6402
prior-facts=1
mean4751.317-4751.308=0.009
σ0.925-0.852=0.073
min4750.775-4750.892=-0.117
max4752.958-4752.830=0.128
mean2770.000-2411.000=359.000
σ0.000
min2770.000-2411.000=359.000
max2770.000-2411.000=359.000
mean8.486-8.397=0.090
σ0.536-0.325=0.211
min7.664-7.845=-0.181
max9.062-8.620=0.442
iters=5
new-facts=6402
prior-facts=6402
mean4941.699-4941.702=-0.003
σ0.152-0.150=0.002
min4941.428-4941.437=-0.009
max4941.784-4941.794=-0.011
mean3017.200-3009.200=8.000
σ230.775-293.266=-62.491
min2770.000-2601.000=169.000
max3320.000-3387.000=-67.000
mean8.619-8.739=-0.120
σ0.241-0.334=-0.093
min8.357-8.458=-0.102
max8.963-9.319=-0.356

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.031-1.837=-0.806
σ0.122-0.175=-0.053
min0.942-1.597=-0.656
max1.219-2.045=-0.826

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.373-466.364=0.009
σ575.918-575.914=0.004
min178.406-178.403=0.003
max1330.250-1330.235=0.015
mean84.000
σ8.000
min80.000
max96.000
mean2770.000-2411.000=359.000
σ0.000
min2770.000-2411.000=359.000
max2770.000-2411.000=359.000
mean0.445-0.566=-0.121
σ0.309-0.570=-0.261
min0.288-0.277=0.011
max0.909-1.422=-0.512
policies=20
mean1784.354-1784.322=0.032
σ0.344-0.358=-0.014
min1784.108-1784.092=0.016
max1784.853-1784.853=-0.001
mean800.000
σ0.000
min800.000
max800.000
mean2770.000-2411.000=359.000
σ0.000
min2770.000-2411.000=359.000
max2770.000-2411.000=359.000
mean2.841-2.797=0.044
σ0.125-0.017=0.107
min2.768-2.777=-0.009
max3.028-2.812=0.215
policies=200
mean17849.737-17849.792=-0.055
σ0.545-0.398=0.147
min17849.310-17849.447=-0.136
max17850.532-17850.366=0.167
mean8000.000
σ0.000
min8000.000
max8000.000
mean2770.000-2411.000=359.000
σ0.000
min2770.000-2411.000=359.000
max2770.000-2411.000=359.000
mean28.006-28.020=-0.015
σ0.154-0.069=0.085
min27.912-27.942=-0.030
max28.236-28.110=0.126