Compare commits

Home / Compare 66bbbae1 .. 409bf54a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.385-70.385=-0.000
σ0.048-0.047=0.001
min70.358-70.358=0.000
max70.518-70.516=0.002
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.158-0.159=-0.001
σ0.005-0.004=0.001
min0.150-0.154=-0.003
max0.164-0.164=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.143-21.142=0.001
σ0.002-0.003=-0.001
min21.138-21.137=0.001
max21.145-21.146=-0.001
mean414.700-413.000=1.700
σ0.483-0.000=0.483
min414.000-413.000=1.000
max415.000-413.000=2.000
mean0.065-0.065=-0.000
σ0.002-0.002=-0.000
min0.063-0.063=-0.001
max0.070-0.071=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.394=0.001
σ0.362-0.359=0.003
min1751.825-1751.823=0.002
max1752.977-1752.958=0.019
mean1653.900-1652.600=1.300
σ646.062-644.553=1.509
min631.000
max2849.000-2855.000=-6.000
mean2.804-2.807=-0.003
σ0.195-0.167=0.028
min2.302-2.444=-0.142
max3.060-3.005=0.055

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.144-270.144=0.000
σ0.006-0.006=-0.000
min270.135-270.133=0.002
max270.149-270.149=0.001
mean2849.000-2855.000=-6.000
σ0.000
min2849.000-2855.000=-6.000
max2849.000-2855.000=-6.000
mean0.380-0.376=0.004
σ0.006-0.001=0.005
min0.371-0.375=-0.004
max0.389-0.377=0.012
iters=5
new-facts=1
prior-facts=6402
mean1930.595-1930.607=-0.012
σ0.016-0.011=0.005
min1930.577-1930.593=-0.016
max1930.612-1930.622=-0.009
mean2849.000-2855.000=-6.000
σ0.000
min2849.000-2855.000=-6.000
max2849.000-2855.000=-6.000
mean2.540-2.554=-0.014
σ0.175-0.119=0.056
min2.388-2.453=-0.065
max2.838-2.727=0.111
iters=5
new-facts=6402
prior-facts=1
mean4751.290-4751.274=0.016
σ0.938-0.867=0.071
min4750.751-4750.743=0.008
max4752.959-4752.814=0.145
mean2849.000-2855.000=-6.000
σ0.000
min2849.000-2855.000=-6.000
max2849.000-2855.000=-6.000
mean8.685-8.732=-0.047
σ0.644-0.323=0.321
min7.665-8.455=-0.790
max9.269-9.272=-0.002
iters=5
new-facts=6402
prior-facts=6402
mean4941.625-4941.696=-0.071
σ0.184-0.148=0.036
min4941.418-4941.433=-0.015
max4941.777-4941.782=-0.005
mean3052.000-3074.600=-22.600
σ199.959-225.324=-25.365
min2849.000-2855.000=-6.000
max3310.000-3305.000=5.000
mean8.557-8.773=-0.216
σ0.163-0.298=-0.136
min8.375-8.428=-0.053
max8.747-9.228=-0.481

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.007-0.988=0.019
σ0.139-0.147=-0.008
min0.944-0.912=0.032
max1.256-1.251=0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.377-466.381=-0.003
σ575.925-575.936=-0.011
min178.404-178.403=0.001
max1330.265-1330.284=-0.019
mean84.250
σ8.500
min80.000
max97.000
mean2849.000-2855.000=-6.000
σ0.000
min2849.000-2855.000=-6.000
max2849.000-2855.000=-6.000
mean0.444-0.445=-0.000
σ0.307-0.304=0.004
min0.289-0.290=-0.001
max0.905-0.901=0.005
policies=20
mean1784.359-1784.361=-0.003
σ0.360-0.361=-0.001
min1784.116-1784.111=0.006
max1784.889-1784.893=-0.004
mean800.000
σ0.000
min800.000
max800.000
mean2849.000-2855.000=-6.000
σ0.000
min2849.000-2855.000=-6.000
max2849.000-2855.000=-6.000
mean2.873-2.863=0.010
σ0.006-0.006=-0.001
min2.869-2.856=0.013
max2.881-2.870=0.011
policies=200
mean17849.840-17849.741=0.099
σ0.443-0.539=-0.096
min17849.549-17849.460=0.089
max17850.497-17850.549=-0.052
mean8000.000
σ0.000
min8000.000
max8000.000
mean2849.000-2855.000=-6.000
σ0.000
min2849.000-2855.000=-6.000
max2849.000-2855.000=-6.000
mean28.493-28.474=0.019
σ0.475-0.531=-0.056
min28.073-27.938=0.135
max28.938-28.982=-0.044