Compare commits

Home / Compare fbe37931 .. cf875ca1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.781=0.001
σ0.046-0.047=-0.001
min70.751-70.748=0.003
max70.910-70.909=0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.161-0.158=0.003
σ0.004-0.003=0.001
min0.158-0.156=0.002
max0.167-0.164=0.003
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=0.001
σ0.003-0.002=0.000
min21.488-21.488=-0.000
max21.497-21.495=0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.065-0.066=-0.001
σ0.003-0.003=-0.001
min0.063-0.063=-0.000
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.095=-0.002
σ0.361-0.361=0.000
min1753.533-1753.529=0.003
max1754.666-1754.682=-0.016
mean1635.150-1658.850=-23.700
σ617.575-617.733=-0.157
min643.000-638.000=5.000
max2474.000-2495.000=-21.000
mean2.777-2.827=-0.050
σ0.229-0.186=0.042
min2.253-2.321=-0.068
max3.197-3.179=0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.595-271.599=-0.004
σ0.005-0.008=-0.003
min271.588-271.590=-0.001
max271.599-271.608=-0.009
mean2474.000-2495.000=-21.000
σ0.000
min2474.000-2495.000=-21.000
max2474.000-2495.000=-21.000
mean0.380-0.382=-0.001
σ0.003-0.005=-0.001
min0.377-0.379=-0.002
max0.385-0.390=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1932.000-1931.990=0.010
σ0.011-0.018=-0.007
min1931.987-1931.962=0.025
max1932.012-1932.004=0.008
mean2474.000-2495.000=-21.000
σ0.000
min2474.000-2495.000=-21.000
max2474.000-2495.000=-21.000
mean2.496-2.589=-0.093
σ0.039-0.087=-0.047
min2.454-2.499=-0.045
max2.543-2.680=-0.137
iters=5
new-facts=6402
prior-facts=1
mean4752.684-4752.812=-0.128
σ0.900-0.807=0.092
min4751.780-4752.360=-0.580
max4754.198-4754.253=-0.055
mean2474.000-2495.000=-21.000
σ0.000
min2474.000-2495.000=-21.000
max2474.000-2495.000=-21.000
mean8.177-7.961=0.216
σ0.376-0.283=0.092
min7.636-7.768=-0.132
max8.526-8.463=0.063
iters=5
new-facts=6402
prior-facts=6402
mean4943.080-4943.206=-0.126
σ0.174-0.022=0.151
min4942.882-4943.181=-0.300
max4943.221-4943.230=-0.009
mean2986.400-2950.600=35.800
σ275.116-370.370=-95.255
min2603.000-2495.000=108.000
max3289.000-3437.000=-148.000
mean8.496-8.424=0.073
σ0.110-0.104=0.006
min8.386-8.342=0.043
max8.629-8.602=0.027

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.723-1.778=-0.055
σ0.159-0.062=0.097
min1.464-1.719=-0.255
max1.833-1.864=-0.032

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.610-468.609=0.001
σ574.882-574.878=0.003
min181.164-181.166=-0.002
max1330.933-1330.927=0.006
mean88.250
σ8.500
min84.000
max101.000
mean2474.000-2495.000=-21.000
σ0.000
min2474.000-2495.000=-21.000
max2474.000-2495.000=-21.000
mean0.572-0.559=0.013
σ0.555-0.544=0.011
min0.286-0.285=0.002
max1.404-1.375=0.029
policies=20
mean1811.956-1811.959=-0.004
σ0.384-0.387=-0.003
min1811.702-1811.703=-0.001
max1812.522-1812.531=-0.009
mean840.000
σ0.000
min840.000
max840.000
mean2474.000-2495.000=-21.000
σ0.000
min2474.000-2495.000=-21.000
max2474.000-2495.000=-21.000
mean2.844-2.844=0.000
σ0.021-0.019=0.002
min2.825-2.821=0.004
max2.870-2.867=0.003
policies=200
mean18126.785-18126.684=0.102
σ0.480-0.357=0.123
min18126.515-18126.433=0.081
max18127.503-18127.212=0.291
mean8400.000
σ0.000
min8400.000
max8400.000
mean2474.000-2495.000=-21.000
σ0.000
min2474.000-2495.000=-21.000
max2474.000-2495.000=-21.000
mean28.594-28.652=-0.059
σ0.060-0.052=0.008
min28.505-28.585=-0.080
max28.634-28.708=-0.074