Compare commits

Home / Compare 93512df0 .. 1b83aea4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.373=0.001
σ0.058-0.057=0.002
min70.331-70.333=-0.002
max70.537-70.531=0.006
mean412.000-410.000=2.000
σ0.000
min412.000-410.000=2.000
max412.000-410.000=2.000
mean0.158-0.158=0.000
σ0.004-0.005=-0.001
min0.154-0.150=0.004
max0.164-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.001
σ0.001-0.002=-0.001
min21.141-21.140=0.001
max21.145-21.146=-0.000
mean412.000-410.000=2.000
σ0.000
min412.000-410.000=2.000
max412.000-410.000=2.000
mean0.064-0.064=-0.000
σ0.002-0.003=-0.000
min0.063-0.063=-0.000
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.200-1752.198=0.002
σ0.362-0.360=0.002
min1751.626-1751.625=0.001
max1752.784-1752.789=-0.005
mean1648.600-1646.150=2.450
σ642.098-624.240=17.858
min630.000-685.000=-55.000
max2843.000-2799.000=44.000
mean2.781-2.800=-0.019
σ0.147-0.190=-0.043
min2.340-2.175=0.165
max2.994-3.060=-0.067

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.934-269.929=0.005
σ0.011-0.007=0.003
min269.917-269.920=-0.003
max269.945-269.938=0.006
mean2843.000-2799.000=44.000
σ0.000
min2843.000-2799.000=44.000
max2843.000-2799.000=44.000
mean0.383-0.373=0.010
σ0.006-0.006=0.000
min0.376-0.368=0.008
max0.391-0.383=0.009
iters=5
new-facts=1
prior-facts=6402
mean1930.403-1930.386=0.018
σ0.013-0.018=-0.005
min1930.387-1930.362=0.025
max1930.417-1930.404=0.013
mean2843.000-2799.000=44.000
σ0.000
min2843.000-2799.000=44.000
max2843.000-2799.000=44.000
mean2.503-2.552=-0.049
σ0.112-0.162=-0.050
min2.405-2.434=-0.029
max2.682-2.835=-0.153
iters=5
new-facts=6402
prior-facts=1
mean4750.870-4750.846=0.024
σ0.798-0.807=-0.010
min4750.314-4750.289=0.025
max4752.272-4752.269=0.003
mean2843.000-2799.000=44.000
σ0.000
min2843.000-2799.000=44.000
max2843.000-2799.000=44.000
mean8.414-8.703=-0.289
σ0.629-0.237=0.392
min7.568-8.422=-0.854
max9.124-9.066=0.057
iters=5
new-facts=6402
prior-facts=6402
mean4941.336-4941.336=-0.000
σ0.085-0.081=0.004
min4941.268-4941.271=-0.003
max4941.430-4941.427=0.003
mean3093.800-3048.000=45.800
σ252.406-226.000=26.406
min2843.000-2799.000=44.000
max3352.000-3325.000=27.000
mean8.656-8.593=0.063
σ0.256-0.123=0.133
min8.334-8.384=-0.050
max8.971-8.701=0.270

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.052-1.047=0.005
σ0.128-0.126=0.002
min0.936-0.935=0.001
max1.250-1.246=0.004

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.910-465.911=-0.001
σ575.755-575.758=-0.002
min178.030-178.026=0.004
max1329.544-1329.548=-0.004
mean81.750
σ7.500
min78.000
max93.000
mean2843.000-2799.000=44.000
σ0.000
min2843.000-2799.000=44.000
max2843.000-2799.000=44.000
mean0.440-0.443=-0.003
σ0.307-0.304=0.003
min0.284-0.289=-0.005
max0.900-0.899=0.002
policies=20
mean1780.497-1780.490=0.007
σ0.334-0.339=-0.005
min1780.248-1780.247=0.000
max1780.985-1780.985=0.001
mean780.000
σ0.000
min780.000
max780.000
mean2843.000-2799.000=44.000
σ0.000
min2843.000-2799.000=44.000
max2843.000-2799.000=44.000
mean2.831-2.852=-0.020
σ0.012-0.081=-0.069
min2.813-2.765=0.048
max2.841-2.961=-0.120
policies=200
mean17811.318-17811.218=0.100
σ0.456-0.403=0.053
min17810.990-17810.931=0.058
max17811.993-17811.811=0.182
mean7800.000
σ0.000
min7800.000
max7800.000
mean2843.000-2799.000=44.000
σ0.000
min2843.000-2799.000=44.000
max2843.000-2799.000=44.000
mean28.267-27.919=0.349
σ0.419-0.143=0.276
min27.774-27.772=0.001
max28.656-28.102=0.554