Compare commits

Home / Compare de08c347 .. 88977c27

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-30.769=0.271
σ0.049-0.046=0.003
min31.002-30.736=0.265
max31.176-30.898=0.278
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.073-0.073=0.001
σ0.004-0.004=-0.000
min0.070-0.069=0.002
max0.081-0.078=0.003
cache=y
dps=1
iters=10
policies=100
mean21.144-21.060=0.084
σ0.003-0.003=-0.000
min21.141-21.054=0.087
max21.148-21.065=0.083
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.066-0.063=0.003
σ0.003-0.002=0.001
min0.063-0.062=0.002
max0.072-0.069=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.422=-0.010
σ0.360-0.362=-0.001
min1750.853-1750.845=0.008
max1751.976-1752.002=-0.027
mean1660.600-1651.600=9.000
σ621.270-624.599=-3.330
min639.000-692.000=-53.000
max2505.000-2812.000=-307.000
mean2.831-2.808=0.023
σ0.191-0.157=0.035
min2.293-2.345=-0.051
max3.210-3.039=0.172

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.397-275.759=-2.362
σ0.018-0.009=0.009
min273.367-275.746=-2.379
max273.412-275.768=-2.355
mean2505.000-2812.000=-307.000
σ0.000
min2505.000-2812.000=-307.000
max2505.000-2812.000=-307.000
mean0.384-0.406=-0.021
σ0.009-0.011=-0.002
min0.377-0.396=-0.020
max0.394-0.419=-0.025
iters=5
new-facts=1
prior-facts=6402
mean1933.834-2168.275=-234.441
σ0.004-0.014=-0.010
min1933.831-2168.251=-234.420
max1933.841-2168.286=-234.445
mean2505.000-2812.000=-307.000
σ0.000
min2505.000-2812.000=-307.000
max2505.000-2812.000=-307.000
mean3.030-2.999=0.031
σ0.109-0.167=-0.058
min2.876-2.791=0.084
max3.165-3.128=0.037
iters=5
new-facts=6402
prior-facts=1
mean4754.292-5048.142=-293.850
σ0.879-0.912=-0.032
min4753.614-5047.552=-293.939
max4755.835-5049.758=-293.923
mean2505.000-2812.000=-307.000
σ0.000
min2505.000-2812.000=-307.000
max2505.000-2812.000=-307.000
mean8.069-8.834=-0.765
σ0.382-0.680=-0.298
min7.740-8.060=-0.320
max8.707-9.756=-1.049
iters=5
new-facts=6402
prior-facts=6402
mean4944.727-5179.022=-234.295
σ0.199-0.336=-0.138
min4944.391-5178.463=-234.071
max4944.876-5179.294=-234.418
mean2962.200-3245.400=-283.200
σ412.198-349.437=62.761
min2505.000-2812.000=-307.000
max3523.000-3724.000=-201.000
mean8.625-9.681=-1.056
σ0.461-0.675=-0.214
min8.393-8.660=-0.267
max9.449-10.395=-0.946

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.732-1.110=0.622
σ0.066-0.151=-0.085
min1.639-0.949=0.690
max1.801-1.361=0.440

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.333-463.578=-0.245
σ572.193-572.659=-0.465
min177.235-177.239=-0.005
max1321.623-1322.566=-0.943
mean79.750
σ7.500
min76.000
max91.000
mean2505.000-2812.000=-307.000
σ0.000
min2505.000-2812.000=-307.000
max2505.000-2812.000=-307.000
mean0.540-0.438=0.101
σ0.519-0.308=0.211
min0.272-0.282=-0.010
max1.319-0.901=0.418
policies=20
mean1772.587-1772.679=-0.092
σ0.337-0.324=0.013
min1772.366-1772.427=-0.061
max1773.087-1773.149=-0.062
mean760.000
σ0.000
min760.000
max760.000
mean2505.000-2812.000=-307.000
σ0.000
min2505.000-2812.000=-307.000
max2505.000-2812.000=-307.000
mean2.741-2.846=-0.106
σ0.001-0.100=-0.099
min2.739-2.738=0.001
max2.742-2.981=-0.239
policies=200
mean17732.364-17733.015=-0.652
σ0.596-0.463=0.133
min17731.993-17732.707=-0.713
max17733.247-17733.705=-0.458
mean7600.000
σ0.000
min7600.000
max7600.000
mean2505.000-2812.000=-307.000
σ0.000
min2505.000-2812.000=-307.000
max2505.000-2812.000=-307.000
mean27.666-27.741=-0.076
σ0.154-0.148=0.006
min27.521-27.606=-0.084
max27.878-27.947=-0.069