Compare commits

Home / Compare e3f21fee .. d53ae352

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.966=0.007
σ0.107-0.103=0.003
min35.922-35.922=0.000
max36.276-36.259=0.017
mean411.000-416.000=-5.000
σ0.000
min411.000-416.000=-5.000
max411.000-416.000=-5.000
mean0.077-0.077=-0.000
σ0.004-0.003=0.001
min0.072-0.074=-0.002
max0.085-0.084=0.000
cache=y
dps=1
iters=10
policies=100
mean26.208-26.208=0.000
σ0.003-0.005=-0.002
min26.204-26.201=0.003
max26.212-26.215=-0.003
mean411.000-416.000=-5.000
σ0.000
min411.000-416.000=-5.000
max411.000-416.000=-5.000
mean0.060-0.060=0.001
σ0.003-0.003=0.001
min0.057-0.057=-0.001
max0.068-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.379-1756.307=2.072
σ0.371-0.368=0.004
min1757.803-1755.731=2.072
max1758.979-1756.898=2.080
mean1630.700-1662.850=-32.150
σ621.710-635.230=-13.520
min637.000-614.000=23.000
max2815.000-2740.000=75.000
mean2.377-2.377=0.000
σ0.115-0.147=-0.032
min2.283-2.076=0.207
max2.782-2.820=-0.038

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.542-278.820=0.721
σ0.010-0.008=0.002
min279.532-278.807=0.725
max279.555-278.827=0.728
mean2815.000-2740.000=75.000
σ0.000
min2815.000-2740.000=75.000
max2815.000-2740.000=75.000
mean0.414-0.412=0.003
σ0.008-0.005=0.003
min0.408-0.408=-0.001
max0.425-0.421=0.004
iters=5
new-facts=1
prior-facts=6402
mean2178.455-2268.877=-90.422
σ0.032-0.016=0.015
min2178.416-2268.848=-90.432
max2178.493-2268.889=-90.396
mean2815.000-2740.000=75.000
σ0.000
min2815.000-2740.000=75.000
max2815.000-2740.000=75.000
mean3.341-3.012=0.329
σ0.069-0.204=-0.135
min3.258-2.904=0.354
max3.426-3.376=0.050
iters=5
new-facts=6402
prior-facts=1
mean5056.404-4954.228=102.176
σ0.993-0.817=0.175
min5055.795-4953.717=102.078
max5058.170-4955.675=102.495
mean2815.000-2740.000=75.000
σ0.000
min2815.000-2740.000=75.000
max2815.000-2740.000=75.000
mean8.918-8.038=0.881
σ0.615-0.246=0.369
min8.233-7.752=0.481
max9.684-8.417=1.267
iters=5
new-facts=6402
prior-facts=6402
mean5193.549-5168.731=24.818
σ0.364-0.204=0.161
min5192.944-5168.387=24.557
max5193.881-5168.887=24.994
mean3296.400-3362.400=-66.000
σ440.858-464.339=-23.481
min2815.000-2743.000=72.000
max3921.000-3975.000=-54.000
mean8.898-9.454=-0.557
σ0.055-0.488=-0.434
min8.849-9.054=-0.205
max8.982-10.131=-1.149

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.999-1.028=-0.029
σ0.068-0.145=-0.077
min0.944-0.936=0.008
max1.079-1.269=-0.190

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.557-460.358=5.199
σ572.658-572.652=0.006
min179.221-174.023=5.198
max1324.544-1319.336=5.208
mean79.500
σ7.000
min76.000
max90.000
mean2815.000-2740.000=75.000
σ0.000
min2815.000-2740.000=75.000
max2815.000-2740.000=75.000
mean0.449-0.527=-0.079
σ0.307-0.516=-0.208
min0.294-0.264=0.030
max0.910-1.301=-0.391
policies=20
mean1792.468-1740.454=52.014
σ0.343-0.323=0.020
min1792.233-1740.242=51.991
max1792.971-1740.936=52.035
mean760.000
σ0.000
min760.000
max760.000
mean2815.000-2740.000=75.000
σ0.000
min2815.000-2740.000=75.000
max2815.000-2740.000=75.000
mean2.910-2.693=0.216
σ0.005-0.007=-0.002
min2.903-2.684=0.218
max2.913-2.700=0.213
policies=200
mean17929.927-17411.384=518.543
σ0.727-0.584=0.143
min17929.297-17411.045=518.252
max17930.751-17412.258=518.493
mean7600.000
σ0.000
min7600.000
max7600.000
mean2815.000-2740.000=75.000
σ0.000
min2815.000-2740.000=75.000
max2815.000-2740.000=75.000
mean28.713-27.050=1.663
σ0.471-0.059=0.412
min28.268-26.993=1.275
max29.371-27.111=2.259