Compare commits

Home / Compare eb163c64 .. 15078f97

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.768-30.769=-0.002
σ0.050-0.050=0.000
min30.728-30.727=0.001
max30.905-30.905=-0.000
mean414.000
σ0.000
min414.000
max414.000
mean0.075-0.075=0.000
σ0.005-0.005=0.000
min0.070-0.071=-0.001
max0.084-0.085=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=0.000
σ0.002-0.002=-0.000
min21.057-21.057=-0.000
max21.064-21.063=0.000
mean414.000
σ0.000
min414.000
max414.000
mean0.062-0.061=0.001
σ0.003-0.005=-0.001
min0.058-0.053=0.006
max0.069-0.070=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.419-1751.419=0.000
σ0.362-0.363=-0.000
min1750.850-1750.850=0.001
max1751.998-1752.001=-0.003
mean1659.650-1650.900=8.750
σ635.840-624.939=10.901
min680.000
max2694.000-2647.000=47.000
mean2.763-2.805=-0.042
σ0.222-0.159=0.063
min2.287-2.383=-0.097
max3.029-3.051=-0.023

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.758-275.756=0.002
σ0.009-0.010=-0.001
min275.748-275.742=0.006
max275.771-275.767=0.004
mean2694.000-2647.000=47.000
σ0.000
min2694.000-2647.000=47.000
max2694.000-2647.000=47.000
mean0.404-0.401=0.003
σ0.010-0.008=0.001
min0.395-0.394=0.001
max0.417-0.413=0.004
iters=5
new-facts=1
prior-facts=6402
mean2168.273-2168.266=0.007
σ0.023-0.023=0.000
min2168.246-2168.228=0.017
max2168.298-2168.287=0.011
mean2694.000-2647.000=47.000
σ0.000
min2694.000-2647.000=47.000
max2694.000-2647.000=47.000
mean2.975-2.809=0.166
σ0.187-0.124=0.064
min2.686-2.746=-0.060
max3.161-3.029=0.132
iters=5
new-facts=6402
prior-facts=1
mean5047.879-5048.104=-0.225
σ0.812-0.899=-0.087
min5046.988-5047.628=-0.640
max5049.210-5049.710=-0.500
mean2694.000-2647.000=47.000
σ0.000
min2694.000-2647.000=47.000
max2694.000-2647.000=47.000
mean8.950-8.741=0.209
σ0.517-0.209=0.308
min8.196-8.418=-0.223
max9.425-8.943=0.482
iters=5
new-facts=6402
prior-facts=6402
mean5179.096-5179.156=-0.060
σ0.201-0.201=-0.001
min5178.815-5178.822=-0.007
max5179.326-5179.315=0.011
mean3275.200-3247.400=27.800
σ381.687-471.757=-90.070
min2736.000-2647.000=89.000
max3734.000-3873.000=-139.000
mean9.930-9.863=0.067
σ0.172-0.197=-0.024
min9.671-9.675=-0.004
max10.072-10.145=-0.072

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.088-1.185=-0.097
σ0.146-0.246=-0.100
min0.948-0.948=0.000
max1.262-1.575=-0.313

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.574-463.570=0.004
σ572.661-572.662=-0.001
min177.240-177.235=0.005
max1322.566-1322.563=0.004
mean79.750
σ7.500
min76.000
max91.000
mean2694.000-2647.000=47.000
σ0.000
min2694.000-2647.000=47.000
max2694.000-2647.000=47.000
mean0.549-0.544=0.005
σ0.532-0.538=-0.005
min0.271-0.273=-0.002
max1.347-1.350=-0.003
policies=20
mean1772.647-1772.616=0.030
σ0.328-0.330=-0.002
min1772.419-1772.404=0.015
max1773.133-1773.107=0.026
mean760.000
σ0.000
min760.000
max760.000
mean2694.000-2647.000=47.000
σ0.000
min2694.000-2647.000=47.000
max2694.000-2647.000=47.000
mean2.731-2.744=-0.012
σ0.023-0.018=0.005
min2.698-2.727=-0.029
max2.748-2.768=-0.020
policies=200
mean17733.054-17732.975=0.079
σ0.497-0.507=-0.010
min17732.781-17732.551=0.231
max17733.798-17733.710=0.088
mean7600.000
σ0.000
min7600.000
max7600.000
mean2694.000-2647.000=47.000
σ0.000
min2694.000-2647.000=47.000
max2694.000-2647.000=47.000
mean27.761-27.701=0.060
σ0.167-0.131=0.037
min27.615-27.574=0.041
max27.970-27.845=0.125