Compare commits

Home / Compare 13dad254 .. 6f880d36

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.980=-0.002
σ0.047-0.047=-0.000
min33.952-33.951=0.001
max34.107-34.109=-0.003
mean412.700-410.000=2.700
σ0.483-0.000=0.483
min412.000-410.000=2.000
max413.000-410.000=3.000
mean0.084-0.085=-0.000
σ0.003-0.003=0.000
min0.082-0.083=-0.001
max0.092-0.091=0.000
cache=y
dps=1
iters=10
policies=100
mean23.316-23.318=-0.001
σ0.003-0.002=0.000
min23.311-23.314=-0.003
max23.321-23.321=-0.000
mean413.000-410.000=3.000
σ0.000
min413.000-410.000=3.000
max413.000-410.000=3.000
mean0.064-0.064=0.000
σ0.003-0.003=-0.000
min0.061-0.061=-0.000
max0.071-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.493-1757.493=-0.000
σ0.365-0.365=-0.001
min1756.920-1756.918=0.003
max1758.082-1758.082=0.000
mean1662.000-1646.100=15.900
σ622.320-625.182=-2.862
min667.000-671.000=-4.000
max2598.000-2587.000=11.000
mean2.383-2.376=0.007
σ0.171-0.113=0.058
min2.253-2.245=0.007
max2.958-2.613=0.345

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.646-326.635=0.011
σ0.030-0.051=-0.021
min326.596-326.546=0.050
max326.675-326.676=-0.001
mean2598.000-2587.000=11.000
σ0.000
min2598.000-2587.000=11.000
max2598.000-2587.000=11.000
mean0.428-0.424=0.004
σ0.004-0.001=0.003
min0.423-0.423=0.000
max0.435-0.426=0.009
iters=5
new-facts=1
prior-facts=6402
mean1988.797-1988.795=0.002
σ0.014-0.016=-0.002
min1988.781-1988.779=0.002
max1988.813-1988.812=0.001
mean2598.000-2587.000=11.000
σ0.000
min2598.000-2587.000=11.000
max2598.000-2587.000=11.000
mean2.653-2.663=-0.010
σ0.186-0.104=0.082
min2.389-2.567=-0.177
max2.896-2.837=0.059
iters=5
new-facts=6402
prior-facts=1
mean4813.365-4813.531=-0.166
σ7.937-7.788=0.149
min4809.531-4809.716=-0.185
max4827.552-4827.458=0.094
mean2598.000-2587.000=11.000
σ0.000
min2598.000-2587.000=11.000
max2598.000-2587.000=11.000
mean8.782-8.802=-0.021
σ0.747-0.531=0.216
min7.752-7.979=-0.227
max9.522-9.228=0.295
iters=5
new-facts=6402
prior-facts=6402
mean5001.123-5001.061=0.062
σ0.153-0.183=-0.030
min5000.852-5000.857=-0.005
max5001.220-5001.205=0.016
mean2927.000-2943.400=-16.400
σ347.353-270.675=76.678
min2598.000-2587.000=11.000
max3434.000-3297.000=137.000
mean9.444-9.636=-0.192
σ0.576-0.565=0.011
min8.509-8.634=-0.125
max9.870-9.980=-0.110

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.220-1.190=0.030
σ0.358-0.258=0.100
min0.942-0.952=-0.010
max1.834-1.593=0.241

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.633-464.632=0.001
σ574.780-574.777=0.003
min177.240-177.237=0.003
max1326.803-1326.798=0.005
mean88.250
σ8.500
min84.000
max101.000
mean2598.000-2587.000=11.000
σ0.000
min2598.000-2587.000=11.000
max2598.000-2587.000=11.000
mean0.542-0.554=-0.012
σ0.530-0.556=-0.025
min0.274-0.274=0.000
max1.338-1.388=-0.050
policies=20
mean1772.689-1772.661=0.027
σ0.354-0.342=0.012
min1772.453-1772.427=0.026
max1773.215-1773.169=0.047
mean840.000
σ0.000
min840.000
max840.000
mean2598.000-2587.000=11.000
σ0.000
min2598.000-2587.000=11.000
max2598.000-2587.000=11.000
mean2.739-2.734=0.005
σ0.036-0.018=0.018
min2.703-2.720=-0.017
max2.783-2.760=0.023
policies=200
mean17733.967-17733.818=0.148
σ0.563-0.612=-0.049
min17733.636-17733.401=0.235
max17734.804-17734.724=0.080
mean8400.000
σ0.000
min8400.000
max8400.000
mean2598.000-2587.000=11.000
σ0.000
min2598.000-2587.000=11.000
max2598.000-2587.000=11.000
mean27.459-27.580=-0.121
σ0.150-0.185=-0.034
min27.249-27.373=-0.124
max27.570-27.778=-0.209