Compare commits

Home / Compare faf4a3bb .. 12f3036c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-30.958=0.082
σ0.049-0.049=0.000
min31.002-30.923=0.079
max31.176-31.093=0.083
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.073-0.077=-0.003
σ0.004-0.003=0.000
min0.070-0.071=-0.000
max0.081-0.084=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.144-21.059=0.084
σ0.003-0.002=0.000
min21.141-21.055=0.086
max21.148-21.063=0.085
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.066-0.060=0.005
σ0.003-0.003=0.001
min0.063-0.057=0.006
max0.072-0.065=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.412=-0.000
σ0.360-0.361=-0.001
min1750.853-1750.844=0.009
max1751.976-1751.997=-0.021
mean1660.600-1663.750=-3.150
σ621.270-623.955=-2.685
min639.000-661.000=-22.000
max2505.000-2510.000=-5.000
mean2.831-2.851=-0.020
σ0.191-0.107=0.084
min2.293-2.578=-0.285
max3.210-3.032=0.179

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.397-273.404=-0.007
σ0.018-0.010=0.008
min273.367-273.395=-0.028
max273.412-273.414=-0.002
mean2505.000-2510.000=-5.000
σ0.000
min2505.000-2510.000=-5.000
max2505.000-2510.000=-5.000
mean0.384-0.387=-0.003
σ0.009-0.008=0.000
min0.377-0.378=-0.001
max0.394-0.395=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.834-1933.839=-0.004
σ0.004-0.008=-0.004
min1933.831-1933.828=0.003
max1933.841-1933.848=-0.007
mean2505.000-2510.000=-5.000
σ0.000
min2505.000-2510.000=-5.000
max2505.000-2510.000=-5.000
mean3.030-3.186=-0.156
σ0.109-0.161=-0.052
min2.876-3.028=-0.152
max3.165-3.386=-0.221
iters=5
new-facts=6402
prior-facts=1
mean4754.292-4754.222=0.069
σ0.879-0.953=-0.074
min4753.614-4753.461=0.152
max4755.835-4755.888=-0.053
mean2505.000-2510.000=-5.000
σ0.000
min2505.000-2510.000=-5.000
max2505.000-2510.000=-5.000
mean8.069-8.508=-0.440
σ0.382-0.631=-0.249
min7.740-7.637=0.104
max8.707-9.050=-0.343
iters=5
new-facts=6402
prior-facts=6402
mean4944.727-4944.790=-0.063
σ0.199-0.081=0.117
min4944.391-4944.724=-0.333
max4944.876-4944.879=-0.002
mean2962.200-2969.000=-6.800
σ412.198-430.705=-18.507
min2505.000-2510.000=-5.000
max3523.000-3557.000=-34.000
mean8.625-8.456=0.168
σ0.461-0.120=0.341
min8.393-8.362=0.031
max9.449-8.664=0.785

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.732-1.646=0.086
σ0.066-0.154=-0.088
min1.639-1.400=0.239
max1.801-1.819=-0.019

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.333-463.336=-0.003
σ572.193-572.196=-0.003
min177.235-177.234=0.001
max1321.623-1321.630=-0.007
mean79.750
σ7.500
min76.000
max91.000
mean2505.000-2510.000=-5.000
σ0.000
min2505.000-2510.000=-5.000
max2505.000-2510.000=-5.000
mean0.540-0.559=-0.020
σ0.519-0.552=-0.032
min0.272-0.279=-0.008
max1.319-1.387=-0.069
policies=20
mean1772.587-1772.587=-0.000
σ0.337-0.335=0.002
min1772.366-1772.366=-0.000
max1773.087-1773.084=0.003
mean760.000
σ0.000
min760.000
max760.000
mean2505.000-2510.000=-5.000
σ0.000
min2505.000-2510.000=-5.000
max2505.000-2510.000=-5.000
mean2.741-2.744=-0.003
σ0.001-0.021=-0.020
min2.739-2.726=0.014
max2.742-2.769=-0.027
policies=200
mean17732.364-17732.369=-0.005
σ0.596-0.578=0.018
min17731.993-17732.008=-0.015
max17733.247-17733.230=0.017
mean7600.000
σ0.000
min7600.000
max7600.000
mean2505.000-2510.000=-5.000
σ0.000
min2505.000-2510.000=-5.000
max2505.000-2510.000=-5.000
mean27.666-27.677=-0.012
σ0.154-0.071=0.083
min27.521-27.622=-0.100
max27.878-27.778=0.101