Compare commits

Home / Compare c1243883 .. a9b4c3a7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.565-70.562=0.003
σ0.050-0.044=0.006
min70.539-70.542=-0.004
max70.707-70.686=0.020
mean414.000
σ0.000
min414.000
max414.000
mean0.160-0.161=-0.001
σ0.004-0.003=0.001
min0.153-0.156=-0.003
max0.166-0.166=0.001
cache=y
dps=1
iters=10
policies=100
mean21.292-21.288=0.004
σ0.012-0.002=0.010
min21.283-21.284=-0.001
max21.325-21.291=0.035
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.064-0.064=-0.001
σ0.002-0.003=-0.000
min0.060-0.060=-0.000
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.571-1753.568=0.003
σ0.362-0.361=0.001
min1752.997-1753.005=-0.009
max1754.149-1754.154=-0.005
mean1640.900-1653.100=-12.200
σ600.952-619.050=-18.097
min643.000-689.000=-46.000
max2424.000-2653.000=-229.000
mean2.782-2.796=-0.014
σ0.209-0.179=0.030
min2.273-2.439=-0.165
max3.096-3.120=-0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.012-271.990=0.022
σ0.009-0.006=0.003
min271.998-271.981=0.017
max272.021-271.996=0.025
mean2424.000-2653.000=-229.000
σ0.000
min2424.000-2653.000=-229.000
max2424.000-2653.000=-229.000
mean0.386-0.394=-0.007
σ0.010-0.001=0.009
min0.377-0.392=-0.016
max0.400-0.395=0.005
iters=5
new-facts=1
prior-facts=6402
mean1932.439-1932.436=0.004
σ0.004-0.005=-0.001
min1932.433-1932.429=0.004
max1932.445-1932.443=0.001
mean2424.000-2653.000=-229.000
σ0.000
min2424.000-2653.000=-229.000
max2424.000-2653.000=-229.000
mean3.010-3.054=-0.044
σ0.058-0.140=-0.082
min2.950-2.935=0.014
max3.102-3.283=-0.181
iters=5
new-facts=6402
prior-facts=1
mean4752.924-4753.031=-0.107
σ0.719-0.980=-0.260
min4752.152-4752.273=-0.121
max4754.090-4754.750=-0.660
mean2424.000-2653.000=-229.000
σ0.000
min2424.000-2653.000=-229.000
max2424.000-2653.000=-229.000
mean8.765-8.650=0.115
σ0.418-0.389=0.029
min8.459-8.052=0.408
max9.454-9.092=0.362
iters=5
new-facts=6402
prior-facts=6402
mean4943.487-4943.631=-0.144
σ0.187-0.023=0.163
min4943.273-4943.611=-0.338
max4943.637-4943.659=-0.021
mean2994.000-3002.800=-8.800
σ285.159-273.441=11.717
min2611.000-2653.000=-42.000
max3332.000-3345.000=-13.000
mean8.624-8.537=0.087
σ0.239-0.110=0.129
min8.398-8.400=-0.003
max9.028-8.651=0.378

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.825-1.134=0.691
σ0.092-0.219=-0.127
min1.738-0.937=0.801
max1.978-1.415=0.562

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.068-473.080=-0.013
σ575.911-575.920=-0.009
min185.106-185.108=-0.002
max1336.934-1336.961=-0.027
mean88.250
σ8.500
min84.000
max101.000
mean2424.000-2653.000=-229.000
σ0.000
min2424.000-2653.000=-229.000
max2424.000-2653.000=-229.000
mean0.551-0.549=0.002
σ0.526-0.526=-0.000
min0.284-0.282=0.003
max1.340-1.338=0.002
policies=20
mean1851.399-1851.423=-0.023
σ0.387-0.373=0.013
min1851.127-1851.162=-0.036
max1851.967-1851.973=-0.007
mean840.000
σ0.000
min840.000
max840.000
mean2424.000-2653.000=-229.000
σ0.000
min2424.000-2653.000=-229.000
max2424.000-2653.000=-229.000
mean2.875-2.862=0.013
σ0.026-0.025=0.001
min2.847-2.834=0.013
max2.909-2.893=0.016
policies=200
mean18521.036-18521.023=0.013
σ0.474-0.471=0.003
min18520.685-18520.739=-0.054
max18521.731-18521.727=0.005
mean8400.000
σ0.000
min8400.000
max8400.000
mean2424.000-2653.000=-229.000
σ0.000
min2424.000-2653.000=-229.000
max2424.000-2653.000=-229.000
mean28.779-28.744=0.035
σ0.104-0.109=-0.005
min28.665-28.595=0.070
max28.908-28.846=0.062