Compare commits

Home / Compare 6489b8ce .. 2ba9d2bd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.707-53.709=-0.002
σ0.363-0.365=-0.003
min53.571-53.569=0.002
max54.739-54.748=-0.009
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.138-0.140=-0.002
σ0.005-0.003=0.001
min0.131-0.136=-0.006
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean42.979-42.977=0.002
σ0.005-0.006=-0.000
min42.973-42.967=0.006
max42.990-42.985=0.005
mean414.000-416.800=-2.800
σ0.000-0.422=-0.422
min414.000-416.000=-2.000
max414.000-417.000=-3.000
mean0.119-0.120=-0.000
σ0.003-0.004=-0.001
min0.114-0.115=-0.000
max0.125-0.129=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.217-995.219=-0.003
σ1.209-1.187=0.022
min994.629-994.686=-0.057
max1000.273-1000.199=0.073
mean1052.050-1061.050=-9.000
σ303.527-311.310=-7.783
min628.000-614.000=14.000
max1516.000-1629.000=-113.000
mean1.480-1.482=-0.002
σ0.075-0.088=-0.013
min1.390-1.391=-0.001
max1.663-1.665=-0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.308-297.313=-0.005
σ0.034-0.014=0.020
min297.248-297.292=-0.044
max297.332-297.326=0.006
mean1516.000-1629.000=-113.000
σ0.000
min1516.000-1629.000=-113.000
max1516.000-1629.000=-113.000
mean0.403-0.393=0.009
σ0.012-0.009=0.003
min0.384-0.386=-0.003
max0.414-0.407=0.007
iters=5
new-facts=1
prior-facts=6402
mean1299.032-1299.014=0.017
σ0.064-0.097=-0.033
min1298.919-1298.841=0.078
max1299.072-1299.063=0.009
mean1516.000-1629.000=-113.000
σ0.000
min1516.000-1629.000=-113.000
max1516.000-1629.000=-113.000
mean2.051-2.017=0.034
σ0.284-0.141=0.144
min1.752-1.890=-0.138
max2.440-2.178=0.262
iters=5
new-facts=6402
prior-facts=1
mean1719.197-1719.181=0.016
σ6.920-6.896=0.024
min1716.007-1716.001=0.006
max1731.573-1731.513=0.060
mean1516.000-1629.000=-113.000
σ0.000
min1516.000-1629.000=-113.000
max1516.000-1629.000=-113.000
mean2.980-3.027=-0.048
σ0.257-0.226=0.031
min2.760-2.789=-0.028
max3.414-3.329=0.085
iters=5
new-facts=6402
prior-facts=6402
mean1981.930-1981.935=-0.005
σ0.034-0.051=-0.016
min1981.871-1981.861=0.010
max1981.957-1982.001=-0.044
mean1800.000-1807.600=-7.600
σ233.327-190.227=43.100
min1536.000-1629.000=-93.000
max2130.000-2082.000=48.000
mean3.300-3.351=-0.051
σ0.413-0.392=0.020
min2.950-3.090=-0.140
max4.011-4.042=-0.032

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.466-1.208=0.257
σ0.239-0.299=-0.060
min1.195-0.915=0.281
max1.739-1.697=0.042

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.448-440.456=-0.007
σ573.024-573.040=-0.016
min153.931-153.933=-0.002
max1299.984-1300.016=-0.032
mean94.250
σ8.500
min90.000
max107.000
mean1516.000-1629.000=-113.000
σ0.000
min1516.000-1629.000=-113.000
max1516.000-1629.000=-113.000
mean0.535-0.520=0.015
σ0.559-0.524=0.035
min0.255-0.256=-0.001
max1.373-1.307=0.067
policies=20
mean1539.608-1539.583=0.025
σ0.308-0.313=-0.005
min1539.396-1539.384=0.012
max1540.064-1540.049=0.016
mean900.000
σ0.000
min900.000
max900.000
mean1516.000-1629.000=-113.000
σ0.000
min1516.000-1629.000=-113.000
max1516.000-1629.000=-113.000
mean2.567-2.581=-0.014
σ0.011-0.025=-0.014
min2.554-2.553=0.001
max2.579-2.605=-0.027
policies=200
mean15404.038-15403.773=0.265
σ0.119-0.041=0.078
min15403.879-15403.732=0.146
max15404.164-15403.826=0.338
mean9000.000
σ0.000
min9000.000
max9000.000
mean1516.000-1629.000=-113.000
σ0.000
min1516.000-1629.000=-113.000
max1516.000-1629.000=-113.000
mean26.007-25.913=0.094
σ0.151-0.106=0.045
min25.841-25.783=0.059
max26.195-26.016=0.180