Compare commits

Home / Compare d8c864ce .. 2bc41483

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.001
σ0.048-0.050=-0.002
min33.955-33.953=0.001
max34.111-34.119=-0.008
mean412.000-418.000=-6.000
σ0.000
min412.000-418.000=-6.000
max412.000-418.000=-6.000
mean0.082-0.084=-0.002
σ0.005-0.003=0.003
min0.077-0.082=-0.006
max0.092-0.090=0.002
cache=y
dps=1
iters=10
policies=100
mean23.318-23.317=0.000
σ0.002-0.003=-0.001
min23.314-23.313=0.001
max23.321-23.322=-0.001
mean412.000-418.000=-6.000
σ0.000
min412.000-418.000=-6.000
max412.000-418.000=-6.000
mean0.065-0.066=-0.001
σ0.003-0.003=-0.001
min0.064-0.064=-0.000
max0.073-0.073=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.428-1757.303=0.125
σ0.364-0.364=-0.000
min1756.854-1756.730=0.124
max1758.016-1757.890=0.126
mean1648.300-1650.450=-2.150
σ612.222-624.285=-12.063
min677.000-640.000=37.000
max2630.000-2833.000=-203.000
mean2.367-2.352=0.015
σ0.093-0.091=0.002
min2.255-2.261=-0.006
max2.595-2.657=-0.061

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.575-326.451=0.124
σ0.043-0.048=-0.005
min326.503-326.366=0.137
max326.616-326.481=0.135
mean2630.000-2833.000=-203.000
σ0.000
min2630.000-2833.000=-203.000
max2630.000-2833.000=-203.000
mean0.424-0.424=0.001
σ0.007-0.002=0.005
min0.420-0.422=-0.002
max0.436-0.426=0.010
iters=5
new-facts=1
prior-facts=6402
mean1988.727-1988.619=0.108
σ0.018-0.009=0.009
min1988.707-1988.608=0.098
max1988.749-1988.633=0.116
mean2630.000-2833.000=-203.000
σ0.000
min2630.000-2833.000=-203.000
max2630.000-2833.000=-203.000
mean2.803-2.667=0.137
σ0.283-0.142=0.141
min2.632-2.498=0.134
max3.305-2.867=0.438
iters=5
new-facts=6402
prior-facts=1
mean4813.458-4813.346=0.112
σ7.778-7.792=-0.014
min4809.613-4809.488=0.125
max4827.367-4827.280=0.087
mean2630.000-2833.000=-203.000
σ0.000
min2630.000-2833.000=-203.000
max2630.000-2833.000=-203.000
mean8.985-8.836=0.149
σ0.192-0.409=-0.217
min8.674-8.254=0.421
max9.173-9.147=0.026
iters=5
new-facts=6402
prior-facts=6402
mean5001.146-5001.018=0.128
σ0.034-0.025=0.010
min5001.112-5000.990=0.121
max5001.200-5001.044=0.156
mean2989.800-3044.800=-55.000
σ275.427-206.408=69.019
min2630.000-2833.000=-203.000
max3317.000-3304.000=13.000
mean9.752-9.780=-0.028
σ0.388-0.171=0.217
min9.113-9.624=-0.512
max10.125-10.041=0.085

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.118-0.924=0.194
σ0.304-0.015=0.290
min0.913-0.913=0.001
max1.652-0.949=0.704

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.571-464.432=0.139
σ574.780-574.767=0.013
min177.172-177.044=0.128
max1326.741-1326.583=0.158
mean88.250
σ8.500
min84.000
max101.000
mean2630.000-2833.000=-203.000
σ0.000
min2630.000-2833.000=-203.000
max2630.000-2833.000=-203.000
mean0.556-0.437=0.120
σ0.568-0.306=0.262
min0.270-0.280=-0.011
max1.409-0.895=0.513
policies=20
mean1772.012-1770.763=1.249
σ0.353-0.352=0.001
min1771.785-1770.537=1.248
max1772.538-1771.286=1.252
mean840.000
σ0.000
min840.000
max840.000
mean2630.000-2833.000=-203.000
σ0.000
min2630.000-2833.000=-203.000
max2630.000-2833.000=-203.000
mean2.728-2.792=-0.064
σ0.018-0.005=0.013
min2.704-2.784=-0.080
max2.747-2.796=-0.050
policies=200
mean17727.390-17714.755=12.635
σ0.544-0.520=0.024
min17727.085-17714.402=12.683
max17728.205-17715.528=12.677
mean8400.000
σ0.000
min8400.000
max8400.000
mean2630.000-2833.000=-203.000
σ0.000
min2630.000-2833.000=-203.000
max2630.000-2833.000=-203.000
mean27.481-27.995=-0.514
σ0.093-0.430=-0.337
min27.390-27.626=-0.236
max27.577-28.511=-0.934