Compare commits

Home / Compare fe38f9e9 .. ab3ae8ec

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.647-53.915=-0.268
σ0.367-0.367=-0.000
min53.510-53.786=-0.276
max54.691-54.959=-0.269
mean416.000-416.800=-0.800
σ0.000-0.422=-0.422
min416.000
max416.000-417.000=-1.000
mean0.139-0.139=-0.000
σ0.003-0.004=-0.001
min0.135-0.134=0.001
max0.144-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean42.942-43.141=-0.198
σ0.009-0.006=0.003
min42.926-43.135=-0.209
max42.954-43.152=-0.198
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.121-0.120=0.000
σ0.004-0.003=0.000
min0.118-0.116=0.001
max0.127-0.127=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.860-991.815=0.045
σ1.211-1.244=-0.033
min991.331-991.234=0.098
max996.938-997.045=-0.107
mean1069.950-1068.950=1.000
σ319.470-312.208=7.262
min606.000-618.000=-12.000
max1647.000-1643.000=4.000
mean1.500-1.522=-0.022
σ0.072-0.072=-0.000
min1.428-1.461=-0.034
max1.730-1.785=-0.055

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.435-285.411=0.025
σ0.007-0.009=-0.002
min285.424-285.395=0.028
max285.442-285.418=0.023
mean1647.000-1643.000=4.000
σ0.000
min1647.000-1643.000=4.000
max1647.000-1643.000=4.000
mean0.377-0.380=-0.003
σ0.007-0.008=-0.001
min0.373-0.373=-0.000
max0.389-0.389=0.000
iters=5
new-facts=1
prior-facts=6402
mean1285.524-1285.376=0.148
σ0.076-0.128=-0.052
min1285.388-1285.317=0.072
max1285.566-1285.605=-0.039
mean1647.000-1643.000=4.000
σ0.000
min1647.000-1643.000=4.000
max1647.000-1643.000=4.000
mean2.045-2.097=-0.052
σ0.248-0.252=-0.004
min1.813-1.831=-0.018
max2.435-2.459=-0.024
iters=5
new-facts=6402
prior-facts=1
mean1705.822-1807.731=-101.910
σ6.846-7.002=-0.156
min1702.625-1804.372=-101.748
max1718.064-1820.241=-102.178
mean1647.000-1643.000=4.000
σ0.000
min1647.000-1643.000=4.000
max1647.000-1643.000=4.000
mean3.082-4.241=-1.158
σ0.252-0.176=0.075
min2.741-4.019=-1.277
max3.327-4.429=-1.102
iters=5
new-facts=6402
prior-facts=6402
mean1968.418-2070.197=-101.779
σ0.026-0.013=0.013
min1968.372-2070.184=-101.812
max1968.436-2070.217=-101.781
mean1800.200-1859.400=-59.200
σ159.089-195.592=-36.504
min1647.000-1643.000=4.000
max2021.000-2093.000=-72.000
mean3.346-4.498=-1.152
σ0.393-0.077=0.316
min3.067-4.415=-1.347
max4.039-4.598=-0.560

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.181-1.136=0.045
σ0.232-0.263=-0.031
min0.913-0.901=0.012
max1.512-1.541=-0.030

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.774-436.779=-0.005
σ572.364-572.348=0.016
min150.590-150.600=-0.011
max1295.321-1295.301=0.020
mean90.250
σ8.500
min86.000
max103.000
mean1647.000-1643.000=4.000
σ0.000
min1647.000-1643.000=4.000
max1647.000-1643.000=4.000
mean0.528-0.526=0.002
σ0.557-0.553=0.004
min0.246-0.249=-0.003
max1.363-1.356=0.007
policies=20
mean1506.180-1506.258=-0.078
σ0.231-0.236=-0.006
min1506.033-1506.109=-0.077
max1506.524-1506.611=-0.087
mean860.000
σ0.000
min860.000
max860.000
mean1647.000-1643.000=4.000
σ0.000
min1647.000-1643.000=4.000
max1647.000-1643.000=4.000
mean2.505-2.514=-0.009
σ0.014-0.011=0.003
min2.488-2.503=-0.015
max2.521-2.529=-0.008
policies=200
mean15069.517-15070.327=-0.811
σ0.047-0.112=-0.065
min15069.465-15070.209=-0.744
max15069.579-15070.446=-0.867
mean8600.000
σ0.000
min8600.000
max8600.000
mean1647.000-1643.000=4.000
σ0.000
min1647.000-1643.000=4.000
max1647.000-1643.000=4.000
mean25.339-25.500=-0.161
σ0.137-0.174=-0.037
min25.161-25.348=-0.188
max25.465-25.672=-0.206