Compare commits

Home / Compare 872258ea .. 895e7e19

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.732=0.050
σ0.047-0.051=-0.003
min70.752-70.704=0.048
max70.912-70.873=0.039
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.159-0.163=-0.004
σ0.004-0.005=-0.001
min0.153-0.156=-0.003
max0.164-0.172=-0.008
cache=y
dps=1
iters=10
policies=100
mean21.492-21.445=0.048
σ0.003-0.002=0.000
min21.488-21.441=0.047
max21.496-21.448=0.048
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.065-0.063=0.002
σ0.003-0.004=-0.001
min0.063-0.059=0.004
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1755.288=-1.194
σ0.361-0.361=-0.001
min1753.529-1754.713=-1.184
max1754.674-1755.868=-1.194
mean1659.000-1647.150=11.850
σ624.168-632.756=-8.588
min683.000-640.000=43.000
max2748.000-2842.000=-94.000
mean2.829-2.803=0.026
σ0.142-0.194=-0.051
min2.443-2.266=0.176
max2.996-3.112=-0.116

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.957-272.767=-0.809
σ0.005-0.008=-0.003
min271.952-272.758=-0.805
max271.964-272.779=-0.814
mean2748.000-2842.000=-94.000
σ0.000
min2748.000-2842.000=-94.000
max2748.000-2842.000=-94.000
mean0.384-0.385=-0.001
σ0.008-0.006=0.001
min0.380-0.379=0.001
max0.398-0.393=0.005
iters=5
new-facts=1
prior-facts=6402
mean1932.318-1933.149=-0.832
σ0.006-0.017=-0.011
min1932.309-1933.123=-0.814
max1932.324-1933.168=-0.844
mean2748.000-2842.000=-94.000
σ0.000
min2748.000-2842.000=-94.000
max2748.000-2842.000=-94.000
mean3.045-2.988=0.057
σ0.074-0.108=-0.033
min2.961-2.826=0.135
max3.148-3.122=0.026
iters=5
new-facts=6402
prior-facts=1
mean4752.976-4753.791=-0.816
σ1.018-0.593=0.426
min4752.028-4753.465=-1.438
max4754.706-4754.847=-0.140
mean2748.000-2842.000=-94.000
σ0.000
min2748.000-2842.000=-94.000
max2748.000-2842.000=-94.000
mean8.638-8.468=0.170
σ0.460-0.395=0.065
min7.887-7.848=0.039
max9.015-8.875=0.139
iters=5
new-facts=6402
prior-facts=6402
mean4943.558-4944.384=-0.827
σ0.015-0.015=-0.001
min4943.541-4944.369=-0.827
max4943.574-4944.402=-0.828
mean2989.600-3018.600=-29.000
σ221.785-253.737=-31.951
min2748.000-2842.000=-94.000
max3312.000-3431.000=-119.000
mean8.520-8.405=0.116
σ0.087-0.046=0.041
min8.433-8.358=0.074
max8.641-8.478=0.163

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.999-1.026=-0.027
σ0.141-0.135=0.006
min0.935-0.935=-0.001
max1.251-1.247=0.004

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.649-472.845=-4.196
σ574.912-574.897=0.016
min181.182-185.386=-4.204
max1331.018-1335.190=-4.172
mean88.250
σ8.500
min84.000
max101.000
mean2748.000-2842.000=-94.000
σ0.000
min2748.000-2842.000=-94.000
max2748.000-2842.000=-94.000
mean0.569-0.451=0.118
σ0.546-0.304=0.242
min0.288-0.292=-0.004
max1.388-0.906=0.482
policies=20
mean1812.189-1854.179=-41.990
σ0.394-0.365=0.029
min1811.921-1853.910=-41.989
max1812.771-1854.713=-41.942
mean840.000
σ0.000
min840.000
max840.000
mean2748.000-2842.000=-94.000
σ0.000
min2748.000-2842.000=-94.000
max2748.000-2842.000=-94.000
mean2.853-2.952=-0.099
σ0.017-0.012=0.006
min2.833-2.943=-0.110
max2.874-2.968=-0.095
policies=200
mean18129.011-18547.526=-418.516
σ0.679-0.710=-0.031
min18128.244-18546.553=-418.309
max18129.895-18548.221=-418.326
mean8400.000
σ0.000
min8400.000
max8400.000
mean2748.000-2842.000=-94.000
σ0.000
min2748.000-2842.000=-94.000
max2748.000-2842.000=-94.000
mean28.635-29.406=-0.770
σ0.060-0.476=-0.416
min28.562-28.977=-0.415
max28.707-29.829=-1.122