Compare commits

Home / Compare ecd05568 .. 6d00aea4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.702-70.702=-0.000
σ0.046-0.046=0.001
min70.670-70.669=0.001
max70.829-70.827=0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.158-0.159=-0.001
σ0.004-0.005=-0.001
min0.151-0.152=-0.000
max0.164-0.166=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.409-21.407=0.002
σ0.002-0.002=-0.000
min21.406-21.404=0.002
max21.412-21.411=0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.064-0.063=0.001
σ0.002-0.004=-0.002
min0.059-0.059=-0.000
max0.066-0.072=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.928=0.003
σ0.360-0.361=-0.001
min1754.359-1754.359=0.001
max1755.506-1755.510=-0.004
mean1655.450-1669.000=-13.550
σ618.940-621.251=-2.311
min684.000-626.000=58.000
max2771.000-2507.000=264.000
mean2.759-2.825=-0.066
σ0.205-0.156=0.049
min2.347-2.352=-0.005
max3.033-3.062=-0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.790-272.789=0.001
σ0.007-0.005=0.002
min272.780-272.784=-0.004
max272.798-272.798=0.000
mean2771.000-2507.000=264.000
σ0.000
min2771.000-2507.000=264.000
max2771.000-2507.000=264.000
mean0.384-0.379=0.005
σ0.010-0.001=0.008
min0.376-0.378=-0.002
max0.398-0.381=0.017
iters=5
new-facts=1
prior-facts=6402
mean1933.225-1933.225=-0.000
σ0.016-0.016=-0.000
min1933.206-1933.202=0.003
max1933.244-1933.243=0.002
mean2771.000-2507.000=264.000
σ0.000
min2771.000-2507.000=264.000
max2771.000-2507.000=264.000
mean3.042-3.192=-0.150
σ0.064-0.161=-0.097
min2.991-3.039=-0.048
max3.134-3.398=-0.264
iters=5
new-facts=6402
prior-facts=1
mean4756.968-4756.984=-0.017
σ7.578-7.543=0.035
min4753.474-4753.586=-0.112
max4770.522-4770.478=0.045
mean2771.000-2507.000=264.000
σ0.000
min2771.000-2507.000=264.000
max2771.000-2507.000=264.000
mean8.534-8.382=0.153
σ0.279-0.226=0.053
min8.317-7.994=0.323
max8.998-8.576=0.421
iters=5
new-facts=6402
prior-facts=6402
mean4944.452-4944.307=0.145
σ0.017-0.197=-0.180
min4944.431-4944.078=0.352
max4944.474-4944.462=0.012
mean2990.800-2976.600=14.200
σ269.608-394.871=-125.263
min2771.000-2507.000=264.000
max3402.000-3517.000=-115.000
mean8.433-8.455=-0.021
σ0.085-0.086=-0.001
min8.357-8.385=-0.028
max8.569-8.590=-0.021

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.007-1.570=-0.562
σ0.138-0.206=-0.068
min0.909-1.216=-0.307
max1.228-1.739=-0.510

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.339-468.317=0.022
σ574.256-574.259=-0.003
min181.204-181.183=0.021
max1329.723-1329.705=0.018
mean88.250
σ8.500
min84.000
max101.000
mean2771.000-2507.000=264.000
σ0.000
min2771.000-2507.000=264.000
max2771.000-2507.000=264.000
mean0.428-0.543=-0.115
σ0.274-0.516=-0.241
min0.285-0.281=0.004
max0.839-1.316=-0.477
policies=20
mean1812.373-1812.143=0.230
σ0.393-0.378=0.014
min1812.105-1811.891=0.213
max1812.951-1812.702=0.248
mean840.000
σ0.000
min840.000
max840.000
mean2771.000-2507.000=264.000
σ0.000
min2771.000-2507.000=264.000
max2771.000-2507.000=264.000
mean2.883-2.826=0.057
σ0.017-0.020=-0.003
min2.868-2.808=0.060
max2.902-2.855=0.047
policies=200
mean18128.972-18128.832=0.141
σ0.629-0.622=0.008
min18128.534-18128.431=0.103
max18129.880-18129.746=0.134
mean8400.000
σ0.000
min8400.000
max8400.000
mean2771.000-2507.000=264.000
σ0.000
min2771.000-2507.000=264.000
max2771.000-2507.000=264.000
mean28.493-28.343=0.151
σ0.317-0.099=0.217
min28.204-28.220=-0.016
max28.886-28.463=0.423