Compare commits

Home / Compare cf1983b9 .. 27a76a02

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.707-70.731=-0.024
σ0.045-0.045=-0.000
min70.681-70.711=-0.030
max70.832-70.857=-0.026
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.161-0.159=0.002
σ0.004-0.005=-0.001
min0.156-0.154=0.002
max0.168-0.170=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.412-21.446=-0.034
σ0.003-0.002=0.001
min21.408-21.443=-0.035
max21.416-21.450=-0.035
mean411.000-413.000=-2.000
σ0.000
min411.000-413.000=-2.000
max411.000-413.000=-2.000
mean0.065-0.062=0.003
σ0.002-0.003=-0.001
min0.063-0.059=0.004
max0.071-0.071=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.932-1754.527=0.405
σ0.362-0.358=0.004
min1754.357-1753.955=0.402
max1755.522-1755.109=0.413
mean1652.350-1672.850=-20.500
σ620.187-650.724=-30.537
min679.000-623.000=56.000
max2784.000-2870.000=-86.000
mean2.810-2.806=0.004
σ0.170-0.181=-0.011
min2.365-2.188=0.177
max3.105-2.983=0.122

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.792-273.610=-0.818
σ0.003-0.005=-0.003
min272.788-273.602=-0.814
max272.794-273.615=-0.821
mean2784.000-2870.000=-86.000
σ0.000
min2784.000-2870.000=-86.000
max2784.000-2870.000=-86.000
mean0.377-0.384=-0.007
σ0.001-0.004=-0.003
min0.376-0.381=-0.005
max0.379-0.391=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1933.229-1933.997=-0.768
σ0.012-0.012=-0.000
min1933.215-1933.975=-0.760
max1933.243-1934.006=-0.762
mean2784.000-2870.000=-86.000
σ0.000
min2784.000-2870.000=-86.000
max2784.000-2870.000=-86.000
mean2.987-3.025=-0.038
σ0.101-0.070=0.031
min2.878-2.955=-0.077
max3.143-3.118=0.024
iters=5
new-facts=6402
prior-facts=1
mean4756.832-4754.758=2.074
σ7.638-0.843=6.795
min4752.915-4754.211=-1.296
max4770.484-4756.249=14.236
mean2784.000-2870.000=-86.000
σ0.000
min2784.000-2870.000=-86.000
max2784.000-2870.000=-86.000
mean8.755-8.694=0.061
σ0.252-0.396=-0.144
min8.483-8.401=0.082
max9.064-9.374=-0.309
iters=5
new-facts=6402
prior-facts=6402
mean4944.381-4945.224=-0.843
σ0.168-0.019=0.150
min4944.082-4945.207=-1.125
max4944.480-4945.246=-0.766
mean3001.000-3049.600=-48.600
σ225.536-188.130=37.406
min2784.000-2870.000=-86.000
max3334.000-3320.000=14.000
mean8.522-8.478=0.044
σ0.089-0.098=-0.009
min8.421-8.376=0.045
max8.620-8.616=0.004

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.089-0.997=0.092
σ0.194-0.140=0.054
min0.910-0.930=-0.020
max1.349-1.247=0.102

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.332-472.848=-4.516
σ574.238-574.936=-0.698
min181.203-185.374=-4.171
max1329.689-1335.253=-5.564
mean88.250
σ8.500
min84.000
max101.000
mean2784.000-2870.000=-86.000
σ0.000
min2784.000-2870.000=-86.000
max2784.000-2870.000=-86.000
mean0.444-0.451=-0.007
σ0.301-0.305=-0.004
min0.291-0.293=-0.002
max0.895-0.909=-0.013
policies=20
mean1812.368-1854.011=-41.643
σ0.405-0.366=0.038
min1812.095-1853.744=-41.650
max1812.962-1854.545=-41.583
mean840.000
σ0.000
min840.000
max840.000
mean2784.000-2870.000=-86.000
σ0.000
min2784.000-2870.000=-86.000
max2784.000-2870.000=-86.000
mean2.885-2.961=-0.075
σ0.016-0.018=-0.002
min2.865-2.949=-0.084
max2.902-2.987=-0.085
policies=200
mean18129.105-18546.682=-417.578
σ0.464-0.376=0.088
min18128.725-18546.426=-417.702
max18129.689-18547.236=-417.547
mean8400.000
σ0.000
min8400.000
max8400.000
mean2784.000-2870.000=-86.000
σ0.000
min2784.000-2870.000=-86.000
max2784.000-2870.000=-86.000
mean28.423-29.138=-0.715
σ0.190-0.451=-0.261
min28.283-28.875=-0.593
max28.695-29.812=-1.117