Compare commits

Home / Compare 2094c2c5 .. d27e4105

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean1448.768-33.994=1414.774
σ0.410-0.053=0.357
min1448.584-33.959=1414.625
max1449.918-34.144=1415.775
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean2.260-0.083=2.176
σ0.024-0.005=0.019
min2.220-0.077=2.143
max2.294-0.092=2.202
cache=y
dps=1
iters=10
policies=100
mean1437.941-23.318=1414.622
σ0.013-0.003=0.010
min1437.911-23.313=1414.598
max1437.962-23.322=1414.640
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean2.247-0.065=2.182
σ0.034-0.003=0.031
min2.163-0.061=2.102
max2.277-0.072=2.205

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1030.061-1762.689=-732.629
σ1.119-0.366=0.753
min1029.553-1762.116=-732.563
max1034.760-1763.286=-728.526
mean1061.350-1623.550=-562.200
σ313.279-597.556=-284.277
min575.000-634.000=-59.000
max1620.000-2411.000=-791.000
mean1.541-2.355=-0.814
σ0.082-0.151=-0.070
min1.468-2.121=-0.654
max1.750-2.758=-1.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean394.156-339.183=54.974
σ0.086-0.062=0.024
min394.031-339.073=54.958
max394.219-339.217=55.002
mean1620.000-2411.000=-791.000
σ0.000
min1620.000-2411.000=-791.000
max1620.000-2411.000=-791.000
mean0.497-0.433=0.063
σ0.008-0.001=0.007
min0.490-0.433=0.058
max0.505-0.435=0.071
iters=5
new-facts=1
prior-facts=6402
mean1395.766-2003.801=-608.035
σ0.055-0.005=0.050
min1395.737-2003.792=-608.056
max1395.864-2003.806=-607.942
mean1620.000-2411.000=-791.000
σ0.000
min1620.000-2411.000=-791.000
max1620.000-2411.000=-791.000
mean2.070-3.257=-1.187
σ0.142-0.131=0.011
min1.982-3.150=-1.168
max2.320-3.443=-1.123
iters=5
new-facts=6402
prior-facts=1
mean1917.938-4828.607=-2910.668
σ7.149-7.738=-0.589
min1914.627-4824.964=-2910.337
max1930.723-4842.446=-2911.723
mean1620.000-2411.000=-791.000
σ0.000
min1620.000-2411.000=-791.000
max1620.000-2411.000=-791.000
mean4.330-8.427=-4.096
σ0.217-0.691=-0.474
min4.064-7.605=-3.540
max4.636-9.237=-4.601
iters=5
new-facts=6402
prior-facts=6402
mean2180.564-5016.059=-2835.496
σ0.020-0.309=-0.290
min2180.553-5015.506=-2834.953
max2180.599-5016.208=-2835.609
mean1847.200-3008.800=-1161.600
σ196.462-298.438=-101.976
min1620.000-2599.000=-979.000
max2082.000-3382.000=-1300.000
mean4.712-8.642=-3.930
σ0.050-0.104=-0.054
min4.653-8.498=-3.844
max4.788-8.742=-3.954

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.086-1.745=-0.660
σ0.249-0.144=0.104
min0.902-1.559=-0.657
max1.516-1.946=-0.430

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean457.277-468.149=-10.872
σ573.356-575.276=-1.920
min170.586-180.505=-9.918
max1317.311-1331.063=-13.751
mean98.250-92.250=6.000
σ8.500
min94.000-88.000=6.000
max111.000-105.000=6.000
mean1620.000-2411.000=-791.000
σ0.000
min1620.000-2411.000=-791.000
max1620.000-2411.000=-791.000
mean0.571-0.554=0.017
σ0.578-0.545=0.033
min0.281-0.279=0.002
max1.438-1.372=0.066
policies=20
mean1706.081-1805.342=-99.261
σ0.399-0.393=0.006
min1705.823-1805.097=-99.273
max1706.670-1805.928=-99.258
mean940.000-880.000=60.000
σ0.000
min940.000-880.000=60.000
max940.000-880.000=60.000
mean1620.000-2411.000=-791.000
σ0.000
min1620.000-2411.000=-791.000
max1620.000-2411.000=-791.000
mean2.820-2.758=0.062
σ0.027-0.016=0.011
min2.785-2.734=0.051
max2.850-2.767=0.083
policies=200
mean17068.591-18061.092=-992.501
σ0.097-0.446=-0.349
min17068.503-18060.785=-992.282
max17068.725-18061.754=-993.029
mean9400.000-8800.000=600.000
σ0.000
min9400.000-8800.000=600.000
max9400.000-8800.000=600.000
mean1620.000-2411.000=-791.000
σ0.000
min1620.000-2411.000=-791.000
max1620.000-2411.000=-791.000
mean28.545-27.945=0.601
σ0.078-0.140=-0.062
min28.450-27.790=0.660
max28.620-28.104=0.516