Compare commits

Home / Compare 22178e56 .. 76997f5e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.702-70.782=-0.080
σ0.047-0.048=-0.001
min70.672-70.749=-0.077
max70.832-70.914=-0.082
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.161-0.161=0.000
σ0.005-0.003=0.002
min0.157-0.157=-0.000
max0.170-0.165=0.005
cache=y
dps=1
iters=10
policies=100
mean21.409-21.491=-0.083
σ0.002-0.003=-0.000
min21.405-21.488=-0.083
max21.412-21.495=-0.083
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.066-0.063=0.003
σ0.003-0.003=-0.000
min0.064-0.059=0.005
max0.074-0.069=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.929-1754.092=0.837
σ0.360-0.360=-0.000
min1754.358-1753.529=0.829
max1755.502-1754.681=0.821
mean1662.800-1663.250=-0.450
σ620.954-635.275=-14.320
min621.000-629.000=-8.000
max2504.000-2778.000=-274.000
mean2.786-2.819=-0.033
σ0.142-0.121=0.021
min2.463-2.477=-0.014
max2.973-3.042=-0.070

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.750-271.956=0.794
σ0.017-0.004=0.013
min272.720-271.949=0.771
max272.762-271.959=0.803
mean2504.000-2778.000=-274.000
σ0.000
min2504.000-2778.000=-274.000
max2504.000-2778.000=-274.000
mean0.382-0.380=0.002
σ0.004-0.003=0.002
min0.380-0.378=0.002
max0.389-0.384=0.005
iters=5
new-facts=1
prior-facts=6402
mean1933.162-1932.324=0.838
σ0.010-0.019=-0.009
min1933.147-1932.311=0.836
max1933.174-1932.357=0.817
mean2504.000-2778.000=-274.000
σ0.000
min2504.000-2778.000=-274.000
max2504.000-2778.000=-274.000
mean3.122-2.889=0.233
σ0.087-0.252=-0.165
min3.013-2.476=0.537
max3.207-3.119=0.088
iters=5
new-facts=6402
prior-facts=1
mean4757.011-4753.084=3.927
σ7.594-0.898=6.697
min4753.421-4752.600=0.821
max4770.595-4754.680=15.915
mean2504.000-2778.000=-274.000
σ0.000
min2504.000-2778.000=-274.000
max2504.000-2778.000=-274.000
mean8.036-8.574=-0.539
σ0.540-0.416=0.124
min7.698-8.047=-0.350
max8.992-8.984=0.009
iters=5
new-facts=6402
prior-facts=6402
mean4944.402-4943.482=0.920
σ0.016-0.158=-0.142
min4944.383-4943.200=1.183
max4944.415-4943.570=0.844
mean2945.400-2982.400=-37.000
σ392.293-218.367=173.926
min2504.000-2778.000=-274.000
max3478.000-3313.000=165.000
mean8.524-8.605=-0.080
σ0.152-0.338=-0.186
min8.365-8.339=0.027
max8.690-9.173=-0.483

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.489-1.022=0.468
σ0.352-0.134=0.218
min0.923-0.928=-0.005
max1.761-1.239=0.522

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.319-468.654=-0.335
σ574.262-574.929=-0.668
min181.186-181.189=-0.003
max1329.712-1331.049=-1.337
mean88.250
σ8.500
min84.000
max101.000
mean2504.000-2778.000=-274.000
σ0.000
min2504.000-2778.000=-274.000
max2504.000-2778.000=-274.000
mean0.565-0.449=0.117
σ0.567-0.302=0.265
min0.279-0.296=-0.017
max1.416-0.902=0.514
policies=20
mean1812.148-1812.211=-0.063
σ0.366-0.386=-0.020
min1811.935-1811.934=0.000
max1812.694-1812.774=-0.081
mean840.000
σ0.000
min840.000
max840.000
mean2504.000-2778.000=-274.000
σ0.000
min2504.000-2778.000=-274.000
max2504.000-2778.000=-274.000
mean2.813-2.942=-0.129
σ0.035-0.058=-0.023
min2.770-2.902=-0.132
max2.854-3.028=-0.174
policies=200
mean18128.932-18129.105=-0.172
σ0.594-0.552=0.042
min18128.546-18128.697=-0.151
max18129.800-18129.920=-0.121
mean8400.000
σ0.000
min8400.000
max8400.000
mean2504.000-2778.000=-274.000
σ0.000
min2504.000-2778.000=-274.000
max2504.000-2778.000=-274.000
mean28.323-28.516=-0.193
σ0.122-0.063=0.059
min28.174-28.461=-0.287
max28.469-28.591=-0.122