Compare commits

Home / Compare 749bf944 .. 666950b3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.376-70.373=0.003
σ0.056-0.057=-0.001
min70.343-70.336=0.006
max70.533-70.532=0.001
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.163-0.158=0.004
σ0.003-0.005=-0.002
min0.160-0.151=0.009
max0.168-0.165=0.003
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.000
σ0.003-0.001=0.001
min21.139-21.141=-0.002
max21.147-21.146=0.001
mean413.000-412.700=0.300
σ0.000-0.483=-0.483
min413.000-412.000=1.000
max413.000
mean0.065-0.063=0.002
σ0.002-0.004=-0.002
min0.062-0.058=0.004
max0.071-0.071=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.202-1752.201=0.001
σ0.361-0.360=0.000
min1751.631-1751.632=-0.001
max1752.772-1752.789=-0.017
mean1635.600-1659.000=-23.400
σ617.896-623.167=-5.271
min644.000-643.000=1.000
max2472.000-2505.000=-33.000
mean2.813-2.829=-0.016
σ0.210-0.156=0.054
min2.142-2.512=-0.370
max3.087-3.028=0.059

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.934-269.935=-0.001
σ0.006-0.004=0.001
min269.930-269.932=-0.002
max269.944-269.942=0.001
mean2472.000-2505.000=-33.000
σ0.000
min2472.000-2505.000=-33.000
max2472.000-2505.000=-33.000
mean0.383-0.385=-0.002
σ0.004-0.004=0.000
min0.380-0.382=-0.002
max0.389-0.390=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1930.394-1930.394=-0.000
σ0.013-0.010=0.004
min1930.372-1930.383=-0.011
max1930.408-1930.405=0.002
mean2472.000-2505.000=-33.000
σ0.000
min2472.000-2505.000=-33.000
max2472.000-2505.000=-33.000
mean2.556-2.516=0.040
σ0.115-0.074=0.041
min2.442-2.450=-0.009
max2.704-2.611=0.093
iters=5
new-facts=6402
prior-facts=1
mean4750.791-4750.518=0.273
σ0.520-0.848=-0.328
min4750.471-4749.767=0.705
max4751.715-4751.889=-0.175
mean2472.000-2505.000=-33.000
σ0.000
min2472.000-2505.000=-33.000
max2472.000-2505.000=-33.000
mean8.191-8.655=-0.464
σ0.548-0.600=-0.051
min7.622-7.653=-0.031
max9.050-9.212=-0.161
iters=5
new-facts=6402
prior-facts=6402
mean4941.187-4941.331=-0.144
σ0.190-0.079=0.111
min4940.925-4941.266=-0.342
max4941.411-4941.420=-0.009
mean2932.000-3022.400=-90.400
σ390.017-312.990=77.027
min2495.000-2575.000=-80.000
max3451.000-3378.000=73.000
mean8.441-8.691=-0.250
σ0.123-0.218=-0.095
min8.316-8.422=-0.106
max8.647-8.954=-0.307

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.788-1.699=0.089
σ0.137-0.200=-0.063
min1.633-1.438=0.195
max1.957-1.929=0.028

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.902-465.910=-0.008
σ575.759-575.762=-0.003
min178.019-178.024=-0.006
max1329.541-1329.553=-0.012
mean81.750
σ7.500
min78.000
max93.000
mean2472.000-2505.000=-33.000
σ0.000
min2472.000-2505.000=-33.000
max2472.000-2505.000=-33.000
mean0.536-0.559=-0.022
σ0.508-0.544=-0.036
min0.281-0.280=0.001
max1.298-1.375=-0.076
policies=20
mean1780.450-1780.471=-0.021
σ0.356-0.352=0.004
min1780.211-1780.224=-0.013
max1780.979-1780.991=-0.013
mean780.000
σ0.000
min780.000
max780.000
mean2472.000-2505.000=-33.000
σ0.000
min2472.000-2505.000=-33.000
max2472.000-2505.000=-33.000
mean2.762-2.779=-0.017
σ0.022-0.019=0.003
min2.739-2.759=-0.020
max2.782-2.805=-0.023
policies=200
mean17811.394-17811.506=-0.112
σ0.440-0.470=-0.030
min17811.085-17811.239=-0.154
max17812.040-17812.211=-0.171
mean7800.000
σ0.000
min7800.000
max7800.000
mean2472.000-2505.000=-33.000
σ0.000
min2472.000-2505.000=-33.000
max2472.000-2505.000=-33.000
mean27.946-27.897=0.050
σ0.043-0.025=0.019
min27.888-27.863=0.025
max27.992-27.918=0.074