Compare commits

Home / Compare 67db9a41 .. 3b892afd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.373-70.376=-0.002
σ0.058-0.059=-0.001
min70.335-70.332=0.003
max70.536-70.540=-0.004
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.156-0.159=-0.003
σ0.006-0.004=0.002
min0.149-0.155=-0.006
max0.166-0.165=0.002
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.001
σ0.003-0.002=0.001
min21.139-21.139=0.001
max21.148-21.146=0.003
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.065-0.062=0.003
σ0.003-0.004=-0.001
min0.063-0.058=0.005
max0.072-0.068=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.199-1752.198=0.002
σ0.362-0.362=0.000
min1751.629-1751.633=-0.004
max1752.783-1752.781=0.002
mean1635.750-1641.900=-6.150
σ617.395-623.255=-5.860
min643.000-670.000=-27.000
max2470.000-2503.000=-33.000
mean2.841-2.831=0.010
σ0.130-0.181=-0.051
min2.544-2.356=0.188
max3.050-3.117=-0.067

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.935-269.935=0.000
σ0.005-0.008=-0.003
min269.927-269.924=0.004
max269.939-269.945=-0.006
mean2470.000-2503.000=-33.000
σ0.000
min2470.000-2503.000=-33.000
max2470.000-2503.000=-33.000
mean0.383-0.383=-0.000
σ0.005-0.005=-0.000
min0.379-0.379=-0.000
max0.391-0.392=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1930.384-1930.387=-0.003
σ0.024-0.026=-0.002
min1930.355-1930.355=0.000
max1930.406-1930.409=-0.003
mean2470.000-2503.000=-33.000
σ0.000
min2470.000-2503.000=-33.000
max2470.000-2503.000=-33.000
mean2.571-2.540=0.031
σ0.138-0.100=0.038
min2.456-2.453=0.003
max2.797-2.692=0.105
iters=5
new-facts=6402
prior-facts=1
mean4750.728-4750.754=-0.026
σ0.874-0.949=-0.075
min4750.078-4749.714=0.364
max4752.264-4752.309=-0.045
mean2470.000-2503.000=-33.000
σ0.000
min2470.000-2503.000=-33.000
max2470.000-2503.000=-33.000
mean8.624-8.708=-0.084
σ0.211-0.337=-0.127
min8.374-8.383=-0.009
max8.836-9.084=-0.249
iters=5
new-facts=6402
prior-facts=6402
mean4941.190-4941.326=-0.136
σ0.252-0.090=0.162
min4940.917-4941.248=-0.331
max4941.423-4941.427=-0.004
mean2961.600-2959.200=2.400
σ274.590-280.985=-6.395
min2593.000-2587.000=6.000
max3317.000-3331.000=-14.000
mean8.402-8.421=-0.018
σ0.041-0.042=-0.001
min8.351-8.363=-0.012
max8.450-8.468=-0.019

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.826-1.709=0.116
σ0.094-0.134=-0.040
min1.713-1.488=0.225
max1.973-1.845=0.128

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.902-465.901=0.000
σ575.752-575.756=-0.004
min178.022-178.020=0.003
max1329.530-1329.536=-0.005
mean81.750
σ7.500
min78.000
max93.000
mean2470.000-2503.000=-33.000
σ0.000
min2470.000-2503.000=-33.000
max2470.000-2503.000=-33.000
mean0.538-0.565=-0.028
σ0.505-0.575=-0.070
min0.277-0.274=0.003
max1.295-1.428=-0.132
policies=20
mean1780.452-1780.425=0.027
σ0.355-0.352=0.004
min1780.219-1780.188=0.031
max1780.979-1780.945=0.034
mean780.000
σ0.000
min780.000
max780.000
mean2470.000-2503.000=-33.000
σ0.000
min2470.000-2503.000=-33.000
max2470.000-2503.000=-33.000
mean2.763-2.770=-0.006
σ0.021-0.015=0.006
min2.741-2.748=-0.007
max2.792-2.779=0.012
policies=200
mean17811.318-17811.184=0.134
σ0.512-0.602=-0.090
min17811.024-17810.786=0.238
max17812.085-17812.073=0.011
mean7800.000
σ0.000
min7800.000
max7800.000
mean2470.000-2503.000=-33.000
σ0.000
min2470.000-2503.000=-33.000
max2470.000-2503.000=-33.000
mean27.782-27.774=0.008
σ0.054-0.068=-0.014
min27.719-27.712=0.007
max27.850-27.868=-0.018