Compare commits

Home / Compare 578c6d2c .. f96d5cf7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.728-70.733=-0.005
σ0.044-0.047=-0.003
min70.704-70.701=0.004
max70.851-70.864=-0.012
mean413.000
σ0.000
min413.000
max413.000
mean0.159-0.160=-0.001
σ0.003-0.002=0.001
min0.156-0.158=-0.002
max0.164-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.448-21.445=0.003
σ0.011-0.004=0.007
min21.441-21.441=-0.000
max21.478-21.452=0.026
mean413.000
σ0.000
min413.000
max413.000
mean0.063-0.064=-0.001
σ0.003-0.004=-0.001
min0.059-0.058=0.001
max0.067-0.073=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.527-1754.525=0.002
σ0.360-0.360=-0.000
min1753.958-1753.953=0.005
max1755.104-1755.087=0.017
mean1658.550-1641.000=17.550
σ644.125-626.957=17.168
min624.000-623.000=1.000
max2867.000-2853.000=14.000
mean2.817-2.779=0.038
σ0.172-0.152=0.020
min2.298-2.317=-0.018
max3.206-3.032=0.174

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.607-273.609=-0.003
σ0.008-0.005=0.003
min273.597-273.602=-0.005
max273.618-273.616=0.002
mean2867.000-2853.000=14.000
σ0.000
min2867.000-2853.000=14.000
max2867.000-2853.000=14.000
mean0.383-0.382=0.001
σ0.004-0.004=-0.000
min0.380-0.379=0.001
max0.390-0.390=0.000
iters=5
new-facts=1
prior-facts=6402
mean1934.012-1934.003=0.009
σ0.015-0.005=0.010
min1933.987-1933.997=-0.010
max1934.021-1934.008=0.013
mean2867.000-2853.000=14.000
σ0.000
min2867.000-2853.000=14.000
max2867.000-2853.000=14.000
mean3.030-2.994=0.036
σ0.239-0.189=0.050
min2.732-2.720=0.011
max3.284-3.254=0.030
iters=5
new-facts=6402
prior-facts=1
mean4754.770-4754.535=0.234
σ0.791-1.088=-0.297
min4754.323-4753.181=1.142
max4756.180-4756.223=-0.043
mean2867.000-2853.000=14.000
σ0.000
min2867.000-2853.000=14.000
max2867.000-2853.000=14.000
mean8.367-8.259=0.108
σ0.334-0.612=-0.278
min7.998-7.577=0.421
max8.832-8.940=-0.108
iters=5
new-facts=6402
prior-facts=6402
mean4945.171-4945.224=-0.053
σ0.185-0.022=0.163
min4944.844-4945.207=-0.362
max4945.294-4945.256=0.038
mean3110.600-3063.200=47.400
σ253.283-211.865=41.418
min2867.000-2853.000=14.000
max3372.000-3350.000=22.000
mean9.299-8.718=0.581
σ0.898-0.317=0.581
min8.394-8.399=-0.005
max10.294-9.135=1.159

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.041-1.054=-0.013
σ0.240-0.135=0.104
min0.932-0.933=-0.001
max1.469-1.271=0.198

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.844-472.841=0.003
σ574.930-574.928=0.002
min185.375-185.369=0.005
max1335.238-1335.233=0.006
mean88.250
σ8.500
min84.000
max101.000
mean2867.000-2853.000=14.000
σ0.000
min2867.000-2853.000=14.000
max2867.000-2853.000=14.000
mean0.492-0.485=0.007
σ0.378-0.377=0.002
min0.292-0.295=-0.004
max1.059-1.050=0.009
policies=20
mean1854.016-1853.978=0.038
σ0.363-0.374=-0.011
min1853.733-1853.707=0.026
max1854.541-1854.525=0.017
mean840.000
σ0.000
min840.000
max840.000
mean2867.000-2853.000=14.000
σ0.000
min2867.000-2853.000=14.000
max2867.000-2853.000=14.000
mean2.947-2.941=0.006
σ0.004-0.017=-0.013
min2.941-2.930=0.012
max2.951-2.966=-0.015
policies=200
mean18546.636-18546.493=0.143
σ0.355-0.373=-0.018
min18546.320-18546.238=0.082
max18547.143-18547.042=0.101
mean8400.000
σ0.000
min8400.000
max8400.000
mean2867.000-2853.000=14.000
σ0.000
min2867.000-2853.000=14.000
max2867.000-2853.000=14.000
mean29.085-29.040=0.045
σ0.520-0.451=0.068
min28.764-28.719=0.045
max29.856-29.704=0.152