Compare commits

Home / Compare 36ca5d1a .. c59c9916

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.375-31.040=39.335
σ0.057-0.049=0.008
min70.337-30.999=39.338
max70.535-31.177=39.358
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.159-0.078=0.081
σ0.003-0.005=-0.002
min0.156-0.072=0.084
max0.165-0.087=0.079
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.000
σ0.001-0.003=-0.002
min21.141-21.139=0.002
max21.145-21.147=-0.002
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.064-0.064=0.000
σ0.002-0.002=-0.000
min0.063-0.058=0.005
max0.070-0.066=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1714.271-1751.411=-37.140
σ169.514-0.362=169.152
min994.087-1750.843=-756.757
max1752.788-1751.995=0.793
mean1655.450-1641.250=14.200
σ617.148-618.522=-1.374
min641.000-627.000=14.000
max2493.000-2480.000=13.000
mean2.759-2.808=-0.050
σ0.349-0.139=0.210
min1.372-2.550=-1.178
max2.967-3.029=-0.062

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.932-266.778=3.154
σ0.007-0.007=0.000
min269.924-266.766=3.158
max269.943-266.784=3.159
mean2493.000-2480.000=13.000
σ0.000
min2493.000-2480.000=13.000
max2493.000-2480.000=13.000
mean0.371-0.364=0.007
σ0.005-0.001=0.004
min0.369-0.363=0.006
max0.380-0.366=0.014
iters=5
new-facts=1
prior-facts=6402
mean1930.388-1927.223=3.165
σ0.017-0.019=-0.002
min1930.363-1927.205=3.158
max1930.407-1927.250=3.157
mean2493.000-2480.000=13.000
σ0.000
min2493.000-2480.000=13.000
max2493.000-2480.000=13.000
mean2.554-2.938=-0.384
σ0.164-0.154=0.010
min2.444-2.702=-0.258
max2.844-3.101=-0.258
iters=5
new-facts=6402
prior-facts=1
mean4750.855-4747.616=3.239
σ0.810-0.961=-0.151
min4750.263-4746.747=3.516
max4752.271-4749.255=3.016
mean2493.000-2480.000=13.000
σ0.000
min2493.000-2480.000=13.000
max2493.000-2480.000=13.000
mean8.589-8.455=0.134
σ0.340-0.537=-0.196
min8.264-7.849=0.415
max9.125-9.141=-0.016
iters=5
new-facts=6402
prior-facts=6402
mean4941.332-4938.178=3.154
σ0.087-0.081=0.007
min4941.253-4938.099=3.154
max4941.430-4938.267=3.163
mean2991.000-2940.000=51.000
σ283.603-383.782=-100.180
min2603.000-2480.000=123.000
max3326.000-3457.000=-131.000
mean8.527-8.464=0.063
σ0.181-0.163=0.018
min8.357-8.316=0.041
max8.734-8.674=0.061

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.551-1.769=-0.219
σ0.300-0.134=0.166
min1.248-1.637=-0.390
max1.963-1.969=-0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.903-465.113=0.790
σ575.760-575.751=0.009
min178.017-177.235=0.782
max1329.543-1328.740=0.803
mean81.750-79.750=2.000
σ7.500
min78.000-76.000=2.000
max93.000-91.000=2.000
mean2493.000-2480.000=13.000
σ0.000
min2493.000-2480.000=13.000
max2493.000-2480.000=13.000
mean0.546-0.562=-0.016
σ0.532-0.558=-0.026
min0.275-0.277=-0.002
max1.344-1.399=-0.056
policies=20
mean1780.453-1772.572=7.881
σ0.358-0.332=0.026
min1780.208-1772.360=7.848
max1780.982-1773.066=7.917
mean780.000-760.000=20.000
σ0.000
min780.000-760.000=20.000
max780.000-760.000=20.000
mean2493.000-2480.000=13.000
σ0.000
min2493.000-2480.000=13.000
max2493.000-2480.000=13.000
mean2.788-2.738=0.051
σ0.072-0.013=0.059
min2.736-2.721=0.015
max2.895-2.750=0.145
policies=200
mean17811.337-17732.511=78.827
σ0.470-0.506=-0.036
min17811.063-17732.229=78.834
max17812.039-17733.269=78.770
mean7800.000-7600.000=200.000
σ0.000
min7800.000-7600.000=200.000
max7800.000-7600.000=200.000
mean2493.000-2480.000=13.000
σ0.000
min2493.000-2480.000=13.000
max2493.000-2480.000=13.000
mean27.843-27.599=0.244
σ0.117-0.155=-0.038
min27.732-27.440=0.293
max27.989-27.802=0.187