Compare commits

Home / Compare 4b9a15e7 .. 96d0b5b5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.646-53.648=-0.003
σ0.367-0.365=0.002
min53.506-53.516=-0.011
max54.691-54.687=0.003
mean414.000-416.200=-2.200
σ0.000-1.033=-1.033
min414.000-415.000=-1.000
max414.000-417.000=-3.000
mean0.137-0.142=-0.005
σ0.007-0.005=0.002
min0.129-0.136=-0.007
max0.147-0.153=-0.005
cache=y
dps=1
iters=10
policies=100
mean42.944-42.943=0.002
σ0.005-0.005=-0.001
min42.939-42.934=0.004
max42.952-42.954=-0.002
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.125-0.121=0.004
σ0.008-0.003=0.004
min0.118-0.118=-0.000
max0.139-0.128=0.011

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.864-991.857=0.007
σ1.224-1.230=-0.006
min991.267-991.262=0.004
max996.980-997.015=-0.034
mean1043.600-1069.150=-25.550
σ302.275-319.197=-16.922
min579.000-605.000=-26.000
max1448.000-1643.000=-195.000
mean1.553-1.526=0.027
σ0.112-0.063=0.048
min1.413-1.461=-0.048
max1.784-1.730=0.054

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.440-285.439=0.001
σ0.011-0.010=0.002
min285.422-285.428=-0.006
max285.451-285.450=0.001
mean1448.000-1643.000=-195.000
σ0.000
min1448.000-1643.000=-195.000
max1448.000-1643.000=-195.000
mean0.389-0.384=0.005
σ0.013-0.008=0.004
min0.375-0.374=0.000
max0.407-0.396=0.011
iters=5
new-facts=1
prior-facts=6402
mean1285.520-1285.496=0.024
σ0.059-0.083=-0.025
min1285.416-1285.355=0.061
max1285.560-1285.563=-0.003
mean1448.000-1643.000=-195.000
σ0.000
min1448.000-1643.000=-195.000
max1448.000-1643.000=-195.000
mean1.944-1.926=0.018
σ0.167-0.124=0.042
min1.801-1.807=-0.006
max2.155-2.132=0.023
iters=5
new-facts=6402
prior-facts=1
mean1705.834-1705.830=0.005
σ6.871-6.877=-0.006
min1702.652-1702.644=0.009
max1718.123-1718.127=-0.004
mean1448.000-1643.000=-195.000
σ0.000
min1448.000-1643.000=-195.000
max1448.000-1643.000=-195.000
mean2.908-3.070=-0.163
σ0.229-0.213=0.016
min2.727-2.846=-0.120
max3.276-3.390=-0.114
iters=5
new-facts=6402
prior-facts=6402
mean1968.431-1968.434=-0.003
σ0.038-0.030=0.007
min1968.376-1968.394=-0.018
max1968.477-1968.478=-0.002
mean1780.200-1880.600=-100.400
σ196.122-188.389=7.733
min1537.000-1643.000=-106.000
max2037.000-2076.000=-39.000
mean3.320-3.281=0.038
σ0.340-0.120=0.219
min3.093-3.087=0.006
max3.920-3.397=0.523

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.614-1.162=0.452
σ0.144-0.261=-0.117
min1.435-0.917=0.518
max1.815-1.581=0.234

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.686-436.691=-0.005
σ572.352-572.352=-0.000
min150.504-150.510=-0.007
max1295.214-1295.219=-0.005
mean90.250
σ8.500
min86.000
max103.000
mean1448.000-1643.000=-195.000
σ0.000
min1448.000-1643.000=-195.000
max1448.000-1643.000=-195.000
mean0.520-0.477=0.043
σ0.534-0.460=0.074
min0.248-0.239=0.009
max1.322-1.168=0.154
policies=20
mean1505.362-1505.356=0.006
σ0.256-0.244=0.012
min1505.189-1505.216=-0.026
max1505.743-1505.722=0.021
mean860.000
σ0.000
min860.000
max860.000
mean1448.000-1643.000=-195.000
σ0.000
min1448.000-1643.000=-195.000
max1448.000-1643.000=-195.000
mean2.548-2.555=-0.006
σ0.055-0.065=-0.009
min2.508-2.509=-0.001
max2.629-2.650=-0.021
policies=200
mean15061.261-15061.181=0.080
σ0.046-0.121=-0.075
min15061.203-15061.054=0.149
max15061.309-15061.298=0.011
mean8600.000
σ0.000
min8600.000
max8600.000
mean1448.000-1643.000=-195.000
σ0.000
min1448.000-1643.000=-195.000
max1448.000-1643.000=-195.000
mean25.477-25.443=0.035
σ0.149-0.144=0.005
min25.345-25.289=0.055
max25.636-25.620=0.016