Compare commits

Home / Compare 1e8a264c .. 3f3abfe9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.730-70.684=0.045
σ0.046-0.044=0.002
min70.704-70.658=0.047
max70.859-70.808=0.051
mean414.400-410.000=4.400
σ0.516-0.000=0.516
min414.000-410.000=4.000
max415.000-410.000=5.000
mean0.162-0.160=0.002
σ0.009-0.003=0.006
min0.152-0.157=-0.004
max0.176-0.165=0.012
cache=y
dps=1
iters=10
policies=100
mean21.446-21.420=0.026
σ0.002-0.003=-0.001
min21.443-21.416=0.027
max21.450-21.424=0.025
mean415.000-410.000=5.000
σ0.000
min415.000-410.000=5.000
max415.000-410.000=5.000
mean0.065-0.063=0.003
σ0.003-0.003=-0.001
min0.063-0.059=0.004
max0.072-0.069=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.528-1754.458=0.070
σ0.364-0.359=0.004
min1753.956-1753.889=0.067
max1755.111-1755.033=0.078
mean1654.650-1648.200=6.450
σ632.641-640.716=-8.075
min642.000-648.000=-6.000
max2845.000-2871.000=-26.000
mean2.794-2.825=-0.031
σ0.190-0.131=0.059
min2.275-2.556=-0.282
max3.041-3.053=-0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.610-273.505=0.105
σ0.007-0.008=-0.001
min273.601-273.497=0.104
max273.618-273.519=0.099
mean2845.000-2871.000=-26.000
σ0.000
min2845.000-2871.000=-26.000
max2845.000-2871.000=-26.000
mean0.387-0.387=-0.000
σ0.010-0.003=0.007
min0.379-0.385=-0.006
max0.403-0.392=0.011
iters=5
new-facts=1
prior-facts=6402
mean1934.001-1933.897=0.105
σ0.019-0.009=0.010
min1933.973-1933.886=0.087
max1934.023-1933.906=0.117
mean2845.000-2871.000=-26.000
σ0.000
min2845.000-2871.000=-26.000
max2845.000-2871.000=-26.000
mean3.104-3.002=0.102
σ0.328-0.147=0.181
min2.870-2.787=0.083
max3.679-3.188=0.491
iters=5
new-facts=6402
prior-facts=1
mean4614.224-4754.739=-140.514
σ314.523-0.792=313.731
min4051.591-4754.335=-702.744
max4756.329-4756.154=0.176
mean2845.000-2871.000=-26.000
σ0.000
min2845.000-2871.000=-26.000
max2845.000-2871.000=-26.000
mean8.139-7.980=0.159
σ0.723-0.256=0.467
min7.017-7.839=-0.822
max8.790-8.435=0.355
iters=5
new-facts=6402
prior-facts=6402
mean4945.220-4945.112=0.108
σ0.015-0.014=0.001
min4945.202-4945.090=0.112
max4945.244-4945.124=0.120
mean3025.200-3041.600=-16.400
σ263.403-253.416=9.987
min2845.000-2871.000=-26.000
max3445.000-3449.000=-4.000
mean8.567-8.432=0.136
σ0.185-0.069=0.116
min8.413-8.327=0.085
max8.792-8.498=0.295

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.094-1.077=0.017
σ0.182-0.238=-0.055
min0.924-0.936=-0.012
max1.324-1.488=-0.164

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.841-472.574=0.267
σ574.938-574.939=-0.001
min185.372-185.093=0.279
max1335.249-1334.983=0.266
mean88.250
σ8.500
min84.000
max101.000
mean2845.000-2871.000=-26.000
σ0.000
min2845.000-2871.000=-26.000
max2845.000-2871.000=-26.000
mean0.452-0.450=0.001
σ0.308-0.312=-0.004
min0.296-0.280=0.016
max0.913-0.918=-0.005
policies=20
mean1854.017-1851.271=2.746
σ0.373-0.378=-0.005
min1853.743-1850.988=2.756
max1854.560-1851.822=2.738
mean840.000
σ0.000
min840.000
max840.000
mean2845.000-2871.000=-26.000
σ0.000
min2845.000-2871.000=-26.000
max2845.000-2871.000=-26.000
mean2.955-2.954=0.002
σ0.027-0.011=0.016
min2.929-2.940=-0.011
max2.982-2.966=0.016
policies=200
mean18546.653-18519.474=27.179
σ0.543-0.489=0.054
min18546.296-18519.183=27.113
max18547.459-18520.207=27.252
mean8400.000
σ0.000
min8400.000
max8400.000
mean2845.000-2871.000=-26.000
σ0.000
min2845.000-2871.000=-26.000
max2845.000-2871.000=-26.000
mean29.192-29.253=-0.061
σ0.469-0.405=0.064
min28.701-28.954=-0.253
max29.646-29.820=-0.174