Compare commits

Home / Compare 24532ad9 .. 8de49f60

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.914=-0.000
σ0.367-0.366=0.001
min53.787-53.782=0.004
max54.959-54.957=0.002
mean416.000-414.800=1.200
σ0.000-0.422=-0.422
min416.000-414.000=2.000
max416.000-415.000=1.000
mean0.136-0.138=-0.002
σ0.007-0.004=0.003
min0.123-0.134=-0.011
max0.144-0.144=0.000
cache=y
dps=1
iters=10
policies=100
mean43.144-43.141=0.003
σ0.003-0.005=-0.002
min43.139-43.134=0.005
max43.149
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.132-0.120=0.012
σ0.010-0.005=0.006
min0.119-0.114=0.004
max0.145-0.128=0.017

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.813-992.077=-0.264
σ1.264-1.258=0.006
min991.227-991.496=-0.269
max997.131-997.370=-0.239
mean1070.700-1069.100=1.600
σ327.498-323.406=4.092
min569.000-573.000=-4.000
max1643.000-1638.000=5.000
mean1.527-1.530=-0.003
σ0.084-0.069=0.015
min1.426-1.464=-0.038
max1.737-1.750=-0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.414-285.676=-0.262
σ0.015-0.015=-0.000
min285.390-285.651=-0.260
max285.426-285.689=-0.263
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.385-0.382=0.003
σ0.010-0.011=-0.002
min0.375-0.374=0.001
max0.400-0.402=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1285.373-1285.641=-0.268
σ0.133-0.135=-0.002
min1285.308-1285.573=-0.266
max1285.611-1285.882=-0.271
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean1.870-1.988=-0.118
σ0.030-0.094=-0.063
min1.823-1.844=-0.021
max1.903-2.072=-0.169
iters=5
new-facts=6402
prior-facts=1
mean1807.695-1807.973=-0.278
σ7.026-6.988=0.038
min1804.334-1804.560=-0.226
max1820.247-1820.454=-0.207
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean4.125-4.103=0.021
σ0.144-0.327=-0.183
min3.977-3.843=0.134
max4.355-4.632=-0.278
iters=5
new-facts=6402
prior-facts=6402
mean2070.195-2070.468=-0.273
σ0.011-0.019=-0.008
min2070.182-2070.447=-0.265
max2070.211-2070.499=-0.288
mean1845.600-1858.000=-12.400
σ172.717-196.641=-23.923
min1643.000-1638.000=5.000
max2088.000-2094.000=-6.000
mean4.488-4.555=-0.067
σ0.054-0.115=-0.060
min4.441-4.443=-0.002
max4.568-4.749=-0.181

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.161-1.206=-0.046
σ0.271-0.319=-0.048
min0.904-0.911=-0.007
max1.599-1.740=-0.141

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.787-437.386=-0.599
σ572.365-572.364=0.001
min150.600-151.195=-0.595
max1295.334-1295.931=-0.597
mean90.250
σ8.500
min86.000
max103.000
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean0.520-0.518=0.001
σ0.535-0.531=0.003
min0.250-0.251=-0.001
max1.322-1.315=0.006
policies=20
mean1506.282-1512.213=-5.931
σ0.257-0.253=0.003
min1506.125-1512.053=-5.928
max1506.666-1512.591=-5.925
mean860.000
σ0.000
min860.000
max860.000
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean2.548-2.540=0.008
σ0.006-0.027=-0.021
min2.541-2.503=0.038
max2.554-2.567=-0.013
policies=200
mean15070.284-15129.711=-59.427
σ0.092-0.064=0.028
min15070.224-15129.665=-59.440
max15070.420-15129.804=-59.384
mean8600.000
σ0.000
min8600.000
max8600.000
mean1643.000-1638.000=5.000
σ0.000
min1643.000-1638.000=5.000
max1643.000-1638.000=5.000
mean25.576-25.726=-0.151
σ0.040-0.167=-0.127
min25.529-25.605=-0.076
max25.610-25.971=-0.361