Compare commits

Home / Compare c3c55572 .. 22a7f4ee

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.980=-0.000
σ0.049-0.047=0.002
min33.952-33.955=-0.004
max34.114-34.110=0.004
mean415.000
σ0.000
min415.000
max415.000
mean0.085-0.084=0.001
σ0.003-0.004=-0.000
min0.081-0.080=0.001
max0.090-0.091=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.318=-0.001
σ0.002-0.003=-0.001
min23.313-23.313=-0.000
max23.320-23.322=-0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.063-0.066=-0.003
σ0.004-0.003=0.001
min0.059-0.064=-0.005
max0.072-0.074=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.366-1757.302=0.064
σ0.365-0.364=0.001
min1756.788-1756.728=0.059
max1757.955-1757.889=0.065
mean1666.350-1666.050=0.300
σ627.496-628.073=-0.577
min671.000
max2614.000-2615.000=-1.000
mean2.353-2.368=-0.014
σ0.115-0.116=-0.001
min2.220-2.258=-0.037
max2.702-2.733=-0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.509-326.441=0.068
σ0.054-0.061=-0.007
min326.416-326.334=0.083
max326.548-326.481=0.068
mean2614.000-2615.000=-1.000
σ0.000
min2614.000-2615.000=-1.000
max2614.000-2615.000=-1.000
mean0.429-0.433=-0.004
σ0.011-0.006=0.004
min0.420-0.425=-0.005
max0.446-0.440=0.007
iters=5
new-facts=1
prior-facts=6402
mean1988.671-1988.614=0.057
σ0.012-0.005=0.006
min1988.658-1988.605=0.053
max1988.686-1988.618=0.068
mean2614.000-2615.000=-1.000
σ0.000
min2614.000-2615.000=-1.000
max2614.000-2615.000=-1.000
mean2.740-2.715=0.024
σ0.134-0.106=0.027
min2.623-2.615=0.008
max2.886-2.880=0.006
iters=5
new-facts=6402
prior-facts=1
mean4813.539-4813.344=0.195
σ7.731-7.797=-0.066
min4809.978-4809.427=0.550
max4827.367-4827.284=0.083
mean2614.000-2615.000=-1.000
σ0.000
min2614.000-2615.000=-1.000
max2614.000-2615.000=-1.000
mean8.431-8.893=-0.463
σ0.629-0.328=0.301
min7.605-8.410=-0.805
max9.326-9.193=0.133
iters=5
new-facts=6402
prior-facts=6402
mean5000.991-5001.004=-0.013
σ0.177-0.022=0.154
min5000.676-5000.979=-0.303
max5001.088-5001.031=0.057
mean2975.400-3015.600=-40.200
σ397.962-313.230=84.732
min2614.000-2615.000=-1.000
max3538.000-3417.000=121.000
mean9.636-9.189=0.447
σ0.225-0.601=-0.376
min9.304-8.502=0.801
max9.895-9.737=0.158

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.258-1.295=-0.037
σ0.397-0.295=0.102
min0.917-0.947=-0.031
max1.778-1.635=0.143

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.507-464.429=0.078
σ574.792-574.775=0.017
min177.103-177.038=0.065
max1326.695-1326.591=0.104
mean88.250
σ8.500
min84.000
max101.000
mean2614.000-2615.000=-1.000
σ0.000
min2614.000-2615.000=-1.000
max2614.000-2615.000=-1.000
mean0.556-0.554=0.002
σ0.559-0.560=-0.001
min0.273-0.269=0.004
max1.395-1.394=0.001
policies=20
mean1771.388-1770.740=0.648
σ0.364-0.363=0.001
min1771.149-1770.496=0.653
max1771.928-1771.279=0.649
mean840.000
σ0.000
min840.000
max840.000
mean2614.000-2615.000=-1.000
σ0.000
min2614.000-2615.000=-1.000
max2614.000-2615.000=-1.000
mean2.728-2.741=-0.013
σ0.012-0.011=0.001
min2.717-2.728=-0.011
max2.744-2.752=-0.008
policies=200
mean17720.980-17714.876=6.104
σ0.554-0.558=-0.004
min17720.640-17714.429=6.211
max17721.800-17715.691=6.108
mean8400.000
σ0.000
min8400.000
max8400.000
mean2614.000-2615.000=-1.000
σ0.000
min2614.000-2615.000=-1.000
max2614.000-2615.000=-1.000
mean27.437-27.522=-0.085
σ0.216-0.116=0.100
min27.291-27.378=-0.088
max27.755-27.636=0.119