Compare commits

Home / Compare 23ed4aa0 .. d055265a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.375-70.376=-0.001
σ0.059-0.059=0.000
min70.330-70.337=-0.007
max70.540-70.539=0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.157-0.160=-0.004
σ0.005-0.003=0.002
min0.151-0.156=-0.005
max0.165-0.165=0.000
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.001
σ0.002-0.004=-0.002
min21.141-21.139=0.001
max21.146-21.152=-0.006
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.064-0.062=0.002
σ0.003-0.004=-0.001
min0.062-0.058=0.004
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.200-1752.197=0.002
σ0.360-0.360=0.000
min1751.633-1751.629=0.004
max1752.784-1752.770=0.014
mean1650.550-1649.650=0.900
σ632.868-646.424=-13.556
min643.000-642.000=1.000
max2851.000-2849.000=2.000
mean2.808-2.802=0.006
σ0.130-0.124=0.006
min2.524-2.548=-0.024
max3.052-3.069=-0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.927-269.931=-0.004
σ0.008-0.005=0.003
min269.918-269.922=-0.004
max269.940-269.935=0.004
mean2851.000-2849.000=2.000
σ0.000
min2851.000-2849.000=2.000
max2851.000-2849.000=2.000
mean0.371-0.375=-0.003
σ0.004-0.007=-0.003
min0.369-0.369=0.000
max0.379-0.385=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1930.402-1930.394=0.008
σ0.007-0.009=-0.001
min1930.396-1930.380=0.016
max1930.414-1930.402=0.012
mean2851.000-2849.000=2.000
σ0.000
min2851.000-2849.000=2.000
max2851.000-2849.000=2.000
mean2.513-2.485=0.028
σ0.074-0.054=0.020
min2.452-2.443=0.008
max2.639-2.574=0.065
iters=5
new-facts=6402
prior-facts=1
mean4750.863-4750.857=0.006
σ0.892-0.892=0.000
min4750.310-4750.304=0.006
max4752.451-4752.444=0.007
mean2851.000-2849.000=2.000
σ0.000
min2851.000-2849.000=2.000
max2851.000-2849.000=2.000
mean8.696-8.426=0.270
σ0.599-0.782=-0.183
min7.641-7.530=0.111
max9.078-9.182=-0.104
iters=5
new-facts=6402
prior-facts=6402
mean4941.332-4941.329=0.004
σ0.089-0.084=0.005
min4941.262-4941.265=-0.002
max4941.435-4941.429=0.006
mean3049.600-3053.200=-3.600
σ201.604-221.266=-19.662
min2851.000-2849.000=2.000
max3326.000-3384.000=-58.000
mean8.477-8.577=-0.100
σ0.204-0.127=0.078
min8.323-8.417=-0.094
max8.808-8.751=0.057

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.049-1.058=-0.009
σ0.128-0.211=-0.084
min0.932-0.928=0.004
max1.243-1.422=-0.178

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.911-465.914=-0.003
σ575.756-575.761=-0.005
min178.028-178.026=0.002
max1329.545-1329.556=-0.011
mean81.750
σ7.500
min78.000
max93.000
mean2851.000-2849.000=2.000
σ0.000
min2851.000-2849.000=2.000
max2851.000-2849.000=2.000
mean0.443-0.461=-0.018
σ0.307-0.351=-0.044
min0.287-0.284=0.003
max0.904-0.988=-0.085
policies=20
mean1780.489-1780.480=0.010
σ0.358-0.355=0.002
min1780.230-1780.227=0.003
max1781.014-1781.001=0.013
mean780.000
σ0.000
min780.000
max780.000
mean2851.000-2849.000=2.000
σ0.000
min2851.000-2849.000=2.000
max2851.000-2849.000=2.000
mean2.846-2.847=-0.001
σ0.008-0.011=-0.003
min2.837-2.836=0.001
max2.852-2.856=-0.004
policies=200
mean17811.270-17811.390=-0.120
σ0.550-0.466=0.084
min17810.903-17811.092=-0.188
max17812.083-17812.084=-0.002
mean7800.000
σ0.000
min7800.000
max7800.000
mean2851.000-2849.000=2.000
σ0.000
min2851.000-2849.000=2.000
max2851.000-2849.000=2.000
mean28.266-28.258=0.009
σ0.470-0.458=0.013
min27.762-27.805=-0.043
max28.679-28.740=-0.061