Compare commits

Home / Compare 9f7e1f9b .. 68a06883

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.781=0.001
σ0.046-0.046=0.000
min70.755-70.747=0.008
max70.911-70.908=0.003
mean413.500-416.000=-2.500
σ0.527-0.000=0.527
min413.000-416.000=-3.000
max414.000-416.000=-2.000
mean0.161-0.160=0.001
σ0.003-0.004=-0.001
min0.157-0.156=0.001
max0.166-0.167=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.492-21.492=0.000
σ0.002-0.003=-0.001
min21.489-21.489=0.000
max21.495-21.498=-0.003
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.065-0.064=0.001
σ0.003-0.002=0.002
min0.063-0.063=-0.000
max0.073-0.068=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.093-1754.093=-0.000
σ0.362-0.361=0.001
min1753.530-1753.524=0.006
max1754.678-1754.672=0.006
mean1649.200-1658.950=-9.750
σ609.632-631.532=-21.900
min643.000-625.000=18.000
max2468.000-2772.000=-304.000
mean2.777-2.800=-0.023
σ0.208-0.181=0.027
min2.170-2.232=-0.062
max3.017-3.143=-0.126

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.924-271.949=-0.025
σ0.006-0.003=0.003
min271.917-271.943=-0.026
max271.932-271.952=-0.021
mean2468.000-2772.000=-304.000
σ0.000
min2468.000-2772.000=-304.000
max2468.000-2772.000=-304.000
mean0.381-0.379=0.003
σ0.006-0.001=0.005
min0.377-0.378=-0.001
max0.392-0.380=0.012
iters=5
new-facts=1
prior-facts=6402
mean1932.319-1932.321=-0.002
σ0.014-0.007=0.007
min1932.295-1932.310=-0.015
max1932.329-1932.327=0.002
mean2468.000-2772.000=-304.000
σ0.000
min2468.000-2772.000=-304.000
max2468.000-2772.000=-304.000
mean3.005-3.112=-0.107
σ0.101-0.131=-0.030
min2.890-3.008=-0.118
max3.154-3.260=-0.106
iters=5
new-facts=6402
prior-facts=1
mean4753.071-4752.975=0.096
σ0.976-0.995=-0.018
min4752.574-4752.049=0.526
max4754.814-4754.669=0.146
mean2468.000-2772.000=-304.000
σ0.000
min2468.000-2772.000=-304.000
max2468.000-2772.000=-304.000
mean8.797-8.367=0.430
σ0.641-0.593=0.048
min7.874-7.640=0.234
max9.573-8.994=0.578
iters=5
new-facts=6402
prior-facts=6402
mean4943.559-4943.560=-0.001
σ0.019-0.014=0.005
min4943.535-4943.545=-0.010
max4943.576-4943.576=-0.000
mean2953.800-3037.400=-83.600
σ277.993-308.841=-30.848
min2581.000-2772.000=-191.000
max3314.000-3493.000=-179.000
mean8.469-8.489=-0.020
σ0.071-0.152=-0.081
min8.394-8.346=0.048
max8.555-8.671=-0.115

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.769-1.038=0.731
σ0.130-0.128=0.002
min1.576-0.923=0.652
max1.896-1.239=0.657

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.651-468.661=-0.010
σ574.922-574.926=-0.003
min181.188-181.192=-0.004
max1331.034-1331.049=-0.015
mean88.250
σ8.500
min84.000
max101.000
mean2468.000-2772.000=-304.000
σ0.000
min2468.000-2772.000=-304.000
max2468.000-2772.000=-304.000
mean0.563-0.448=0.115
σ0.554-0.301=0.252
min0.285-0.295=-0.010
max1.393-0.900=0.493
policies=20
mean1812.201-1812.214=-0.013
σ0.383-0.372=0.010
min1811.946-1811.941=0.005
max1812.765-1812.755=0.009
mean840.000
σ0.000
min840.000
max840.000
mean2468.000-2772.000=-304.000
σ0.000
min2468.000-2772.000=-304.000
max2468.000-2772.000=-304.000
mean2.832-2.928=-0.097
σ0.031-0.142=-0.111
min2.789-2.820=-0.031
max2.858-3.126=-0.268
policies=200
mean18129.213-18129.058=0.154
σ0.490-0.449=0.041
min18128.924-18128.687=0.238
max18129.945-18129.710=0.235
mean8400.000
σ0.000
min8400.000
max8400.000
mean2468.000-2772.000=-304.000
σ0.000
min2468.000-2772.000=-304.000
max2468.000-2772.000=-304.000
mean28.517-28.576=-0.060
σ0.019-0.116=-0.097
min28.489-28.495=-0.006
max28.533-28.747=-0.214