Compare commits

Home / Compare d844af69 .. f0290b4d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.781=0.001
σ0.055-0.055=-0.001
min70.745-70.747=-0.003
max70.935-70.935=-0.000
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.161-0.160=0.001
σ0.004-0.003=0.001
min0.155-0.155=0.000
max0.170-0.165=0.005
cache=y
dps=1
iters=10
policies=100
mean21.494-21.494=-0.000
σ0.004-0.002=0.001
min21.491-21.491=0.000
max21.502-21.498=0.004
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.065-0.065=-0.000
σ0.002-0.003=-0.000
min0.064-0.063=0.001
max0.072-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.121-1751.122=-0.001
σ0.359-0.361=-0.002
min1750.546-1750.551=-0.005
max1751.705-1751.703=0.002
mean1638.550-1641.800=-3.250
σ626.253-630.041=-3.788
min626.000-622.000=4.000
max2793.000-2768.000=25.000
mean2.810-2.819=-0.008
σ0.175-0.141=0.035
min2.155-2.440=-0.285
max2.986-3.050=-0.064

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean268.620-268.618=0.001
σ0.005-0.005=-0.001
min268.613-268.611=0.002
max268.624-268.624=0.000
mean2793.000-2768.000=25.000
σ0.000
min2793.000-2768.000=25.000
max2793.000-2768.000=25.000
mean0.376-0.376=-0.001
σ0.005-0.004=0.001
min0.371-0.374=-0.003
max0.382-0.384=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1929.006-1929.012=-0.006
σ0.020-0.020=-0.001
min1928.987-1928.985=0.003
max1929.032-1929.033=-0.001
mean2793.000-2768.000=25.000
σ0.000
min2793.000-2768.000=25.000
max2793.000-2768.000=25.000
mean2.557-2.560=-0.002
σ0.155-0.148=0.007
min2.384-2.415=-0.032
max2.748-2.758=-0.009
iters=5
new-facts=6402
prior-facts=1
mean4749.735-4749.759=-0.024
σ0.862-0.807=0.055
min4749.224-4749.277=-0.053
max4751.270-4751.195=0.074
mean2793.000-2768.000=25.000
σ0.000
min2793.000-2768.000=25.000
max2793.000-2768.000=25.000
mean8.732-8.326=0.406
σ0.352-0.477=-0.126
min8.342-7.699=0.643
max9.164-8.928=0.236
iters=5
new-facts=6402
prior-facts=6402
mean4940.223-4940.229=-0.006
σ0.016-0.017=-0.001
min4940.205-4940.208=-0.002
max4940.240-4940.245=-0.005
mean2994.800-2982.200=12.600
σ263.962-247.429=16.533
min2793.000-2768.000=25.000
max3413.000-3373.000=40.000
mean8.414-8.382=0.032
σ0.043-0.064=-0.021
min8.365-8.301=0.064
max8.460-8.460=-0.000

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.997-1.022=-0.025
σ0.140-0.139=0.001
min0.927-0.930=-0.003
max1.247-1.252=-0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.712-462.699=0.013
σ574.956-574.923=0.033
min175.226-175.222=0.005
max1325.146-1325.083=0.063
mean86.250
σ8.500
min82.000
max99.000
mean2793.000-2768.000=25.000
σ0.000
min2793.000-2768.000=25.000
max2793.000-2768.000=25.000
mean0.478-0.439=0.039
σ0.404-0.305=0.100
min0.274-0.285=-0.011
max1.084-0.896=0.188
policies=20
mean1752.482-1752.543=-0.061
σ0.350-0.373=-0.023
min1752.279-1752.311=-0.032
max1753.007-1753.101=-0.094
mean820.000
σ0.000
min820.000
max820.000
mean2793.000-2768.000=25.000
σ0.000
min2793.000-2768.000=25.000
max2793.000-2768.000=25.000
mean2.718-2.808=-0.090
σ0.011-0.089=-0.078
min2.706-2.722=-0.016
max2.733-2.928=-0.195
policies=200
mean17532.194-17532.186=0.008
σ0.577-0.437=0.140
min17531.810-17531.839=-0.029
max17533.053-17532.820=0.233
mean8200.000
σ0.000
min8200.000
max8200.000
mean2793.000-2768.000=25.000
σ0.000
min2793.000-2768.000=25.000
max2793.000-2768.000=25.000
mean27.475-27.577=-0.102
σ0.113-0.102=0.011
min27.344-27.500=-0.156
max27.584-27.725=-0.141