Compare commits

Home / Compare 04b0cc93 .. 7a70ae90

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.731-70.734=-0.003
σ0.046-0.046=0.000
min70.707-70.703=0.004
max70.860-70.859=0.001
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.160-0.161=-0.001
σ0.004-0.003=0.001
min0.154-0.157=-0.003
max0.168-0.168=0.000
cache=y
dps=1
iters=10
policies=100
mean21.465-21.465=-0.000
σ0.003-0.004=-0.000
min21.460-21.461=-0.001
max21.471-21.471=-0.000
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.063-0.065=-0.002
σ0.004-0.002=0.001
min0.060-0.063=-0.003
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.459-1754.459=0.000
σ0.360-0.361=-0.001
min1753.889-1753.885=0.004
max1755.044-1755.031=0.013
mean1651.100-1642.600=8.500
σ621.234-627.566=-6.332
min632.000-624.000=8.000
max2647.000-2854.000=-207.000
mean2.823-2.806=0.018
σ0.245-0.097=0.148
min2.136-2.606=-0.470
max3.181-2.941=0.240

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.498-273.500=-0.002
σ0.006-0.009=-0.003
min273.493-273.489=0.004
max273.508-273.512=-0.004
mean2647.000-2854.000=-207.000
σ0.000
min2647.000-2854.000=-207.000
max2647.000-2854.000=-207.000
mean0.383-0.377=0.006
σ0.005-0.005=-0.000
min0.380-0.373=0.007
max0.391-0.386=0.006
iters=5
new-facts=1
prior-facts=6402
mean1933.893-1933.896=-0.004
σ0.005-0.014=-0.009
min1933.886-1933.880=0.007
max1933.899-1933.914=-0.016
mean2647.000-2854.000=-207.000
σ0.000
min2647.000-2854.000=-207.000
max2647.000-2854.000=-207.000
mean2.967-2.937=0.030
σ0.212-0.142=0.070
min2.698-2.717=-0.019
max3.192-3.067=0.125
iters=5
new-facts=6402
prior-facts=1
mean4754.406-4754.713=-0.307
σ0.757-0.812=-0.055
min4753.616-4754.252=-0.637
max4755.661-4756.161=-0.499
mean2647.000-2854.000=-207.000
σ0.000
min2647.000-2854.000=-207.000
max2647.000-2854.000=-207.000
mean8.705-8.263=0.442
σ0.280-0.392=-0.111
min8.379-7.822=0.557
max8.963-8.704=0.259
iters=5
new-facts=6402
prior-facts=6402
mean4945.121-4945.042=0.079
σ0.014-0.166=-0.152
min4945.105-4944.745=0.360
max4945.136-4945.124=0.013
mean3008.400-3063.400=-55.000
σ265.586-285.895=-20.309
min2647.000-2854.000=-207.000
max3306.000-3509.000=-203.000
mean8.576-8.446=0.129
σ0.160-0.136=0.024
min8.402-8.362=0.040
max8.735-8.680=0.055

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.169-1.065=0.104
σ0.376-0.133=0.243
min0.928-0.945=-0.017
max1.799-1.267=0.532

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.572-472.572=-0.000
σ574.949-574.926=0.023
min185.093-185.103=-0.010
max1334.995-1334.961=0.034
mean88.250
σ8.500
min84.000
max101.000
mean2647.000-2854.000=-207.000
σ0.000
min2647.000-2854.000=-207.000
max2647.000-2854.000=-207.000
mean0.568-0.451=0.117
σ0.559-0.306=0.253
min0.287-0.297=-0.010
max1.406-0.910=0.496
policies=20
mean1851.239-1851.298=-0.059
σ0.373-0.368=0.004
min1850.989-1851.033=-0.044
max1851.790-1851.834=-0.044
mean840.000
σ0.000
min840.000
max840.000
mean2647.000-2854.000=-207.000
σ0.000
min2647.000-2854.000=-207.000
max2647.000-2854.000=-207.000
mean2.849-2.949=-0.099
σ0.010-0.019=-0.009
min2.843-2.935=-0.093
max2.864-2.976=-0.112
policies=200
mean18519.353-18519.361=-0.008
σ0.395-0.543=-0.147
min18519.009-18518.882=0.128
max18519.918-18520.101=-0.183
mean8400.000
σ0.000
min8400.000
max8400.000
mean2647.000-2854.000=-207.000
σ0.000
min2647.000-2854.000=-207.000
max2647.000-2854.000=-207.000
mean28.868-29.178=-0.310
σ0.043-0.392=-0.350
min28.813-28.958=-0.145
max28.916-29.766=-0.850