Compare commits

Home / Compare 3a0326cb .. 6a240738

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.733=0.047
σ0.052-0.046=0.006
min70.751-70.700=0.051
max70.926-70.861=0.065
mean415.600-416.000=-0.400
σ0.516-0.000=0.516
min415.000-416.000=-1.000
max416.000
mean0.159-0.156=0.002
σ0.006-0.004=0.002
min0.151-0.150=0.001
max0.171-0.165=0.007
cache=y
dps=1
iters=10
policies=100
mean21.493-21.445=0.048
σ0.003-0.003=0.001
min21.488-21.440=0.049
max21.497-21.448=0.049
mean416.000
σ0.000
min416.000
max416.000
mean0.063-0.065=-0.001
σ0.004-0.002=0.002
min0.059-0.063=-0.004
max0.070-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.882-1754.527=-2.645
σ0.362-0.363=-0.001
min1751.309-1753.953=-2.643
max1752.469-1755.117=-2.647
mean1665.700-1659.650=6.050
σ637.804-638.362=-0.558
min679.000-641.000=38.000
max2693.000-2837.000=-144.000
mean2.796-2.771=0.025
σ0.179-0.221=-0.042
min2.251-2.157=0.094
max3.031-3.042=-0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.379-273.611=-4.232
σ0.007-0.007=-0.000
min269.370-273.600=-4.229
max269.386-273.617=-4.231
mean2693.000-2837.000=-144.000
σ0.000
min2693.000-2837.000=-144.000
max2693.000-2837.000=-144.000
mean0.377-0.384=-0.007
σ0.004-0.007=-0.003
min0.374-0.380=-0.007
max0.383-0.396=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1929.751-1934.003=-4.253
σ0.006-0.011=-0.005
min1929.745-1933.996=-4.251
max1929.761-1934.023=-4.262
mean2693.000-2837.000=-144.000
σ0.000
min2693.000-2837.000=-144.000
max2693.000-2837.000=-144.000
mean3.063-3.077=-0.014
σ0.069-0.278=-0.209
min3.000-2.780=0.220
max3.167-3.527=-0.361
iters=5
new-facts=6402
prior-facts=1
mean4750.519-4754.761=-4.242
σ0.866-0.819=0.047
min4749.975-4754.301=-4.325
max4752.051-4756.217=-4.166
mean2693.000-2837.000=-144.000
σ0.000
min2693.000-2837.000=-144.000
max2693.000-2837.000=-144.000
mean8.675-8.449=0.225
σ0.682-0.501=0.181
min7.892-7.639=0.253
max9.761-8.923=0.838
iters=5
new-facts=6402
prior-facts=6402
mean4940.988-4945.140=-4.153
σ0.013-0.175=-0.162
min4940.970-4944.831=-3.861
max4940.998-4945.254=-4.256
mean3034.200-3047.200=-13.000
σ281.615-225.900=55.716
min2693.000-2837.000=-144.000
max3411.000-3382.000=29.000
mean8.584-8.623=-0.039
σ0.187-0.253=-0.066
min8.395-8.294=0.101
max8.840-8.938=-0.098

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.067-1.005=0.062
σ0.140-0.142=-0.002
min0.927-0.935=-0.008
max1.237-1.259=-0.022

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.726-472.865=-10.138
σ574.936-574.930=0.006
min175.249-185.393=-10.144
max1325.131-1335.260=-10.129
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2693.000-2837.000=-144.000
σ0.000
min2693.000-2837.000=-144.000
max2693.000-2837.000=-144.000
mean0.554-0.486=0.068
σ0.545-0.375=0.170
min0.276-0.296=-0.021
max1.372-1.049=0.322
policies=20
mean1752.726-1854.272=-101.546
σ0.354-0.371=-0.017
min1752.519-1854.003=-101.484
max1753.257-1854.814=-101.557
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2693.000-2837.000=-144.000
σ0.000
min2693.000-2837.000=-144.000
max2693.000-2837.000=-144.000
mean2.730-2.945=-0.214
σ0.017-0.014=0.003
min2.707-2.931=-0.224
max2.745-2.964=-0.219
policies=200
mean17534.670-18549.181=-1014.511
σ0.591-0.488=0.103
min17534.277-18548.888=-1014.611
max17535.540-18549.908=-1014.368
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2693.000-2837.000=-144.000
σ0.000
min2693.000-2837.000=-144.000
max2693.000-2837.000=-144.000
mean27.499-29.250=-1.751
σ0.124-0.452=-0.328
min27.413-28.823=-1.411
max27.678-29.795=-2.117