Compare commits

Home / Compare e0eea404 .. d8d65c03

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.780-70.779=0.001
σ0.051-0.053=-0.001
min70.746-70.750=-0.004
max70.921-70.926=-0.004
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.157-0.162=-0.004
σ0.005-0.004=0.001
min0.151-0.159=-0.007
max0.164-0.168=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=0.000
σ0.003-0.004=-0.000
min21.489-21.488=0.001
max21.500-21.497=0.002
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.065-0.065=0.000
σ0.003-0.003=-0.000
min0.064-0.063=0.001
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.881-1751.880=0.000
σ0.362-0.361=0.000
min1751.307-1751.305=0.002
max1752.462-1752.452=0.010
mean1656.050-1650.100=5.950
σ627.736-638.231=-10.495
min679.000-625.000=54.000
max2663.000-2854.000=-191.000
mean2.832-2.813=0.018
σ0.161-0.179=-0.018
min2.471-2.319=0.152
max3.066-2.980=0.086

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.375-269.376=-0.001
σ0.004-0.008=-0.004
min269.370-269.366=0.004
max269.380-269.388=-0.008
mean2663.000-2854.000=-191.000
σ0.000
min2663.000-2854.000=-191.000
max2663.000-2854.000=-191.000
mean0.377-0.376=0.001
σ0.003-0.005=-0.002
min0.374-0.372=0.002
max0.382-0.385=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1929.746-1929.744=0.002
σ0.015-0.019=-0.004
min1929.726-1929.715=0.011
max1929.763-1929.762=0.000
mean2663.000-2854.000=-191.000
σ0.000
min2663.000-2854.000=-191.000
max2663.000-2854.000=-191.000
mean3.023-3.123=-0.100
σ0.068-0.145=-0.077
min2.955-3.009=-0.054
max3.136-3.363=-0.227
iters=5
new-facts=6402
prior-facts=1
mean4750.517-4750.386=0.132
σ0.850-0.960=-0.110
min4750.056-4749.526=0.530
max4752.030-4752.026=0.004
mean2663.000-2854.000=-191.000
σ0.000
min2663.000-2854.000=-191.000
max2663.000-2854.000=-191.000
mean8.415-8.731=-0.316
σ0.461-0.533=-0.072
min7.627-8.098=-0.470
max8.814-9.540=-0.726
iters=5
new-facts=6402
prior-facts=6402
mean4940.984-4940.980=0.004
σ0.015-0.020=-0.006
min4940.967-4940.955=0.013
max4941.002-4941.001=0.001
mean2959.800-3075.000=-115.200
σ328.062-297.157=30.906
min2663.000-2854.000=-191.000
max3428.000-3534.000=-106.000
mean8.364-8.409=-0.045
σ0.046-0.113=-0.066
min8.293-8.335=-0.042
max8.418-8.608=-0.189

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.143-1.022=0.120
σ0.197-0.138=0.059
min0.935-0.928=0.007
max1.448-1.246=0.202

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.066-466.064=0.002
σ574.949-574.923=0.026
min178.590-178.595=-0.005
max1328.489-1328.449=0.040
mean86.250
σ8.500
min82.000
max99.000
mean2663.000-2854.000=-191.000
σ0.000
min2663.000-2854.000=-191.000
max2663.000-2854.000=-191.000
mean0.564-0.477=0.087
σ0.558-0.376=0.182
min0.281-0.279=0.002
max1.400-1.040=0.361
policies=20
mean1786.123-1786.173=-0.050
σ0.346-0.367=-0.021
min1785.919-1785.909=0.010
max1786.641-1786.713=-0.072
mean820.000
σ0.000
min820.000
max820.000
mean2663.000-2854.000=-191.000
σ0.000
min2663.000-2854.000=-191.000
max2663.000-2854.000=-191.000
mean2.769-2.856=-0.087
σ0.017-0.012=0.005
min2.751-2.845=-0.095
max2.791-2.872=-0.082
policies=200
mean17868.386-17868.556=-0.170
σ0.576-0.548=0.027
min17867.950-17868.197=-0.247
max17869.217-17869.368=-0.151
mean8200.000
σ0.000
min8200.000
max8200.000
mean2663.000-2854.000=-191.000
σ0.000
min2663.000-2854.000=-191.000
max2663.000-2854.000=-191.000
mean27.869-28.428=-0.559
σ0.026-0.471=-0.444
min27.848-27.879=-0.032
max27.907-28.843=-0.936