Compare commits

Home / Compare 8822d9d0 .. 60b59342

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.972-53.972=0.000
σ0.365-0.365=-0.000
min53.838-53.828=0.010
max55.010-55.010=-0.000
mean415.800-413.000=2.800
σ0.422-0.000=0.422
min415.000-413.000=2.000
max416.000-413.000=3.000
mean0.139-0.139=-0.000
σ0.004-0.004=0.000
min0.136-0.135=0.001
max0.145-0.145=0.000
cache=y
dps=1
iters=10
policies=100
mean43.177-43.177=-0.000
σ0.006-0.007=-0.001
min43.164-43.167=-0.003
max43.183-43.188=-0.004
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.121-0.121=0.000
σ0.003-0.003=-0.001
min0.119-0.118=0.001
max0.127-0.127=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean994.836-994.842=-0.006
σ1.248-1.229=0.019
min994.292-994.264=0.028
max1000.091-1000.009=0.082
mean1064.050-1059.750=4.300
σ321.498-313.772=7.726
min570.000-600.000=-30.000
max1624.000-1561.000=63.000
mean1.476-1.471=0.005
σ0.099-0.080=0.019
min1.263-1.408=-0.146
max1.657-1.767=-0.110

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.290-297.294=-0.004
σ0.013-0.007=0.006
min297.275-297.284=-0.009
max297.307-297.304=0.002
mean1624.000-1561.000=63.000
σ0.000
min1624.000-1561.000=63.000
max1624.000-1561.000=63.000
mean0.389-0.387=0.002
σ0.007-0.006=0.001
min0.381-0.382=-0.001
max0.397-0.397=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1298.541-1298.523=0.018
σ0.134-0.091=0.043
min1298.475-1298.474=0.001
max1298.780-1298.686=0.094
mean1624.000-1561.000=63.000
σ0.000
min1624.000-1561.000=63.000
max1624.000-1561.000=63.000
mean1.936-1.911=0.025
σ0.064-0.067=-0.003
min1.859-1.823=0.036
max2.003-2.002=0.001
iters=5
new-facts=6402
prior-facts=1
mean1820.759-1820.767=-0.008
σ7.032-7.053=-0.021
min1817.366-1817.372=-0.005
max1833.323-1833.369=-0.045
mean1624.000-1561.000=63.000
σ0.000
min1624.000-1561.000=63.000
max1624.000-1561.000=63.000
mean4.104-4.176=-0.073
σ0.177-0.268=-0.091
min3.840-3.851=-0.011
max4.259-4.575=-0.316
iters=5
new-facts=6402
prior-facts=6402
mean2083.378-2083.372=0.006
σ0.007-0.024=-0.016
min2083.366-2083.335=0.031
max2083.384-2083.396=-0.012
mean1849.600-1769.600=80.000
σ200.131-188.194=11.937
min1624.000-1561.000=63.000
max2080.000-2027.000=53.000
mean4.605-4.731=-0.126
σ0.160-0.402=-0.241
min4.477-4.384=0.093
max4.859-5.389=-0.530

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.302-1.345=-0.042
σ0.351-0.443=-0.092
min0.905-0.936=-0.031
max1.812-1.838=-0.026

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.382-440.377=0.005
σ572.875-572.881=-0.005
min153.935-153.929=0.006
max1299.694-1299.697=-0.003
mean94.250
σ8.500
min90.000
max107.000
mean1624.000-1561.000=63.000
σ0.000
min1624.000-1561.000=63.000
max1624.000-1561.000=63.000
mean0.545-0.553=-0.009
σ0.551-0.569=-0.017
min0.267-0.266=0.001
max1.372-1.406=-0.034
policies=20
mean1539.590-1539.583=0.006
σ0.305-0.305=-0.000
min1539.396-1539.396=0.001
max1540.044-1540.037=0.007
mean900.000
σ0.000
min900.000
max900.000
mean1624.000-1561.000=63.000
σ0.000
min1624.000-1561.000=63.000
max1624.000-1561.000=63.000
mean2.566-2.573=-0.007
σ0.039-0.010=0.029
min2.531-2.561=-0.030
max2.619-2.584=0.035
policies=200
mean15403.810-15403.876=-0.066
σ0.117-0.213=-0.096
min15403.666-15403.557=0.109
max15403.950-15403.997=-0.047
mean9000.000
σ0.000
min9000.000
max9000.000
mean1624.000-1561.000=63.000
σ0.000
min1624.000-1561.000=63.000
max1624.000-1561.000=63.000
mean25.881-25.945=-0.063
σ0.181-0.213=-0.032
min25.699-25.706=-0.007
max26.092-26.159=-0.067