Compare commits

Home / Compare 2e9d8ed5 .. 9c2699b8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.731=0.051
σ0.045-0.052=-0.007
min70.754-70.700=0.054
max70.907-70.876=0.031
mean413.000
σ0.000
min413.000
max413.000
mean0.160-0.162=-0.002
σ0.003-0.004=-0.001
min0.157-0.158=-0.002
max0.166-0.171=-0.005
cache=y
dps=1
iters=10
policies=100
mean21.492-21.446=0.047
σ0.003-0.002=0.001
min21.487-21.444=0.044
max21.496-21.450=0.046
mean413.000
σ0.000
min413.000
max413.000
mean0.063-0.064=-0.001
σ0.004-0.003=0.001
min0.058-0.060=-0.002
max0.071-0.070=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.092-1755.286=-1.194
σ0.361-0.359=0.002
min1753.530-1754.717=-1.187
max1754.676-1755.864=-1.188
mean1664.850-1657.350=7.500
σ627.510-647.133=-19.622
min667.000-627.000=40.000
max2666.000-2857.000=-191.000
mean2.825-2.838=-0.013
σ0.154-0.109=0.044
min2.334-2.494=-0.160
max3.053-2.974=0.080

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.958-274.367=-2.408
σ0.008-0.007=0.001
min271.947-274.361=-2.413
max271.966-274.379=-2.413
mean2666.000-2857.000=-191.000
σ0.000
min2666.000-2857.000=-191.000
max2666.000-2857.000=-191.000
mean0.383-0.389=-0.005
σ0.006-0.005=0.001
min0.379-0.384=-0.005
max0.393-0.396=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.316-1934.751=-2.436
σ0.007-0.020=-0.014
min1932.305-1934.725=-2.420
max1932.323-1934.779=-2.455
mean2666.000-2857.000=-191.000
σ0.000
min2666.000-2857.000=-191.000
max2666.000-2857.000=-191.000
mean3.007-3.071=-0.064
σ0.080-0.108=-0.027
min2.937-2.965=-0.027
max3.141-3.237=-0.096
iters=5
new-facts=6402
prior-facts=1
mean4753.059-4755.513=-2.455
σ0.938-0.950=-0.012
min4752.599-4754.993=-2.395
max4754.735-4757.208=-2.473
mean2666.000-2857.000=-191.000
σ0.000
min2666.000-2857.000=-191.000
max2666.000-2857.000=-191.000
mean8.698-8.650=0.048
σ0.486-0.530=-0.043
min7.909-7.872=0.036
max9.072-9.316=-0.244
iters=5
new-facts=6402
prior-facts=6402
mean4943.555-4945.988=-2.433
σ0.011-0.019=-0.008
min4943.540-4945.971=-2.431
max4943.565-4946.013=-2.448
mean2968.400-3019.400=-51.000
σ240.111-183.768=56.343
min2666.000-2857.000=-191.000
max3291.000-3305.000=-14.000
mean8.465-8.506=-0.041
σ0.043-0.111=-0.068
min8.419-8.327=0.092
max8.527-8.590=-0.063

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.092-1.027=0.065
σ0.165-0.137=0.028
min0.933-0.937=-0.003
max1.275-1.255=0.020

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.657-472.847=-4.190
σ574.932-574.923=0.010
min181.186-185.372=-4.186
max1331.056-1335.231=-4.175
mean88.250
σ8.500
min84.000
max101.000
mean2666.000-2857.000=-191.000
σ0.000
min2666.000-2857.000=-191.000
max2666.000-2857.000=-191.000
mean0.562-0.447=0.115
σ0.549-0.299=0.249
min0.286-0.295=-0.008
max1.385-0.896=0.489
policies=20
mean1812.179-1854.043=-41.864
σ0.386-0.376=0.010
min1811.915-1853.760=-41.845
max1812.746-1854.587=-41.841
mean840.000
σ0.000
min840.000
max840.000
mean2666.000-2857.000=-191.000
σ0.000
min2666.000-2857.000=-191.000
max2666.000-2857.000=-191.000
mean2.865-2.966=-0.101
σ0.021-0.021=0.000
min2.836-2.940=-0.104
max2.884-2.988=-0.104
policies=200
mean18129.112-18546.713=-417.601
σ0.517-0.495=0.022
min18128.714-18546.346=-417.632
max18129.871-18547.423=-417.552
mean8400.000
σ0.000
min8400.000
max8400.000
mean2666.000-2857.000=-191.000
σ0.000
min2666.000-2857.000=-191.000
max2666.000-2857.000=-191.000
mean28.567-29.251=-0.684
σ0.094-0.498=-0.404
min28.461-28.786=-0.325
max28.688-29.714=-1.026