Compare commits

Home / Compare 7236627e .. 6fbc3b4d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.777=0.005
σ0.047-0.047=-0.000
min70.755-70.747=0.008
max70.912-70.907=0.005
mean413.000
σ0.000
min413.000
max413.000
mean0.161-0.161=-0.001
σ0.004-0.003=0.000
min0.156-0.158=-0.002
max0.167-0.168=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.491-21.490=0.001
σ0.003-0.002=0.001
min21.488-21.487=0.001
max21.497-21.494=0.003
mean413.000
σ0.000
min413.000
max413.000
mean0.063-0.066=-0.003
σ0.003-0.002=0.001
min0.060-0.065=-0.005
max0.068-0.073=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.854-1758.259=-3.405
σ0.360-0.363=-0.003
min1754.289-1757.689=-3.400
max1755.452-1758.843=-3.391
mean1650.900-1673.950=-23.050
σ636.314-630.867=5.447
min628.000-678.000=-50.000
max2769.000-2668.000=101.000
mean2.845-2.842=0.003
σ0.210-0.210=0.000
min2.332-2.326=0.006
max3.351-3.126=0.225

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.360-275.733=-3.373
σ0.006-0.009=-0.003
min272.354-275.721=-3.368
max272.366-275.744=-3.379
mean2769.000-2668.000=101.000
σ0.000
min2769.000-2668.000=101.000
max2769.000-2668.000=101.000
mean0.385-0.381=0.004
σ0.006-0.004=0.002
min0.379-0.377=0.002
max0.394-0.388=0.006
iters=5
new-facts=1
prior-facts=6402
mean1932.729-1936.130=-3.400
σ0.013-0.016=-0.002
min1932.714-1936.115=-3.401
max1932.747-1936.149=-3.401
mean2769.000-2668.000=101.000
σ0.000
min2769.000-2668.000=101.000
max2769.000-2668.000=101.000
mean3.064-3.035=0.029
σ0.070-0.138=-0.068
min2.996-2.811=0.184
max3.156-3.154=0.002
iters=5
new-facts=6402
prior-facts=1
mean4753.438-4756.927=-3.490
σ0.922-0.824=0.098
min4752.692-4756.399=-3.707
max4755.043-4758.391=-3.348
mean2769.000-2668.000=101.000
σ0.000
min2769.000-2668.000=101.000
max2769.000-2668.000=101.000
mean8.251-8.197=0.053
σ0.441-0.537=-0.096
min7.594-7.729=-0.136
max8.570-9.060=-0.489
iters=5
new-facts=6402
prior-facts=6402
mean4943.965-4947.284=-3.320
σ0.021-0.151=-0.130
min4943.942-4947.015=-3.073
max4943.986-4947.364=-3.378
mean2993.600-2981.600=12.000
σ216.103-341.816=-125.714
min2769.000-2668.000=101.000
max3306.000-3460.000=-154.000
mean8.488-8.547=-0.059
σ0.046-0.219=-0.173
min8.433-8.344=0.089
max8.553-8.885=-0.332

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.053-1.096=-0.042
σ0.127-0.154=-0.027
min0.934-0.944=-0.009
max1.244-1.254=-0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.641-478.789=-10.147
σ574.922-574.931=-0.009
min181.175-191.314=-10.139
max1331.024-1341.185=-10.161
mean88.250-90.250=-2.000
σ8.500
min84.000-86.000=-2.000
max101.000-103.000=-2.000
mean2769.000-2668.000=101.000
σ0.000
min2769.000-2668.000=101.000
max2769.000-2668.000=101.000
mean0.493-0.606=-0.113
σ0.287-0.610=-0.323
min0.288-0.300=-0.012
max0.907-1.521=-0.615
policies=20
mean1811.964-1913.439=-101.475
σ0.364-0.391=-0.027
min1811.679-1913.149=-101.470
max1812.494-1914.005=-101.511
mean840.000-860.000=-20.000
σ0.000
min840.000-860.000=-20.000
max840.000-860.000=-20.000
mean2769.000-2668.000=101.000
σ0.000
min2769.000-2668.000=101.000
max2769.000-2668.000=101.000
mean2.837-3.001=-0.164
σ0.015-0.026=-0.010
min2.816-2.975=-0.160
max2.851-3.036=-0.185
policies=200
mean18126.683-19141.024=-1014.341
σ0.471-0.339=0.132
min18126.381-19140.783=-1014.402
max18127.386-19141.527=-1014.141
mean8400.000-8600.000=-200.000
σ0.000
min8400.000-8600.000=-200.000
max8400.000-8600.000=-200.000
mean2769.000-2668.000=101.000
σ0.000
min2769.000-2668.000=101.000
max2769.000-2668.000=101.000
mean28.546-30.111=-1.566
σ0.043-0.093=-0.050
min28.512-29.993=-1.481
max28.604-30.196=-1.592