Compare commits

Home / Compare 5458ca12 .. 5f77be88

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.648-53.648=0.001
σ0.367-0.367=0.000
min53.517-53.518=-0.001
max54.694-54.692=0.001
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.140-0.140=-0.000
σ0.004-0.004=-0.000
min0.135-0.135=0.000
max0.146-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean42.942-42.941=0.001
σ0.007-0.004=0.002
min42.928-42.934=-0.005
max42.954-42.948=0.006
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.122-0.121=0.001
σ0.003-0.003=0.000
min0.119-0.118=0.001
max0.128-0.126=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.793-991.803=-0.009
σ1.263-1.253=0.010
min991.248-991.248=-0.000
max997.114-997.074=0.040
mean1063.650-1063.000=0.650
σ322.083-322.010=0.072
min567.000-566.000=1.000
max1639.000-1636.000=3.000
mean1.531-1.532=-0.001
σ0.104-0.121=-0.017
min1.383-1.373=0.010
max1.758-1.874=-0.116

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.397-285.393=0.004
σ0.008-0.010=-0.003
min285.390-285.375=0.015
max285.410-285.400=0.011
mean1639.000-1636.000=3.000
σ0.000
min1639.000-1636.000=3.000
max1639.000-1636.000=3.000
mean0.383-0.378=0.004
σ0.010-0.007=0.003
min0.375-0.373=0.002
max0.395-0.391=0.004
iters=5
new-facts=1
prior-facts=6402
mean1285.353-1285.358=-0.005
σ0.133-0.136=-0.003
min1285.287-1285.293=-0.006
max1285.591-1285.601=-0.009
mean1639.000-1636.000=3.000
σ0.000
min1639.000-1636.000=3.000
max1639.000-1636.000=3.000
mean1.891-1.871=0.020
σ0.076-0.074=0.002
min1.798-1.815=-0.017
max2.003-1.989=0.014
iters=5
new-facts=6402
prior-facts=1
mean1807.673-1807.716=-0.043
σ7.041-6.987=0.054
min1804.324-1804.361=-0.037
max1820.253-1820.198=0.055
mean1639.000-1636.000=3.000
σ0.000
min1639.000-1636.000=3.000
max1639.000-1636.000=3.000
mean4.152-4.243=-0.091
σ0.278-0.184=0.094
min3.918-4.092=-0.175
max4.602-4.523=0.079
iters=5
new-facts=6402
prior-facts=6402
mean2070.178-2070.173=0.005
σ0.008-0.010=-0.001
min2070.170-2070.163=0.008
max2070.191-2070.188=0.004
mean1847.000-1847.800=-0.800
σ174.303-175.317=-1.015
min1639.000-1636.000=3.000
max2091.000
mean4.462-4.461=0.002
σ0.062-0.045=0.017
min4.399-4.419=-0.020
max4.538-4.535=0.003

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.174-1.219=-0.046
σ0.260-0.320=-0.059
min0.907-0.913=-0.006
max1.545-1.747=-0.203

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.774-436.782=-0.008
σ572.364-572.360=0.004
min150.590-150.589=0.000
max1295.320-1295.322=-0.002
mean90.250
σ8.500
min86.000
max103.000
mean1639.000-1636.000=3.000
σ0.000
min1639.000-1636.000=3.000
max1639.000-1636.000=3.000
mean0.536-0.522=0.014
σ0.562-0.545=0.017
min0.251-0.249=0.003
max1.379-1.339=0.039
policies=20
mean1506.185-1506.184=0.001
σ0.241-0.237=0.003
min1506.026-1506.032=-0.007
max1506.543-1506.538=0.005
mean860.000
σ0.000
min860.000
max860.000
mean1639.000-1636.000=3.000
σ0.000
min1639.000-1636.000=3.000
max1639.000-1636.000=3.000
mean2.522-2.516=0.006
σ0.009-0.032=-0.022
min2.509-2.471=0.037
max2.529-2.539=-0.010
policies=200
mean15069.543-15069.549=-0.006
σ0.054-0.046=0.008
min15069.497-15069.499=-0.002
max15069.617-15069.611=0.007
mean8600.000
σ0.000
min8600.000
max8600.000
mean1639.000-1636.000=3.000
σ0.000
min1639.000-1636.000=3.000
max1639.000-1636.000=3.000
mean25.470-25.436=0.033
σ0.154-0.126=0.028
min25.310-25.303=0.007
max25.662-25.581=0.081