Compare commits

Home / Compare 4636800a .. 2b1cef02

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.106-54.105=0.002
σ0.365-0.364=0.001
min53.967-53.970=-0.003
max55.143-55.139=0.005
mean414.000-413.600=0.400
σ0.000-0.516=-0.516
min414.000-413.000=1.000
max414.000
mean0.140-0.136=0.004
σ0.004-0.003=0.001
min0.136-0.130=0.005
max0.147-0.140=0.007
cache=y
dps=1
iters=10
policies=100
mean43.378-43.378=-0.000
σ0.006-0.005=0.000
min43.369-43.367=0.003
max43.387-43.384=0.003
mean414.000-414.700=-0.700
σ0.000-0.483=-0.483
min414.000
max414.000-415.000=-1.000
mean0.123-0.120=0.002
σ0.003-0.002=0.001
min0.120-0.118=0.001
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean997.119-997.123=-0.005
σ1.198-1.191=0.007
min996.589-996.584=0.005
max1002.141-1002.117=0.024
mean1058.250-1053.000=5.250
σ315.162-310.784=4.378
min596.000-597.000=-1.000
max1634.000
mean1.445-1.455=-0.010
σ0.075-0.096=-0.021
min1.375-1.383=-0.008
max1.680-1.725=-0.044

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.007-303.010=-0.003
σ0.022-0.019=0.002
min302.969-302.977=-0.007
max303.026-303.028=-0.002
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.394-0.402=-0.008
σ0.005-0.009=-0.004
min0.390-0.391=-0.001
max0.403-0.413=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1304.306-1304.296=0.010
σ0.074-0.102=-0.029
min1304.180-1304.118=0.062
max1304.357-1304.365=-0.009
mean1634.000
σ0.000
min1634.000
max1634.000
mean2.019-2.027=-0.008
σ0.253-0.249=0.004
min1.867-1.760=0.106
max2.467-2.428=0.039
iters=5
new-facts=6402
prior-facts=1
mean1724.601-1724.608=-0.007
σ6.921-6.932=-0.011
min1721.303-1721.282=0.022
max1736.975-1737.001=-0.026
mean1634.000
σ0.000
min1634.000
max1634.000
mean3.078-3.116=-0.038
σ0.398-0.399=-0.001
min2.613-2.578=0.035
max3.631-3.539=0.092
iters=5
new-facts=6402
prior-facts=6402
mean1987.324-1987.317=0.006
σ0.019-0.066=-0.047
min1987.297-1987.214=0.083
max1987.349-1987.395=-0.046
mean1861.000-1807.800=53.200
σ237.304-144.685=92.619
min1634.000
max2168.000-2007.000=161.000
mean3.163-3.247=-0.084
σ0.150-0.446=-0.296
min2.986-2.910=0.076
max3.362-4.032=-0.670

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.142-1.242=-0.100
σ0.297-0.367=-0.069
min0.910-0.912=-0.001
max1.637-1.751=-0.114

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.516-442.518=-0.002
σ572.871-572.882=-0.011
min156.069-156.069=0.000
max1301.822-1301.841=-0.019
mean94.250
σ8.500
min90.000
max107.000
mean1634.000
σ0.000
min1634.000
max1634.000
mean0.522-0.530=-0.008
σ0.527-0.532=-0.005
min0.257-0.258=-0.001
max1.312-1.328=-0.015
policies=20
mean1560.944-1560.957=-0.013
σ0.306-0.302=0.004
min1560.757-1560.758=-0.001
max1561.401-1561.406=-0.005
mean900.000
σ0.000
min900.000
max900.000
mean1634.000
σ0.000
min1634.000
max1634.000
mean2.579-2.565=0.015
σ0.028-0.010=0.018
min2.554-2.553=0.001
max2.608-2.577=0.030
policies=200
mean15617.529-15617.521=0.009
σ0.092-0.196=-0.104
min15617.397-15617.312=0.086
max15617.608-15617.784=-0.175
mean9000.000
σ0.000
min9000.000
max9000.000
mean1634.000
σ0.000
min1634.000
max1634.000
mean26.193-26.294=-0.101
σ0.217-0.218=-0.002
min25.984-26.028=-0.043
max26.415-26.483=-0.068