Compare commits

Home / Compare 9e82eea0 .. 28fc668c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.705-53.704=0.001
σ0.363-0.363=0.000
min53.574-53.573=0.000
max54.739-54.737=0.001
mean412.000-418.000=-6.000
σ0.000
min412.000-418.000=-6.000
max412.000-418.000=-6.000
mean0.138-0.139=-0.000
σ0.003-0.004=-0.001
min0.136-0.135=0.001
max0.143-0.147=-0.003
cache=y
dps=1
iters=10
policies=100
mean42.978-42.979=-0.001
σ0.006-0.005=0.002
min42.966-42.973=-0.007
max42.986-42.989=-0.003
mean412.000-418.000=-6.000
σ0.000
min412.000-418.000=-6.000
max412.000-418.000=-6.000
mean0.119-0.121=-0.002
σ0.004-0.003=0.001
min0.113-0.118=-0.005
max0.125-0.127=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean994.901-994.897=0.004
σ1.201-1.188=0.013
min994.373-994.369=0.003
max999.943-999.878=0.066
mean1058.650-1060.950=-2.300
σ321.900-317.182=4.719
min563.000-598.000=-35.000
max1622.000-1621.000=1.000
mean1.446-1.440=0.006
σ0.078-0.087=-0.009
min1.380-1.354=0.026
max1.645-1.677=-0.032

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.308-297.307=0.001
σ0.017-0.015=0.003
min297.284-297.282=0.001
max297.332-297.319=0.013
mean1622.000-1621.000=1.000
σ0.000
min1622.000-1621.000=1.000
max1622.000-1621.000=1.000
mean0.394-0.389=0.005
σ0.014-0.007=0.007
min0.384-0.384=0.000
max0.418-0.401=0.017
iters=5
new-facts=1
prior-facts=6402
mean1298.699-1298.668=0.031
σ0.054-0.061=-0.007
min1298.607-1298.566=0.041
max1298.736-1298.714=0.022
mean1622.000-1621.000=1.000
σ0.000
min1622.000-1621.000=1.000
max1622.000-1621.000=1.000
mean1.868-1.950=-0.082
σ0.031-0.144=-0.113
min1.839-1.837=0.002
max1.908-2.200=-0.292
iters=5
new-facts=6402
prior-facts=1
mean1718.865-1718.870=-0.005
σ6.932-6.905=0.027
min1715.550-1715.659=-0.109
max1731.259-1731.219=0.040
mean1622.000-1621.000=1.000
σ0.000
min1622.000-1621.000=1.000
max1622.000-1621.000=1.000
mean3.068-3.084=-0.015
σ0.491-0.291=0.200
min2.412-2.713=-0.301
max3.571-3.452=0.118
iters=5
new-facts=6402
prior-facts=6402
mean1981.591-1981.607=-0.016
σ0.048-0.002=0.046
min1981.513-1981.604=-0.091
max1981.645-1981.610=0.035
mean1817.200-1893.000=-75.800
σ203.599-226.862=-23.263
min1622.000-1621.000=1.000
max2110.000-2175.000=-65.000
mean3.352-3.204=0.149
σ0.398-0.081=0.318
min3.096-3.096=0.001
max4.059-3.316=0.743

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.209-1.374=-0.165
σ0.335-0.384=-0.049
min0.901-0.987=-0.086
max1.717-1.828=-0.111

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.369-440.376=-0.007
σ572.883-572.882=0.001
min153.921-153.931=-0.010
max1299.694-1299.699=-0.005
mean94.250
σ8.500
min90.000
max107.000
mean1622.000-1621.000=1.000
σ0.000
min1622.000-1621.000=1.000
max1622.000-1621.000=1.000
mean0.526-0.526=-0.000
σ0.535-0.539=-0.003
min0.257-0.255=0.002
max1.329-1.334=-0.005
policies=20
mean1539.520-1539.517=0.003
σ0.310-0.305=0.004
min1539.328-1539.321=0.008
max1539.982-1539.971=0.011
mean900.000
σ0.000
min900.000
max900.000
mean1622.000-1621.000=1.000
σ0.000
min1622.000-1621.000=1.000
max1622.000-1621.000=1.000
mean2.579-2.572=0.008
σ0.025-0.015=0.010
min2.556-2.553=0.002
max2.610-2.586=0.024
policies=200
mean15403.105-15403.129=-0.023
σ0.054-0.073=-0.020
min15403.041-15403.030=0.011
max15403.152-15403.205=-0.053
mean9000.000
σ0.000
min9000.000
max9000.000
mean1622.000-1621.000=1.000
σ0.000
min1622.000-1621.000=1.000
max1622.000-1621.000=1.000
mean25.844-26.016=-0.172
σ0.191-0.219=-0.028
min25.627-25.790=-0.163
max26.075-26.224=-0.149