Compare commits

Home / Compare eaef3fc1 .. 90feefc0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.821-53.823=-0.001
σ0.368-0.368=0.001
min53.682-53.682=0.001
max54.869-54.868=0.000
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.139-0.136=0.003
σ0.004-0.004=0.000
min0.133-0.131=0.002
max0.145-0.142=0.002
cache=y
dps=1
iters=10
policies=100
mean43.208-43.209=-0.001
σ0.005-0.006=-0.001
min43.198-43.199=-0.001
max43.217-43.219=-0.002
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.122-0.123=-0.000
σ0.004-0.004=0.000
min0.119-0.120=-0.001
max0.129-0.129=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.173-1016.179=-0.005
σ1.198-1.163=0.035
min1015.628-1015.603=0.025
max1021.197-1021.045=0.152
mean1035.700-1047.000=-11.300
σ316.110-312.151=3.960
min537.000-554.000=-17.000
max1635.000-1513.000=122.000
mean1.573-1.549=0.024
σ0.109-0.054=0.056
min1.482-1.491=-0.009
max1.926-1.678=0.248

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.346-301.468=-0.122
σ0.258-0.238=0.019
min301.156-301.329=-0.173
max302.054-302.135=-0.082
mean2027.000
σ0.000
min2027.000
max2027.000
mean0.568-0.573=-0.004
σ0.037-0.038=-0.001
min0.504-0.501=0.003
max0.606-0.603=0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.690-300.694=-0.003
σ0.033-0.030=0.004
min300.635-300.659=-0.024
max300.718-300.736=-0.017
mean1635.000-1513.000=122.000
σ0.000
min1635.000-1513.000=122.000
max1635.000-1513.000=122.000
mean0.390-0.396=-0.006
σ0.005-0.009=-0.004
min0.386-0.390=-0.003
max0.399-0.410=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1322.868-1322.879=-0.011
σ0.094-0.064=0.030
min1322.818-1322.800=0.017
max1323.035-1322.948=0.087
mean1635.000-1513.000=122.000
σ0.000
min1635.000-1513.000=122.000
max1635.000-1513.000=122.000
mean1.915-2.069=-0.155
σ0.112-0.241=-0.130
min1.816-1.807=0.009
max2.055-2.372=-0.317
iters=5
new-facts=6402
prior-facts=1
mean1561.291-1561.363=-0.072
σ6.845-6.850=-0.005
min1558.003-1558.158=-0.155
max1573.530-1573.615=-0.084
mean1635.000-1513.000=122.000
σ0.000
min1635.000-1513.000=122.000
max1635.000-1513.000=122.000
mean2.181-2.330=-0.148
σ0.103-0.244=-0.141
min2.098-2.148=-0.050
max2.351-2.677=-0.326
iters=5
new-facts=6402
prior-facts=6402
mean1890.788-1890.798=-0.010
σ0.018-0.043=-0.026
min1890.767-1890.765=0.002
max1890.816-1890.874=-0.058
mean1770.200-1730.000=40.200
σ167.421-209.151=-41.730
min1635.000-1513.000=122.000
max2027.000
mean2.914-2.931=-0.017
σ0.118-0.094=0.024
min2.843-2.861=-0.018
max3.122-3.039=0.083

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.165-1.478=-0.313
σ0.348-0.439=-0.092
min0.916-0.939=-0.023
max1.744-1.833=-0.088

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.047-443.038=0.008
σ573.415-573.401=0.014
min156.338-156.333=0.005
max1303.169-1303.140=0.029
mean96.250
σ8.500
min92.000
max109.000
mean1635.000-1513.000=122.000
σ0.000
min1635.000-1513.000=122.000
max1635.000-1513.000=122.000
mean0.556-0.552=0.004
σ0.583-0.580=0.003
min0.261-0.260=0.001
max1.430-1.422=0.008
policies=20
mean1563.617-1563.621=-0.003
σ0.322-0.343=-0.020
min1563.438-1563.405=0.033
max1564.101-1564.133=-0.032
mean920.000
σ0.000
min920.000
max920.000
mean1635.000-1513.000=122.000
σ0.000
min1635.000-1513.000=122.000
max1635.000-1513.000=122.000
mean2.610-2.632=-0.021
σ0.004-0.018=-0.014
min2.606-2.616=-0.011
max2.614-2.652=-0.038
policies=200
mean15644.165-15644.077=0.088
σ0.121-0.163=-0.042
min15644.055-15643.848=0.207
max15644.327-15644.197=0.130
mean9200.000
σ0.000
min9200.000
max9200.000
mean1635.000-1513.000=122.000
σ0.000
min1635.000-1513.000=122.000
max1635.000-1513.000=122.000
mean26.427-26.540=-0.114
σ0.171-0.149=0.022
min26.196-26.362=-0.167
max26.576-26.693=-0.117