Compare commits

Home / Compare d1fc1a0a .. 4e928a6b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.823-53.826=-0.002
σ0.367-0.365=0.002
min53.679-53.680=-0.001
max54.868-54.864=0.004
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.139-0.151=-0.012
σ0.004-0.009=-0.004
min0.131-0.133=-0.001
max0.147-0.161=-0.014
cache=y
dps=1
iters=10
policies=100
mean43.208-43.209=-0.001
σ0.005-0.005=0.000
min43.202-43.201=0.000
max43.215-43.218=-0.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.121-0.123=-0.002
σ0.002-0.005=-0.003
min0.118-0.116=0.002
max0.126-0.132=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.175-1016.181=-0.006
σ1.172-1.163=0.009
min1015.631-1015.605=0.026
max1021.087-1021.044=0.043
mean1053.550-1042.550=11.000
σ314.731-310.129=4.602
min587.000-597.000=-10.000
max1672.000-1633.000=39.000
mean1.548-1.551=-0.003
σ0.083-0.099=-0.015
min1.445-1.468=-0.023
max1.794-1.832=-0.038

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.509-301.313=0.196
σ0.245-0.208=0.037
min301.297-301.134=0.163
max302.158-301.845=0.313
mean1949.000-2026.000=-77.000
σ0.000
min1949.000-2026.000=-77.000
max1949.000-2026.000=-77.000
mean0.563-0.557=0.006
σ0.036-0.044=-0.008
min0.505-0.504=0.001
max0.599-0.614=-0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.701-300.705=-0.004
σ0.022-0.010=0.012
min300.666-300.695=-0.029
max300.724-300.722=0.002
mean1672.000-1633.000=39.000
σ0.000
min1672.000-1633.000=39.000
max1672.000-1633.000=39.000
mean0.397-0.397=-0.000
σ0.009-0.008=0.000
min0.388-0.389=-0.001
max0.408-0.406=0.001
iters=5
new-facts=1
prior-facts=6402
mean1322.863-1322.865=-0.002
σ0.099-0.103=-0.004
min1322.802-1322.810=-0.008
max1323.037-1323.049=-0.012
mean1672.000-1633.000=39.000
σ0.000
min1672.000-1633.000=39.000
max1672.000-1633.000=39.000
mean1.925-1.964=-0.039
σ0.079-0.114=-0.035
min1.824-1.841=-0.017
max2.037-2.092=-0.055
iters=5
new-facts=6402
prior-facts=1
mean1561.301-1561.302=-0.000
σ6.888-6.903=-0.015
min1557.970-1557.975=-0.004
max1573.617-1573.644=-0.027
mean1672.000-1633.000=39.000
σ0.000
min1672.000-1633.000=39.000
max1672.000-1633.000=39.000
mean2.235-2.307=-0.072
σ0.258-0.342=-0.083
min2.056-2.087=-0.031
max2.685-2.914=-0.228
iters=5
new-facts=6402
prior-facts=6402
mean1890.805-1890.786=0.019
σ0.028-0.021=0.007
min1890.786-1890.758=0.028
max1890.852-1890.815=0.037
mean1784.000-1768.600=15.400
σ104.960-167.918=-62.958
min1672.000-1633.000=39.000
max1949.000-2026.000=-77.000
mean3.183-2.844=0.339
σ0.398-0.120=0.278
min2.863-2.745=0.117
max3.831-3.028=0.803

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.112-1.210=-0.098
σ0.239-0.327=-0.087
min0.899-0.914=-0.015
max1.424-1.692=-0.268

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.319-443.326=-0.007
σ573.962-573.971=-0.009
min156.335-156.339=-0.004
max1304.262-1304.282=-0.021
mean96.250
σ8.500
min92.000
max109.000
mean1672.000-1633.000=39.000
σ0.000
min1672.000-1633.000=39.000
max1672.000-1633.000=39.000
mean0.555-0.521=0.035
σ0.584-0.524=0.061
min0.261-0.257=0.003
max1.432-1.306=0.126
policies=20
mean1563.641-1563.603=0.038
σ0.323-0.326=-0.003
min1563.463-1563.419=0.044
max1564.125-1564.091=0.034
mean920.000
σ0.000
min920.000
max920.000
mean1672.000-1633.000=39.000
σ0.000
min1672.000-1633.000=39.000
max1672.000-1633.000=39.000
mean2.616-2.598=0.018
σ0.011-0.018=-0.007
min2.606-2.583=0.023
max2.626-2.623=0.004
policies=200
mean15644.143-15644.083=0.060
σ0.081-0.159=-0.078
min15644.078-15643.949=0.129
max15644.262-15644.299=-0.037
mean9200.000
σ0.000
min9200.000
max9200.000
mean1672.000-1633.000=39.000
σ0.000
min1672.000-1633.000=39.000
max1672.000-1633.000=39.000
mean26.436-26.389=0.047
σ0.185-0.143=0.042
min26.271-26.254=0.016
max26.636-26.526=0.110