Compare commits

Home / Compare 8a502c37 .. 6ca83610

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.822-53.826=-0.005
σ0.369-0.367=0.002
min53.673-53.689=-0.016
max54.871-54.871=-0.000
mean417.000
σ0.000
min417.000
max417.000
mean0.135-0.147=-0.012
σ0.005-0.008=-0.003
min0.130-0.136=-0.006
max0.142-0.157=-0.016
cache=y
dps=1
iters=10
policies=100
mean43.206-43.208=-0.002
σ0.006-0.006=-0.001
min43.197-43.195=0.002
max43.214-43.218=-0.004
mean417.000
σ0.000
min417.000
max417.000
mean0.117-0.121=-0.004
σ0.004-0.005=-0.001
min0.114-0.114=0.000
max0.127-0.127=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.175-1016.179=-0.003
σ1.181-1.162=0.019
min1015.613-1015.603=0.010
max1021.123-1021.041=0.082
mean1049.700-1045.900=3.800
σ310.063-296.497=13.566
min564.000-587.000=-23.000
max1512.000-1463.000=49.000
mean1.537-1.558=-0.021
σ0.064-0.051=0.014
min1.485-1.499=-0.014
max1.731-1.651=0.080

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.469-301.473=-0.004
σ0.236-0.260=-0.024
min301.209-301.291=-0.083
max302.031-302.188=-0.157
mean1965.000-2041.000=-76.000
σ0.000
min1965.000-2041.000=-76.000
max1965.000-2041.000=-76.000
mean0.560-0.548=0.012
σ0.044-0.030=0.013
min0.496-0.507=-0.011
max0.605-0.585=0.020

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.698-300.700=-0.001
σ0.035-0.023=0.012
min300.655-300.671=-0.017
max300.746-300.731=0.015
mean1512.000-1463.000=49.000
σ0.000
min1512.000-1463.000=49.000
max1512.000-1463.000=49.000
mean0.398-0.397=0.002
σ0.014-0.008=0.006
min0.389-0.390=-0.000
max0.422-0.409=0.013
iters=5
new-facts=1
prior-facts=6402
mean1322.865-1322.865=0.000
σ0.098-0.092=0.006
min1322.810-1322.814=-0.004
max1323.041-1323.028=0.012
mean1512.000-1463.000=49.000
σ0.000
min1512.000-1463.000=49.000
max1512.000-1463.000=49.000
mean1.930-1.929=0.002
σ0.122-0.095=0.027
min1.828-1.836=-0.007
max2.142-2.056=0.086
iters=5
new-facts=6402
prior-facts=1
mean1561.316-1561.351=-0.036
σ6.907-6.838=0.069
min1557.986-1558.110=-0.124
max1573.664-1573.580=0.084
mean1512.000-1463.000=49.000
σ0.000
min1512.000-1463.000=49.000
max1512.000-1463.000=49.000
mean2.353-2.368=-0.015
σ0.361-0.260=0.102
min2.008-2.053=-0.045
max2.846-2.636=0.210
iters=5
new-facts=6402
prior-facts=6402
mean1890.803-1890.794=0.010
σ0.026-0.020=0.005
min1890.787-1890.769=0.018
max1890.849-1890.815=0.033
mean1774.200-1727.200=47.000
σ158.768-235.205=-76.437
min1533.000-1463.000=70.000
max1965.000-2041.000=-76.000
mean2.979-2.949=0.030
σ0.219-0.110=0.109
min2.707-2.878=-0.171
max3.300-3.143=0.158

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.565-1.715=-0.150
σ0.327-0.069=0.257
min1.208-1.617=-0.409
max1.876-1.777=0.099

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.327-443.319=0.008
σ573.977-573.970=0.007
min156.335-156.331=0.004
max1304.293-1304.275=0.019
mean96.250
σ8.500
min92.000
max109.000
mean1512.000-1463.000=49.000
σ0.000
min1512.000-1463.000=49.000
max1512.000-1463.000=49.000
mean0.539-0.520=0.019
σ0.556-0.510=0.047
min0.258-0.262=-0.003
max1.374-1.284=0.089
policies=20
mean1563.593-1563.603=-0.009
σ0.334-0.344=-0.010
min1563.391-1563.374=0.017
max1564.093-1564.114=-0.022
mean920.000
σ0.000
min920.000
max920.000
mean1512.000-1463.000=49.000
σ0.000
min1512.000-1463.000=49.000
max1512.000-1463.000=49.000
mean2.613-2.619=-0.007
σ0.012-0.014=-0.001
min2.598-2.601=-0.003
max2.627-2.633=-0.006
policies=200
mean15644.078-15644.098=-0.020
σ0.136-0.131=0.005
min15643.954-15643.942=0.013
max15644.230-15644.225=0.005
mean9200.000
σ0.000
min9200.000
max9200.000
mean1512.000-1463.000=49.000
σ0.000
min1512.000-1463.000=49.000
max1512.000-1463.000=49.000
mean26.452-26.553=-0.101
σ0.163-0.252=-0.089
min26.312-26.417=-0.105
max26.652-26.932=-0.279