Compare commits

Home / Compare b1ab1f4d .. 0067ff3a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.822-53.654=0.168
σ0.368-0.368=0.001
min53.677-53.516=0.161
max54.869-54.700=0.169
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.136-0.137=-0.001
σ0.004-0.004=-0.001
min0.129-0.132=-0.003
max0.143-0.145=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.207-42.982=0.225
σ0.008-0.007=0.001
min43.195-42.972=0.222
max43.222-42.993=0.229
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.120-0.122=-0.002
σ0.004-0.004=0.000
min0.114-0.119=-0.005
max0.126-0.128=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.177-1013.973=2.204
σ1.163-1.178=-0.014
min1015.635-1013.430=2.205
max1021.047-1018.900=2.146
mean1041.950-1049.250=-7.300
σ311.631-319.179=-7.548
min587.000
max1634.000-1660.000=-26.000
mean1.591-1.629=-0.038
σ0.096-0.075=0.022
min1.509-1.542=-0.033
max1.850-1.863=-0.013

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.335-299.290=2.045
σ0.236-0.241=-0.005
min301.139-299.139=2.000
max301.971-299.949=2.022
mean1941.000-2038.000=-97.000
σ0.000
min1941.000-2038.000=-97.000
max1941.000-2038.000=-97.000
mean0.538-0.597=-0.059
σ0.032-0.028=0.004
min0.500-0.556=-0.056
max0.579-0.626=-0.047

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.705-294.683=6.022
σ0.023-0.016=0.007
min300.682-294.662=6.020
max300.738-294.703=6.035
mean1634.000-1660.000=-26.000
σ0.000
min1634.000-1660.000=-26.000
max1634.000-1660.000=-26.000
mean0.397-0.388=0.010
σ0.008-0.006=0.002
min0.388-0.382=0.006
max0.408-0.398=0.010
iters=5
new-facts=1
prior-facts=6402
mean1322.864-1316.943=5.921
σ0.099-0.090=0.009
min1322.802-1316.900=5.902
max1323.040-1317.103=5.937
mean1634.000-1660.000=-26.000
σ0.000
min1634.000-1660.000=-26.000
max1634.000-1660.000=-26.000
mean1.924-1.942=-0.018
σ0.074-0.083=-0.009
min1.829-1.852=-0.024
max2.007-2.033=-0.026
iters=5
new-facts=6402
prior-facts=1
mean1561.306-1555.326=5.980
σ6.882-6.854=0.029
min1557.951-1552.023=5.928
max1573.609-1567.580=6.029
mean1634.000-1660.000=-26.000
σ0.000
min1634.000-1660.000=-26.000
max1634.000-1660.000=-26.000
mean2.327-2.370=-0.042
σ0.299-0.190=0.109
min2.081-2.141=-0.060
max2.689-2.662=0.027
iters=5
new-facts=6402
prior-facts=6402
mean1890.803-1884.780=6.022
σ0.027-0.023=0.004
min1890.780-1884.760=6.020
max1890.846-1884.819=6.027
mean1774.600-1783.000=-8.400
σ113.065-159.283=-46.217
min1634.000-1660.000=-26.000
max1941.000-2038.000=-97.000
mean3.003-3.043=-0.041
σ0.150-0.225=-0.075
min2.870-2.904=-0.034
max3.242-3.430=-0.188

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.189-1.103=0.086
σ0.394-0.274=0.120
min0.910-0.916=-0.006
max1.855-1.532=0.323

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.047-440.680=2.367
σ573.413-573.398=0.015
min156.331-153.975=2.356
max1303.166-1300.777=2.389
mean96.250
σ8.500
min92.000
max109.000
mean1634.000-1660.000=-26.000
σ0.000
min1634.000-1660.000=-26.000
max1634.000-1660.000=-26.000
mean0.546-0.530=0.016
σ0.566-0.522=0.044
min0.260-0.269=-0.008
max1.394-1.313=0.082
policies=20
mean1563.615-1539.919=23.697
σ0.342-0.308=0.034
min1563.409-1539.738=23.671
max1564.128-1540.380=23.747
mean920.000
σ0.000
min920.000
max920.000
mean1634.000-1660.000=-26.000
σ0.000
min1634.000-1660.000=-26.000
max1634.000-1660.000=-26.000
mean2.620-2.593=0.027
σ0.013-0.016=-0.002
min2.600-2.575=0.025
max2.630-2.614=0.016
policies=200
mean15644.128-15407.079=237.049
σ0.147-0.041=0.107
min15643.944-15407.044=236.900
max15644.267-15407.133=237.135
mean9200.000
σ0.000
min9200.000
max9200.000
mean1634.000-1660.000=-26.000
σ0.000
min1634.000-1660.000=-26.000
max1634.000-1660.000=-26.000
mean26.669-26.255=0.414
σ0.293-0.136=0.157
min26.370-26.132=0.238
max27.070-26.375=0.694