Compare commits

Home / Compare ffa77e73 .. a42caadb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.015=-0.001
σ0.368-0.369=-0.002
min53.866-53.872=-0.006
max55.060-55.065=-0.005
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.138-0.138=0.001
σ0.004-0.004=0.000
min0.135-0.130=0.005
max0.144-0.145=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.321-43.323=-0.002
σ0.006-0.007=-0.001
min43.313-43.313=0.001
max43.334-43.337=-0.003
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.122-0.121=0.001
σ0.004-0.004=-0.000
min0.118-0.116=0.002
max0.130-0.130=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1011.005=-4.695
σ1.182-1.153=0.029
min1005.765-1010.468=-4.703
max1011.267-1015.828=-4.561
mean1051.150-1046.750=4.400
σ303.691-316.006=-12.315
min586.000-582.000=4.000
max1640.000-1648.000=-8.000
mean1.561-1.592=-0.031
σ0.103-0.125=-0.022
min1.471-1.489=-0.017
max1.820-2.059=-0.239

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866-0.865=0.001
σ0.003-0.002=0.001
min0.864
max0.869-0.868=0.001
mean1640.000-1648.000=-8.000
σ0.000
min1640.000-1648.000=-8.000
max1640.000-1648.000=-8.000
mean0.423-0.346=0.077
σ0.140-0.028=0.112
min0.330-0.325=0.005
max0.670-0.387=0.284
name=error_case.art
mean2.337-2.336=0.001
σ0.003-0.002=0.001
min2.336
max2.341-2.339=0.002
mean1640.000-1648.000=-8.000
σ0.000
min1640.000-1648.000=-8.000
max1640.000-1648.000=-8.000
mean0.916-0.844=0.072
σ0.102-0.036=0.066
min0.832-0.815=0.017
max1.090-0.903=0.187
name=heavy_item.art
mean1.523
σ0.002-0.003=-0.001
min1.522
max1.526-1.529=-0.003
mean1640.000-1648.000=-8.000
σ0.000
min1640.000-1648.000=-8.000
max1640.000-1648.000=-8.000
mean0.551-0.539=0.013
σ0.056-0.048=0.008
min0.493-0.494=-0.001
max0.625-0.614=0.011
name=nested_use.art
mean2.360-2.362=-0.002
σ0.002-0.004=-0.003
min2.359
max2.363-2.369=-0.006
mean1640.000-1648.000=-8.000
σ0.000
min1640.000-1648.000=-8.000
max1640.000-1648.000=-8.000
mean0.870-0.988=-0.118
σ0.062-0.333=-0.271
min0.827-0.819=0.009
max0.979-1.581=-0.602

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113-964.091=0.022
σ0.031-0.010=0.021
min964.088-964.082=0.006
max964.164-964.108=0.056
mean1640.000-1648.000=-8.000
σ0.000
min1640.000-1648.000=-8.000
max1640.000-1648.000=-8.000
mean0.811-0.824=-0.013
σ0.030-0.023=0.007
min0.783-0.797=-0.014
max0.858-0.856=0.003
name=cdr_enhanced_4k_loc.art
mean884.711-884.737=-0.026
σ0.007-0.022=-0.015
min884.705-884.716=-0.012
max884.721-884.772=-0.051
mean1640.000-1648.000=-8.000
σ0.000
min1640.000-1648.000=-8.000
max1640.000-1648.000=-8.000
mean0.710-0.730=-0.020
σ0.040-0.011=0.028
min0.642-0.711=-0.069
max0.739-0.741=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.720=-0.003
mean1640.000-1648.000=-8.000
σ0.000
min1640.000-1648.000=-8.000
max1640.000-1648.000=-8.000
mean4.214-4.222=-0.008
σ0.081-0.078=0.004
min4.094-4.087=0.008
max4.663-4.486=0.177
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.669-7.666=0.003
mean1640.000-1648.000=-8.000
σ0.000
min1640.000-1648.000=-8.000
max1640.000-1648.000=-8.000
mean4.196-4.205=-0.009
σ0.060-0.075=-0.015
min4.094-4.076=0.018
max4.476-4.461=0.015
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1640.000-1648.000=-8.000
σ0.000
min1640.000-1648.000=-8.000
max1640.000-1648.000=-8.000
mean0.753-0.740=0.013
σ0.044-0.036=0.008
min0.714-0.709=0.005
max1.062-1.017=0.044
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1640.000-1648.000=-8.000
σ0.000
min1640.000-1648.000=-8.000
max1640.000-1648.000=-8.000
mean0.705-0.703=0.002
σ0.022-0.036=-0.015
min0.671-0.531=0.140
max0.781-0.879=-0.098

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.277-300.951=-4.673
σ0.279-0.244=0.035
min295.980-300.710=-4.731
max296.999-301.605=-4.607
mean1902.000-1919.000=-17.000
σ0.000
min1902.000-1919.000=-17.000
max1902.000-1919.000=-17.000
mean0.568-0.582=-0.014
σ0.043-0.027=0.016
min0.512-0.521=-0.010
max0.652-0.613=0.038

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.704-299.446=-14.742
σ0.027-0.050=-0.024
min284.677-299.373=-14.695
max284.735-299.504=-14.769
mean1640.000-1648.000=-8.000
σ0.000
min1640.000-1648.000=-8.000
max1640.000-1648.000=-8.000
mean0.392-0.388=0.003
σ0.007-0.007=-0.000
min0.384-0.384=0.000
max0.403-0.402=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.077-1309.885=-14.809
σ0.105-0.095=0.009
min1294.960-1309.765=-14.805
max1295.206-1309.997=-14.791
mean1640.000-1648.000=-8.000
σ0.000
min1640.000-1648.000=-8.000
max1640.000-1648.000=-8.000
mean1.917-1.868=0.050
σ0.104-0.105=-0.001
min1.808-1.732=0.076
max2.037-2.013=0.024
iters=5
new-facts=6402
prior-facts=1
mean1539.184-1554.038=-14.854
σ6.828-6.851=-0.023
min1535.950-1550.808=-14.858
max1551.395-1566.289=-14.894
mean1640.000-1648.000=-8.000
σ0.000
min1640.000-1648.000=-8.000
max1640.000-1648.000=-8.000
mean2.213-2.371=-0.158
σ0.180-0.236=-0.057
min2.058-2.008=0.051
max2.489-2.608=-0.119
iters=5
new-facts=6402
prior-facts=6402
mean1856.989-1871.761=-14.772
σ0.059-0.044=0.015
min1856.932-1871.712=-14.781
max1857.076-1871.803=-14.727
mean1773.200-1779.600=-6.400
σ128.550-134.953=-6.403
min1640.000-1648.000=-8.000
max1902.000-1919.000=-17.000
mean3.045-3.022=0.024
σ0.272-0.231=0.040
min2.827-2.808=0.018
max3.502-3.413=0.090

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.197-1.165=0.033
σ0.289-0.230=0.060
min0.927-0.941=-0.013
max1.672-1.513=0.158

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.784-447.786=-0.002
σ581.212-581.212=0.000
min157.176-157.176=-0.001
max1319.602-1319.604=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1640.000-1648.000=-8.000
σ0.000
min1640.000-1648.000=-8.000
max1640.000-1648.000=-8.000
mean0.535-0.524=0.011
σ0.553-0.533=0.020
min0.257-0.255=0.002
max1.364-1.324=0.041
policies=20
mean1572.089-1572.099=-0.010
σ0.363-0.348=0.014
min1571.841-1571.863=-0.022
max1572.628-1572.616=0.011
mean920.000
σ0.000
min920.000
max920.000
mean1640.000-1648.000=-8.000
σ0.000
min1640.000-1648.000=-8.000
max1640.000-1648.000=-8.000
mean2.628-2.613=0.015
σ0.024-0.018=0.006
min2.599-2.591=0.009
max2.658-2.633=0.024
policies=200
mean15729.009-15729.001=0.008
σ0.167-0.028=0.140
min15728.823-15728.974=-0.151
max15729.208-15729.040=0.169
mean9200.000
σ0.000
min9200.000
max9200.000
mean1640.000-1648.000=-8.000
σ0.000
min1640.000-1648.000=-8.000
max1640.000-1648.000=-8.000
mean26.496-26.475=0.021
σ0.130-0.026=0.104
min26.402-26.438=-0.036
max26.688-26.500=0.189