Compare commits

Home / Compare 659e5410 .. e3c0b70c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.015=-0.001
σ0.369-0.371=-0.001
min53.872-53.869=0.003
max55.064-55.069=-0.005
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.136-0.140=-0.004
σ0.005-0.004=0.001
min0.130-0.136=-0.006
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=0.000
σ0.008-0.007=0.001
min43.309-43.308=0.001
max43.336-43.333=0.003
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.121-0.120=0.001
σ0.002-0.001=0.001
min0.119-0.118=0.001
max0.126-0.122=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1006.311=-0.002
σ1.167-1.159=0.008
min1005.768-1005.742=0.025
max1011.194-1011.161=0.033
mean1045.850-1045.350=0.500
σ313.898-313.737=0.161
min595.000
max1641.000-1642.000=-1.000
mean1.547-1.537=0.010
σ0.098-0.078=0.020
min1.459-1.448=0.011
max1.781-1.758=0.023

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1641.000-1642.000=-1.000
σ0.000
min1641.000-1642.000=-1.000
max1641.000-1642.000=-1.000
mean0.409-0.391=0.018
σ0.144-0.109=0.036
min0.320-0.321=-0.002
max0.663-0.583=0.080
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1641.000-1642.000=-1.000
σ0.000
min1641.000-1642.000=-1.000
max1641.000-1642.000=-1.000
mean0.887-0.882=0.004
σ0.097-0.094=0.004
min0.820-0.816=0.004
max1.056-1.045=0.011
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1641.000-1642.000=-1.000
σ0.000
min1641.000-1642.000=-1.000
max1641.000-1642.000=-1.000
mean0.555-0.540=0.015
σ0.054-0.054=0.000
min0.510-0.490=0.020
max0.646-0.632=0.014
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1641.000-1642.000=-1.000
σ0.000
min1641.000-1642.000=-1.000
max1641.000-1642.000=-1.000
mean0.852-0.834=0.018
σ0.036-0.030=0.006
min0.826-0.809=0.018
max0.913-0.881=0.032

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.115=-0.000
σ0.029-0.034=-0.005
min964.094-964.086=0.008
max964.163-964.171=-0.008
mean1641.000-1642.000=-1.000
σ0.000
min1641.000-1642.000=-1.000
max1641.000-1642.000=-1.000
mean0.852-0.839=0.013
σ0.004-0.032=-0.028
min0.845-0.789=0.056
max0.856-0.871=-0.015
name=cdr_enhanced_4k_loc.art
mean884.712-884.711=0.000
σ0.008-0.008=0.000
min884.703
max884.723-884.723=-0.000
mean1641.000-1642.000=-1.000
σ0.000
min1641.000-1642.000=-1.000
max1641.000-1642.000=-1.000
mean0.710-0.721=-0.011
σ0.029-0.011=0.017
min0.681-0.708=-0.027
max0.740-0.738=0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718
mean1641.000-1642.000=-1.000
σ0.000
min1641.000-1642.000=-1.000
max1641.000-1642.000=-1.000
mean4.214-4.254=-0.040
σ0.081-0.077=0.005
min4.030-4.124=-0.094
max4.518-4.478=0.040
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.669-7.666=0.003
mean1641.000-1642.000=-1.000
σ0.000
min1641.000-1642.000=-1.000
max1641.000-1642.000=-1.000
mean3.533-4.238=-0.705
σ0.198-0.153=0.045
min3.354-4.077=-0.723
max4.276-5.452=-1.176
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1641.000-1642.000=-1.000
σ0.000
min1641.000-1642.000=-1.000
max1641.000-1642.000=-1.000
mean0.737-0.758=-0.021
σ0.018-0.041=-0.023
min0.707-0.542=0.164
max0.842-0.868=-0.026
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1641.000-1642.000=-1.000
σ0.000
min1641.000-1642.000=-1.000
max1641.000-1642.000=-1.000
mean0.690-0.715=-0.025
σ0.014-0.032=-0.018
min0.655-0.654=0.002
max0.753-0.815=-0.062

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.453-296.263=0.190
σ0.242-0.253=-0.011
min296.208-296.085=0.124
max297.100-296.961=0.138
mean1953.000-1915.000=38.000
σ0.000
min1953.000-1915.000=38.000
max1953.000-1915.000=38.000
mean0.589-0.572=0.017
σ0.035-0.038=-0.004
min0.539-0.516=0.023
max0.665-0.630=0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.694-284.695=-0.002
σ0.037-0.033=0.005
min284.642-284.661=-0.019
max284.734-284.737=-0.003
mean1641.000-1642.000=-1.000
σ0.000
min1641.000-1642.000=-1.000
max1641.000-1642.000=-1.000
mean0.398-0.402=-0.004
σ0.007-0.017=-0.010
min0.385-0.386=-0.000
max0.403-0.428=-0.025
iters=5
new-facts=1
prior-facts=6402
mean1295.075-1295.076=-0.001
σ0.103-0.106=-0.003
min1294.960-1294.953=0.007
max1295.206-1295.203=0.003
mean1641.000-1642.000=-1.000
σ0.000
min1641.000-1642.000=-1.000
max1641.000-1642.000=-1.000
mean1.920-1.943=-0.023
σ0.117-0.124=-0.007
min1.791-1.805=-0.014
max2.048-2.134=-0.086
iters=5
new-facts=6402
prior-facts=1
mean1539.211-1539.230=-0.019
σ6.828-6.844=-0.016
min1535.919-1535.929=-0.010
max1551.420-1551.467=-0.047
mean1641.000-1642.000=-1.000
σ0.000
min1641.000-1642.000=-1.000
max1641.000-1642.000=-1.000
mean2.362-2.367=-0.005
σ0.244-0.231=0.013
min2.052-2.058=-0.005
max2.692-2.687=0.005
iters=5
new-facts=6402
prior-facts=6402
mean1856.983-1856.979=0.003
σ0.061-0.060=0.001
min1856.930-1856.923=0.007
max1857.069-1857.064=0.006
mean1791.200-1772.600=18.600
σ156.538-137.136=19.402
min1641.000-1642.000=-1.000
max1953.000-1915.000=38.000
mean2.937-3.068=-0.132
σ0.153-0.263=-0.110
min2.822-2.861=-0.039
max3.185-3.525=-0.340

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.181-1.190=-0.009
σ0.208-0.360=-0.152
min0.927-0.924=0.003
max1.459-1.788=-0.329

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.786=0.000
σ581.212-581.212=0.000
min157.179-157.178=0.000
max1319.605-1319.605=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1641.000-1642.000=-1.000
σ0.000
min1641.000-1642.000=-1.000
max1641.000-1642.000=-1.000
mean0.538-0.534=0.004
σ0.558-0.546=0.012
min0.255-0.257=-0.002
max1.374-1.353=0.021
policies=20
mean1572.099-1572.102=-0.003
σ0.344-0.352=-0.008
min1571.864-1571.864=0.000
max1572.610-1572.626=-0.016
mean920.000
σ0.000
min920.000
max920.000
mean1641.000-1642.000=-1.000
σ0.000
min1641.000-1642.000=-1.000
max1641.000-1642.000=-1.000
mean2.621-2.619=0.002
σ0.023-0.022=0.001
min2.595-2.591=0.004
max2.651-2.646=0.006
policies=200
mean15729.091-15729.050=0.040
σ0.120-0.053=0.067
min15728.986-15728.977=0.009
max15729.262-15729.103=0.159
mean9200.000
σ0.000
min9200.000
max9200.000
mean1641.000-1642.000=-1.000
σ0.000
min1641.000-1642.000=-1.000
max1641.000-1642.000=-1.000
mean26.528-26.511=0.017
σ0.212-0.048=0.164
min26.349-26.477=-0.128
max26.776-26.582=0.194