Compare commits

Home / Compare 2f7ad602 .. cb04f63b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.014=-0.000
σ0.369-0.369=-0.000
min53.872-53.870=0.002
max55.064-55.065=-0.001
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.136-0.140=-0.004
σ0.005-0.004=0.002
min0.130-0.137=-0.008
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=0.000
σ0.008-0.008=0.000
min43.309-43.309=-0.000
max43.336-43.338=-0.002
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.121-0.123=-0.002
σ0.002-0.004=-0.002
min0.119-0.119=0.000
max0.126-0.129=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1006.306=0.003
σ1.167-1.182=-0.015
min1005.768-1005.767=0.001
max1011.194-1011.260=-0.066
mean1045.850-1043.700=2.150
σ313.898-311.595=2.303
min595.000-596.000=-1.000
max1641.000-1631.000=10.000
mean1.547-1.575=-0.028
σ0.098-0.088=0.010
min1.459-1.498=-0.039
max1.781-1.834=-0.053

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1641.000-1631.000=10.000
σ0.000
min1641.000-1631.000=10.000
max1641.000-1631.000=10.000
mean0.409-0.406=0.003
σ0.144-0.114=0.030
min0.320-0.347=-0.028
max0.663-0.610=0.053
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1641.000-1631.000=10.000
σ0.000
min1641.000-1631.000=10.000
max1641.000-1631.000=10.000
mean0.887-0.889=-0.002
σ0.097-0.096=0.001
min0.820-0.828=-0.008
max1.056-1.056=-0.000
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1641.000-1631.000=10.000
σ0.000
min1641.000-1631.000=10.000
max1641.000-1631.000=10.000
mean0.555-0.550=0.005
σ0.054-0.054=0.000
min0.510-0.502=0.008
max0.646-0.643=0.003
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1641.000-1631.000=10.000
σ0.000
min1641.000-1631.000=10.000
max1641.000-1631.000=10.000
mean0.852-0.850=0.002
σ0.036-0.037=-0.001
min0.826-0.818=0.008
max0.913-0.911=0.002

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.115=-0.001
σ0.029-0.034=-0.005
min964.094-964.086=0.008
max964.163-964.172=-0.009
mean1641.000-1631.000=10.000
σ0.000
min1641.000-1631.000=10.000
max1641.000-1631.000=10.000
mean0.852-0.809=0.043
σ0.004-0.066=-0.061
min0.845-0.736=0.109
max0.856-0.860=-0.004
name=cdr_enhanced_4k_loc.art
mean884.712-884.711=0.000
σ0.008-0.007=0.001
min884.703-884.705=-0.001
max884.723-884.722=0.000
mean1641.000-1631.000=10.000
σ0.000
min1641.000-1631.000=10.000
max1641.000-1631.000=10.000
mean0.710-0.706=0.005
σ0.029-0.044=-0.015
min0.681-0.648=0.032
max0.740-0.741=-0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715
σ0.002
min7.714
max7.718
mean1641.000-1631.000=10.000
σ0.000
min1641.000-1631.000=10.000
max1641.000-1631.000=10.000
mean4.214-4.216=-0.002
σ0.081-0.068=0.013
min4.030-4.105=-0.076
max4.518-4.452=0.066
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.669-7.670=-0.001
mean1641.000-1631.000=10.000
σ0.000
min1641.000-1631.000=10.000
max1641.000-1631.000=10.000
mean3.533-4.204=-0.670
σ0.198-0.064=0.134
min3.354-4.051=-0.697
max4.276-4.375=-0.099
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1641.000-1631.000=10.000
σ0.000
min1641.000-1631.000=10.000
max1641.000-1631.000=10.000
mean0.737-0.677=0.059
σ0.018-0.098=-0.080
min0.707-0.514=0.193
max0.842-0.864=-0.022
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1641.000-1631.000=10.000
σ0.000
min1641.000-1631.000=10.000
max1641.000-1631.000=10.000
mean0.690-0.501=0.189
σ0.014-0.012=0.002
min0.655-0.476=0.179
max0.753-0.563=0.190

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.453-296.464=-0.011
σ0.242-0.220=0.022
min296.208-296.324=-0.115
max297.100-297.048=0.052
mean1953.000-1916.000=37.000
σ0.000
min1953.000-1916.000=37.000
max1953.000-1916.000=37.000
mean0.589-0.576=0.014
σ0.035-0.039=-0.005
min0.539-0.517=0.022
max0.665-0.659=0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.694-284.697=-0.003
σ0.037-0.035=0.002
min284.642-284.652=-0.010
max284.734-284.738=-0.003
mean1641.000-1631.000=10.000
σ0.000
min1641.000-1631.000=10.000
max1641.000-1631.000=10.000
mean0.398-0.398=-0.000
σ0.007-0.010=-0.003
min0.385-0.385=0.001
max0.403-0.407=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.075-1295.081=-0.006
σ0.103-0.110=-0.006
min1294.960-1294.961=-0.001
max1295.206-1295.211=-0.006
mean1641.000-1631.000=10.000
σ0.000
min1641.000-1631.000=10.000
max1641.000-1631.000=10.000
mean1.920-1.931=-0.012
σ0.117-0.096=0.021
min1.791-1.829=-0.038
max2.048-2.023=0.025
iters=5
new-facts=6402
prior-facts=1
mean1539.211-1539.191=0.019
σ6.828-6.855=-0.027
min1535.919-1535.925=-0.006
max1551.420-1551.450=-0.031
mean1641.000-1631.000=10.000
σ0.000
min1641.000-1631.000=10.000
max1641.000-1631.000=10.000
mean2.362-2.260=0.102
σ0.244-0.268=-0.025
min2.052-2.028=0.024
max2.692-2.658=0.034
iters=5
new-facts=6402
prior-facts=6402
mean1856.983-1856.987=-0.004
σ0.061-0.053=0.009
min1856.930-1856.930=-0.000
max1857.069-1857.061=0.008
mean1791.200-1771.400=19.800
σ156.538-140.030=16.509
min1641.000-1631.000=10.000
max1953.000-1916.000=37.000
mean2.937-3.101=-0.164
σ0.153-0.316=-0.163
min2.822-2.883=-0.061
max3.185-3.657=-0.471

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.181-1.213=-0.032
σ0.208-0.273=-0.065
min0.927-0.954=-0.027
max1.459-1.652=-0.193

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.786=0.001
σ581.212-581.213=-0.000
min157.179-157.176=0.003
max1319.605-1319.605=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1641.000-1631.000=10.000
σ0.000
min1641.000-1631.000=10.000
max1641.000-1631.000=10.000
mean0.538-0.532=0.006
σ0.558-0.538=0.020
min0.255-0.261=-0.006
max1.374-1.339=0.036
policies=20
mean1572.099-1572.102=-0.003
σ0.344-0.353=-0.009
min1571.864-1571.868=-0.003
max1572.610-1572.626=-0.017
mean920.000
σ0.000
min920.000
max920.000
mean1641.000-1631.000=10.000
σ0.000
min1641.000-1631.000=10.000
max1641.000-1631.000=10.000
mean2.621-2.629=-0.008
σ0.023-0.018=0.005
min2.595-2.607=-0.012
max2.651-2.645=0.006
policies=200
mean15729.091-15729.078=0.013
σ0.120-0.107=0.013
min15728.986-15728.998=-0.012
max15729.262-15729.233=0.029
mean9200.000
σ0.000
min9200.000
max9200.000
mean1641.000-1631.000=10.000
σ0.000
min1641.000-1631.000=10.000
max1641.000-1631.000=10.000
mean26.528-26.545=-0.017
σ0.212-0.033=0.179
min26.349-26.513=-0.164
max26.776-26.581=0.194