Compare commits

Home / Compare a2fb0f3b .. 491e17ab

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.016=-0.001
σ0.368-0.369=-0.000
min53.869-53.870=-0.001
max55.063-55.064=-0.002
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.141-0.141=-0.001
σ0.005-0.004=0.001
min0.136-0.136=0.000
max0.154-0.147=0.006
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=0.000
σ0.005-0.007=-0.002
min43.314-43.309=0.005
max43.333-43.334=-0.001
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.122-0.121=0.001
σ0.003-0.005=-0.001
min0.118-0.115=0.003
max0.128-0.129=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1006.310=-0.000
σ1.175-1.178=-0.003
min1005.769-1005.765=0.003
max1011.229-1011.242=-0.014
mean1044.550-1046.200=-1.650
σ313.262-311.921=1.340
min596.000-597.000=-1.000
max1638.000-1634.000=4.000
mean1.555-1.570=-0.015
σ0.088-0.098=-0.010
min1.352-1.485=-0.133
max1.758-1.841=-0.082

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1638.000-1634.000=4.000
σ0.000
min1638.000-1634.000=4.000
max1638.000-1634.000=4.000
mean0.406-0.417=-0.011
σ0.136-0.143=-0.006
min0.326-0.340=-0.014
max0.647-0.671=-0.024
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1638.000-1634.000=4.000
σ0.000
min1638.000-1634.000=4.000
max1638.000-1634.000=4.000
mean0.873-0.881=-0.008
σ0.090-0.096=-0.007
min0.809-0.816=-0.007
max1.026-1.050=-0.025
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1638.000-1634.000=4.000
σ0.000
min1638.000-1634.000=4.000
max1638.000-1634.000=4.000
mean0.531-0.538=-0.006
σ0.055-0.052=0.003
min0.489-0.492=-0.003
max0.626-0.625=0.002
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1638.000-1634.000=4.000
σ0.000
min1638.000-1634.000=4.000
max1638.000-1634.000=4.000
mean0.827-0.825=0.002
σ0.034-0.040=-0.007
min0.799-0.790=0.009
max0.883-0.892=-0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.116=-0.001
σ0.033-0.034=-0.001
min964.088-964.086=0.001
max964.169-964.171=-0.001
mean1638.000-1634.000=4.000
σ0.000
min1638.000-1634.000=4.000
max1638.000-1634.000=4.000
mean0.837-0.821=0.015
σ0.021-0.056=-0.035
min0.812-0.728=0.084
max0.856-0.865=-0.009
name=cdr_enhanced_4k_loc.art
mean884.711-884.712=-0.001
σ0.004-0.007=-0.003
min884.703-884.705=-0.001
max884.714-884.722=-0.008
mean1638.000-1634.000=4.000
σ0.000
min1638.000-1634.000=4.000
max1638.000-1634.000=4.000
mean0.702-0.714=-0.013
σ0.045-0.032=0.013
min0.649-0.664=-0.015
max0.737-0.741=-0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.719=-0.002
mean1638.000-1634.000=4.000
σ0.000
min1638.000-1634.000=4.000
max1638.000-1634.000=4.000
mean4.196-2.726=1.470
σ0.071-0.102=-0.031
min4.065-2.552=1.513
max4.578-3.096=1.482
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666
mean1638.000-1634.000=4.000
σ0.000
min1638.000-1634.000=4.000
max1638.000-1634.000=4.000
mean4.182-2.722=1.460
σ0.059-0.087=-0.028
min4.078-2.579=1.499
max4.387-3.014=1.373
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1638.000-1634.000=4.000
σ0.000
min1638.000-1634.000=4.000
max1638.000-1634.000=4.000
mean0.731-0.524=0.207
σ0.018-0.014=0.004
min0.696-0.499=0.197
max0.859-0.608=0.251
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1638.000-1634.000=4.000
σ0.000
min1638.000-1634.000=4.000
max1638.000-1634.000=4.000
mean0.697-0.294=0.403
σ0.016-0.057=-0.042
min0.662-0.265=0.397
max0.762-0.542=0.219

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.437-296.213=0.224
σ0.255-0.218=0.036
min296.121-296.079=0.042
max297.073-296.822=0.251
mean1898.000-1912.000=-14.000
σ0.000
min1898.000-1912.000=-14.000
max1898.000-1912.000=-14.000
mean0.581-0.557=0.023
σ0.048-0.046=0.002
min0.515-0.498=0.016
max0.696-0.605=0.091

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.687-284.687=0.000
σ0.037-0.039=-0.001
min284.638-284.650=-0.012
max284.724-284.731=-0.007
mean1638.000-1634.000=4.000
σ0.000
min1638.000-1634.000=4.000
max1638.000-1634.000=4.000
mean0.395-0.407=-0.012
σ0.010-0.004=0.006
min0.383-0.403=-0.019
max0.402-0.414=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1295.040-1295.083=-0.043
σ0.091-0.115=-0.024
min1294.961-1294.958=0.003
max1295.185-1295.233=-0.048
mean1638.000-1634.000=4.000
σ0.000
min1638.000-1634.000=4.000
max1638.000-1634.000=4.000
mean1.889-2.006=-0.117
σ0.148-0.119=0.029
min1.788-1.891=-0.103
max2.149-2.156=-0.007
iters=5
new-facts=6402
prior-facts=1
mean1539.273-1539.187=0.086
σ6.772-6.862=-0.090
min1536.145-1535.902=0.243
max1551.386-1551.459=-0.073
mean1638.000-1634.000=4.000
σ0.000
min1638.000-1634.000=4.000
max1638.000-1634.000=4.000
mean2.353-2.264=0.089
σ0.260-0.208=0.052
min2.139-2.034=0.104
max2.749-2.517=0.232
iters=5
new-facts=6402
prior-facts=6402
mean1856.984-1856.995=-0.011
σ0.053-0.054=-0.001
min1856.934-1856.941=-0.007
max1857.063-1857.066=-0.003
mean1767.600-1770.800=-3.200
σ125.111-139.087=-13.976
min1638.000-1634.000=4.000
max1898.000-1912.000=-14.000
mean3.054-3.069=-0.015
σ0.276-0.332=-0.056
min2.834-2.854=-0.020
max3.531-3.658=-0.127

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.252-1.216=0.036
σ0.328-0.362=-0.034
min0.936-0.935=0.001
max1.793-1.787=0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.787=-0.001
σ581.212-581.212=0.000
min157.178-157.179=-0.001
max1319.604-1319.605=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1638.000-1634.000=4.000
σ0.000
min1638.000-1634.000=4.000
max1638.000-1634.000=4.000
mean0.544-0.542=0.002
σ0.567-0.566=0.000
min0.259-0.257=0.002
max1.394-1.391=0.003
policies=20
mean1572.113-1572.078=0.035
σ0.369-0.354=0.015
min1571.864-1571.846=0.019
max1572.662-1572.606=0.056
mean920.000
σ0.000
min920.000
max920.000
mean1638.000-1634.000=4.000
σ0.000
min1638.000-1634.000=4.000
max1638.000-1634.000=4.000
mean2.653-2.632=0.021
σ0.022-0.011=0.011
min2.639-2.617=0.022
max2.685-2.644=0.041
policies=200
mean15729.002-15729.003=-0.001
σ0.126-0.162=-0.036
min15728.900-15728.836=0.064
max15729.158-15729.207=-0.049
mean9200.000
σ0.000
min9200.000
max9200.000
mean1638.000-1634.000=4.000
σ0.000
min1638.000-1634.000=4.000
max1638.000-1634.000=4.000
mean26.598-26.524=0.074
σ0.162-0.130=0.032
min26.382-26.417=-0.036
max26.763-26.708=0.055