Compare commits

Home / Compare 85c53b34 .. 8b1d2b1a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.014=0.001
σ0.371-0.370=0.001
min53.878-53.869=0.008
max55.070-55.066=0.004
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.141-0.138=0.003
σ0.006-0.006=-0.000
min0.136-0.130=0.005
max0.153-0.147=0.006
cache=y
dps=1
iters=10
policies=100
mean43.321-43.323=-0.002
σ0.006-0.006=0.000
min43.316-43.310=0.005
max43.333-43.334=-0.001
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.121-0.126=-0.005
σ0.005-0.007=-0.002
min0.116-0.119=-0.003
max0.128-0.143=-0.014

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.307-1006.307=0.001
σ1.177-1.186=-0.009
min1005.764-1005.773=-0.008
max1011.238-1011.268=-0.030
mean1045.300-1055.000=-9.700
σ313.973-318.715=-4.743
min595.000-599.000=-4.000
max1643.000-1621.000=22.000
mean1.554-1.559=-0.005
σ0.089-0.099=-0.011
min1.426-1.346=0.080
max1.801-1.797=0.004

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean0.414-0.410=0.003
σ0.135-0.149=-0.014
min0.332-0.318=0.014
max0.652-0.673=-0.021
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean0.891-0.915=-0.025
σ0.092-0.102=-0.010
min0.834-0.830=0.005
max1.054-1.061=-0.008
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean0.574-0.551=0.023
σ0.063-0.039=0.024
min0.500-0.519=-0.019
max0.643-0.614=0.030
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean0.866-0.845=0.020
σ0.037-0.035=0.002
min0.834-0.811=0.023
max0.929-0.898=0.030

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.114=0.001
σ0.033-0.033=0.000
min964.088-964.086=0.002
max964.170-964.169=0.001
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean0.842-0.818=0.025
σ0.025-0.053=-0.028
min0.799-0.736=0.063
max0.862-0.858=0.003
name=cdr_enhanced_4k_loc.art
mean884.710-884.712=-0.002
σ0.007-0.007=-0.000
min884.703-884.705=-0.001
max884.721-884.721=-0.000
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean0.671-0.737=-0.066
σ0.039-0.005=0.034
min0.619-0.731=-0.112
max0.724-0.744=-0.021

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.721-7.719=0.002
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean4.275-3.513=0.762
σ0.089-0.080=0.009
min4.145-3.388=0.757
max4.572-3.935=0.637
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean4.250-3.538=0.711
σ0.057-0.080=-0.023
min4.150-3.428=0.721
max4.425-3.824=0.601
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean0.739-0.491=0.248
σ0.042-0.085=-0.043
min0.542-0.294=0.248
max0.866-0.619=0.246
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean0.696-0.284=0.412
σ0.017-0.007=0.010
min0.661-0.264=0.397
max0.781-0.319=0.462

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.161-296.161=0.001
σ0.276-0.237=0.039
min295.936-295.919=0.016
max296.912-296.791=0.121
mean1902.000-1909.000=-7.000
σ0.000
min1902.000-1909.000=-7.000
max1902.000-1909.000=-7.000
mean0.582-0.566=0.016
σ0.059-0.040=0.019
min0.505-0.507=-0.002
max0.703-0.607=0.096

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.704-284.690=0.014
σ0.025-0.034=-0.009
min284.677-284.644=0.033
max284.733-284.726=0.006
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean0.401-0.392=0.009
σ0.018-0.009=0.010
min0.383-0.383=-0.000
max0.428-0.405=0.022
iters=5
new-facts=1
prior-facts=6402
mean1295.079-1295.083=-0.005
σ0.112-0.115=-0.003
min1294.961-1294.959=0.002
max1295.219-1295.227=-0.008
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean1.923-1.899=0.023
σ0.108-0.083=0.025
min1.799-1.810=-0.011
max2.028-2.008=0.020
iters=5
new-facts=6402
prior-facts=1
mean1539.194-1539.188=0.006
σ6.882-6.849=0.034
min1535.914-1535.950=-0.036
max1551.501-1551.435=0.066
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean2.298-2.229=0.069
σ0.211-0.228=-0.017
min2.043-1.984=0.058
max2.564-2.484=0.080
iters=5
new-facts=6402
prior-facts=6402
mean1856.985-1856.987=-0.002
σ0.060-0.051=0.009
min1856.924-1856.933=-0.010
max1857.066-1857.065=0.002
mean1770.200-1773.200=-3.000
σ128.719-136.471=-7.751
min1643.000-1621.000=22.000
max1902.000-1909.000=-7.000
mean3.030-3.008=0.023
σ0.167-0.293=-0.126
min2.872-2.744=0.128
max3.302-3.501=-0.198

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.214-1.260=-0.046
σ0.344-0.333=0.011
min0.932-0.937=-0.005
max1.793-1.786=0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.785=0.001
σ581.212-581.212=-0.000
min157.179-157.177=0.001
max1319.605-1319.604=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean0.542-0.546=-0.004
σ0.566-0.568=-0.002
min0.258-0.259=-0.001
max1.392-1.398=-0.006
policies=20
mean1572.105-1572.103=0.002
σ0.357-0.354=0.003
min1571.865-1571.861=0.004
max1572.637-1572.630=0.007
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean2.630-2.632=-0.002
σ0.020-0.025=-0.005
min2.609-2.614=-0.005
max2.650-2.667=-0.018
policies=200
mean15729.073-15728.973=0.100
σ0.113-0.081=0.032
min15729.000-15728.877=0.123
max15729.239-15729.070=0.169
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1621.000=22.000
σ0.000
min1643.000-1621.000=22.000
max1643.000-1621.000=22.000
mean26.430-26.486=-0.056
σ0.055-0.031=0.024
min26.380-26.459=-0.079
max26.502-26.520=-0.018