Compare commits

Home / Compare 38de5fc2 .. 1e8fadc2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.016-54.015=0.000
σ0.369-0.370=-0.001
min53.872-53.869=0.003
max55.065-55.069=-0.004
mean420.000-415.000=5.000
σ0.000
min420.000-415.000=5.000
max420.000-415.000=5.000
mean0.139-0.140=-0.000
σ0.004-0.004=0.000
min0.136-0.136=0.000
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.001
σ0.007-0.006=0.001
min43.307-43.311=-0.004
max43.332-43.333=-0.001
mean420.000-415.000=5.000
σ0.000
min420.000-415.000=5.000
max420.000-415.000=5.000
mean0.119-0.121=-0.002
σ0.004-0.002=0.002
min0.114-0.119=-0.005
max0.126-0.126=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.306-1006.313=-0.007
σ1.175-1.153=0.022
min1005.775-1005.740=0.034
max1011.219-1011.135=0.084
mean1048.700-1053.150=-4.450
σ312.161-315.938=-3.778
min599.000-564.000=35.000
max1637.000-1613.000=24.000
mean1.545-1.508=0.037
σ0.108-0.057=0.051
min1.456-1.451=0.004
max1.799-1.648=0.151

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1637.000-1613.000=24.000
σ0.000
min1637.000-1613.000=24.000
max1637.000-1613.000=24.000
mean0.467-0.417=0.050
σ0.173-0.137=0.036
min0.318-0.325=-0.006
max0.660-0.657=0.003
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1637.000-1613.000=24.000
σ0.000
min1637.000-1613.000=24.000
max1637.000-1613.000=24.000
mean0.886-0.895=-0.009
σ0.136-0.106=0.030
min0.807-0.836=-0.029
max1.127-1.082=0.045
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1637.000-1613.000=24.000
σ0.000
min1637.000-1613.000=24.000
max1637.000-1613.000=24.000
mean0.529-0.559=-0.030
σ0.054-0.075=-0.020
min0.484-0.497=-0.014
max0.620-0.682=-0.062
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1637.000-1613.000=24.000
σ0.000
min1637.000-1613.000=24.000
max1637.000-1613.000=24.000
mean0.825-0.844=-0.020
σ0.037-0.043=-0.006
min0.800-0.801=-0.002
max0.889-0.907=-0.018

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.115=-0.000
σ0.025-0.034=-0.009
min964.094-964.086=0.008
max964.155-964.170=-0.015
mean1637.000-1613.000=24.000
σ0.000
min1637.000-1613.000=24.000
max1637.000-1613.000=24.000
mean0.822-0.815=0.007
σ0.035-0.035=-0.000
min0.769-0.760=0.010
max0.856-0.854=0.002
name=cdr_enhanced_4k_loc.art
mean884.712-884.711=0.001
σ0.007-0.008=-0.001
min884.705-884.705=0.000
max884.721-884.723=-0.002
mean1637.000-1613.000=24.000
σ0.000
min1637.000-1613.000=24.000
max1637.000-1613.000=24.000
mean0.715-0.719=-0.004
σ0.030-0.033=-0.003
min0.675-0.666=0.009
max0.740-0.744=-0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.720-7.719=0.001
mean1637.000-1613.000=24.000
σ0.000
min1637.000-1613.000=24.000
max1637.000-1613.000=24.000
mean4.199-4.269=-0.069
σ0.139-0.103=0.036
min3.574-4.115=-0.541
max4.573-4.775=-0.202
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1637.000-1613.000=24.000
σ0.000
min1637.000-1613.000=24.000
max1637.000-1613.000=24.000
mean4.232-4.254=-0.022
σ0.080-0.075=0.005
min4.093-4.086=0.007
max4.493-4.448=0.045
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1637.000-1613.000=24.000
σ0.000
min1637.000-1613.000=24.000
max1637.000-1613.000=24.000
mean0.735-0.731=0.004
σ0.016-0.017=-0.001
min0.702-0.704=-0.002
max0.839-0.847=-0.008
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1637.000-1613.000=24.000
σ0.000
min1637.000-1613.000=24.000
max1637.000-1613.000=24.000
mean0.693-0.697=-0.004
σ0.017-0.015=0.002
min0.654-0.670=-0.016
max0.778-0.765=0.014

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.208-296.248=-0.041
σ0.210-0.193=0.016
min296.022-296.047=-0.025
max296.775-296.765=0.010
mean1910.000-1904.000=6.000
σ0.000
min1910.000-1904.000=6.000
max1910.000-1904.000=6.000
mean0.573-0.583=-0.010
σ0.054-0.052=0.001
min0.500-0.533=-0.033
max0.673-0.705=-0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.699-284.697=0.001
σ0.036-0.030=0.006
min284.655-284.664=-0.008
max284.741-284.732=0.010
mean1637.000-1613.000=24.000
σ0.000
min1637.000-1613.000=24.000
max1637.000-1613.000=24.000
mean0.396-0.399=-0.003
σ0.011-0.012=-0.001
min0.384-0.384=-0.000
max0.407-0.410=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.084-1295.090=-0.006
σ0.116-0.130=-0.014
min1294.963-1294.960=0.003
max1295.224-1295.268=-0.044
mean1637.000-1613.000=24.000
σ0.000
min1637.000-1613.000=24.000
max1637.000-1613.000=24.000
mean1.865-1.894=-0.029
σ0.075-0.093=-0.018
min1.795-1.786=0.009
max1.969-2.004=-0.035
iters=5
new-facts=6402
prior-facts=1
mean1539.191-1539.178=0.014
σ6.852-6.846=0.007
min1535.966-1535.926=0.040
max1551.446-1551.421=0.026
mean1637.000-1613.000=24.000
σ0.000
min1637.000-1613.000=24.000
max1637.000-1613.000=24.000
mean2.186-2.238=-0.052
σ0.173-0.227=-0.054
min2.008-2.018=-0.010
max2.411-2.534=-0.123
iters=5
new-facts=6402
prior-facts=6402
mean1856.981-1856.983=-0.002
σ0.065-0.063=0.002
min1856.902-1856.910=-0.008
max1857.075-1857.069=0.005
mean1776.000-1765.800=10.200
σ131.809-137.347=-5.538
min1637.000-1613.000=24.000
max1910.000-1904.000=6.000
mean3.049-3.049=-0.000
σ0.324-0.338=-0.014
min2.810-2.818=-0.008
max3.607-3.648=-0.041

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.201-1.224=-0.023
σ0.367-0.348=0.019
min0.921-0.932=-0.011
max1.809-1.786=0.023

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.786=-0.001
σ581.213-581.212=0.000
min157.176-157.179=-0.002
max1319.604-1319.605=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1637.000-1613.000=24.000
σ0.000
min1637.000-1613.000=24.000
max1637.000-1613.000=24.000
mean0.522-0.536=-0.014
σ0.521-0.555=-0.034
min0.259-0.258=0.001
max1.303-1.368=-0.065
policies=20
mean1572.095-1572.101=-0.006
σ0.340-0.349=-0.009
min1571.864-1571.866=-0.003
max1572.601-1572.620=-0.020
mean920.000
σ0.000
min920.000
max920.000
mean1637.000-1613.000=24.000
σ0.000
min1637.000-1613.000=24.000
max1637.000-1613.000=24.000
mean2.611-2.616=-0.005
σ0.029-0.018=0.012
min2.573-2.598=-0.026
max2.643-2.635=0.008
policies=200
mean15729.067-15728.967=0.100
σ0.078-0.117=-0.039
min15729.010-15728.817=0.193
max15729.180-15729.090=0.090
mean9200.000
σ0.000
min9200.000
max9200.000
mean1637.000-1613.000=24.000
σ0.000
min1637.000-1613.000=24.000
max1637.000-1613.000=24.000
mean26.490-26.418=0.071
σ0.171-0.153=0.018
min26.381-26.289=0.092
max26.745-26.634=0.111