Compare commits

Home / Compare d59eb59a .. 7286be47

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.016=-0.001
σ0.370-0.369=0.001
min53.872-53.876=-0.004
max55.067-55.065=0.002
mean417.000-416.900=0.100
σ0.000-0.316=-0.316
min417.000-416.000=1.000
max417.000
mean0.140-0.140=-0.000
σ0.007-0.004=0.003
min0.130-0.133=-0.003
max0.149-0.146=0.003
cache=y
dps=1
iters=10
policies=100
mean43.324-43.322=0.002
σ0.007-0.006=0.001
min43.308-43.314=-0.005
max43.335-43.337=-0.003
mean417.000
σ0.000
min417.000
max417.000
mean0.130-0.120=0.010
σ0.010-0.003=0.007
min0.120-0.115=0.004
max0.149-0.124=0.025

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1006.309=0.000
σ1.175-1.162=0.013
min1005.744-1005.741=0.003
max1011.233-1011.177=0.055
mean1046.500-1044.400=2.100
σ313.302-312.550=0.752
min598.000-577.000=21.000
max1640.000-1634.000=6.000
mean1.544-1.564=-0.020
σ0.087-0.094=-0.007
min1.470-1.473=-0.002
max1.781-1.833=-0.052

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.404-0.408=-0.005
σ0.133-0.136=-0.003
min0.315-0.327=-0.012
max0.639-0.649=-0.010
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.896-0.890=0.006
σ0.094-0.088=0.006
min0.823-0.838=-0.015
max1.056-1.047=0.010
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.539-0.544=-0.005
σ0.064-0.054=0.010
min0.497-0.512=-0.015
max0.649-0.639=0.010
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.858-0.850=0.008
σ0.030-0.039=-0.009
min0.831-0.825=0.007
max0.909-0.919=-0.010

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.115=-0.002
σ0.028-0.035=-0.007
min964.095-964.086=0.008
max964.161-964.173=-0.012
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.812-0.832=-0.020
σ0.063-0.043=0.020
min0.708-0.765=-0.057
max0.857-0.867=-0.010
name=cdr_enhanced_4k_loc.art
mean884.712-884.711=0.000
σ0.008-0.008=0.000
min884.703
max884.722-884.723=-0.001
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.676-0.683=-0.006
σ0.047-0.073=-0.026
min0.614-0.595=0.018
max0.741-0.742=-0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.714-7.715=-0.000
σ0.002-0.002=0.000
min7.714
max7.718
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean4.301-4.261=0.040
σ0.085-0.102=-0.017
min4.110-4.103=0.007
max4.720-4.732=-0.012
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.666
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean4.273-4.211=0.062
σ0.072-0.086=-0.014
min4.101-4.065=0.036
max4.482-4.467=0.015
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.751-0.742=0.008
σ0.018-0.020=-0.003
min0.723-0.719=0.004
max0.850-0.895=-0.046
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.706-0.705=0.001
σ0.015-0.016=-0.000
min0.671-0.671=-0.000
max0.771-0.791=-0.020

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.216-296.324=-0.108
σ0.204-0.165=0.039
min296.071-296.191=-0.120
max296.756-296.751=0.005
mean1926.000-1899.000=27.000
σ0.000
min1926.000-1899.000=27.000
max1926.000-1899.000=27.000
mean0.578-0.603=-0.024
σ0.039-0.016=0.023
min0.513-0.574=-0.061
max0.647-0.635=0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.696-284.694=0.003
σ0.036-0.038=-0.002
min284.653-284.640=0.013
max284.736-284.732=0.004
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.403-0.398=0.005
σ0.009-0.009=0.000
min0.387-0.389=-0.002
max0.409-0.407=0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.084-1295.071=0.013
σ0.112-0.107=0.005
min1294.960-1294.946=0.014
max1295.226-1295.213=0.013
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean1.897-2.008=-0.110
σ0.085-0.122=-0.037
min1.806-1.833=-0.027
max2.011-2.168=-0.156
iters=5
new-facts=6402
prior-facts=1
mean1539.178-1539.206=-0.028
σ6.843-6.839=0.005
min1535.898-1535.958=-0.059
max1551.416-1551.437=-0.021
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean2.249-2.155=0.094
σ0.203-0.139=0.065
min2.025-2.043=-0.018
max2.448-2.391=0.058
iters=5
new-facts=6402
prior-facts=6402
mean1856.997-1856.980=0.016
σ0.062-0.052=0.010
min1856.931-1856.936=-0.006
max1857.065-1857.058=0.007
mean1777.800-1779.600=-1.800
σ143.472-125.532=17.940
min1640.000-1634.000=6.000
max1926.000-1899.000=27.000
mean2.949-2.987=-0.038
σ0.146-0.099=0.047
min2.804-2.832=-0.028
max3.106-3.107=-0.001

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.203-1.224=-0.021
σ0.255-0.212=0.043
min0.956-0.954=0.002
max1.614-1.511=0.103

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.786=-0.001
σ581.212-581.213=-0.000
min157.177-157.179=-0.002
max1319.603-1319.604=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.546-0.543=0.003
σ0.573-0.566=0.007
min0.259-0.254=0.004
max1.406-1.393=0.014
policies=20
mean1572.087-1572.103=-0.017
σ0.360-0.355=0.005
min1571.843-1571.863=-0.021
max1572.622-1572.630=-0.009
mean920.000
σ0.000
min920.000
max920.000
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean2.632-2.631=0.002
σ0.017-0.009=0.008
min2.617-2.622=-0.006
max2.655-2.639=0.015
policies=200
mean15729.082-15729.033=0.049
σ0.087-0.047=0.041
min15728.988-15728.976=0.012
max15729.200-15729.077=0.123
mean9200.000
σ0.000
min9200.000
max9200.000
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean26.609-26.501=0.107
σ0.213-0.032=0.181
min26.445-26.459=-0.014
max26.918-26.535=0.383