Compare commits

Home / Compare 6612faa2 .. 45880858

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.014=0.001
σ0.371-0.368=0.003
min53.873-53.876=-0.003
max55.069-55.059=0.010
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.140-0.139=0.000
σ0.004-0.005=-0.001
min0.136-0.132=0.004
max0.147-0.147=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.322-43.321=0.001
σ0.005-0.007=-0.002
min43.314-43.315=-0.001
max43.334-43.337=-0.003
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.119-0.117=0.002
σ0.002-0.003=-0.000
min0.115-0.114=0.001
max0.122-0.121=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1006.307=0.002
σ1.160-1.195=-0.034
min1005.750-1005.769=-0.019
max1011.165-1011.315=-0.150
mean1046.500-1050.900=-4.400
σ313.135-303.756=9.379
min597.000-585.000=12.000
max1641.000-1639.000=2.000
mean1.538-1.548=-0.011
σ0.081-0.096=-0.015
min1.467-1.467=-0.000
max1.780-1.761=0.019

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1641.000-1639.000=2.000
σ0.000
min1641.000-1639.000=2.000
max1641.000-1639.000=2.000
mean0.410-0.419=-0.008
σ0.129-0.133=-0.004
min0.332-0.337=-0.005
max0.639-0.653=-0.014
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1641.000-1639.000=2.000
σ0.000
min1641.000-1639.000=2.000
max1641.000-1639.000=2.000
mean0.882-0.898=-0.017
σ0.100-0.088=0.011
min0.813-0.829=-0.016
max1.056-1.051=0.004
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1641.000-1639.000=2.000
σ0.000
min1641.000-1639.000=2.000
max1641.000-1639.000=2.000
mean0.546-0.574=-0.027
σ0.045-0.069=-0.024
min0.501-0.517=-0.016
max0.617-0.661=-0.044
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1641.000-1639.000=2.000
σ0.000
min1641.000-1639.000=2.000
max1641.000-1639.000=2.000
mean0.847-0.847=-0.000
σ0.039-0.043=-0.004
min0.808-0.804=0.003
max0.910-0.916=-0.006

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.115=0.000
σ0.034-0.034=-0.000
min964.086-964.088=-0.001
max964.170-964.171=-0.001
mean1641.000-1639.000=2.000
σ0.000
min1641.000-1639.000=2.000
max1641.000-1639.000=2.000
mean0.826-0.827=-0.001
σ0.047-0.028=0.019
min0.746-0.788=-0.042
max0.857-0.854=0.003
name=cdr_enhanced_4k_loc.art
mean884.711-884.712=-0.000
σ0.007-0.007=-0.001
min884.705-884.705=-0.000
max884.720-884.722=-0.002
mean1641.000-1639.000=2.000
σ0.000
min1641.000-1639.000=2.000
max1641.000-1639.000=2.000
mean0.719-0.710=0.009
σ0.031-0.038=-0.007
min0.670-0.647=0.023
max0.743-0.736=0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.721-7.719=0.002
mean1641.000-1639.000=2.000
σ0.000
min1641.000-1639.000=2.000
max1641.000-1639.000=2.000
mean4.233-4.274=-0.041
σ0.097-0.077=0.021
min4.100-4.146=-0.047
max4.577-4.555=0.022
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1641.000-1639.000=2.000
σ0.000
min1641.000-1639.000=2.000
max1641.000-1639.000=2.000
mean4.206-4.229=-0.023
σ0.084-0.070=0.014
min4.089-4.102=-0.013
max4.537-4.577=-0.040
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1641.000-1639.000=2.000
σ0.000
min1641.000-1639.000=2.000
max1641.000-1639.000=2.000
mean0.744-0.731=0.013
σ0.018-0.020=-0.001
min0.714-0.699=0.014
max0.858-0.858=0.000
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1641.000-1639.000=2.000
σ0.000
min1641.000-1639.000=2.000
max1641.000-1639.000=2.000
mean0.535-0.688=-0.153
σ0.078-0.022=0.056
min0.482-0.571=-0.089
max0.801-0.781=0.020

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.098-296.290=-0.192
σ0.261-0.237=0.023
min295.896-296.051=-0.155
max296.800-296.909=-0.108
mean1909.000-1906.000=3.000
σ0.000
min1909.000-1906.000=3.000
max1909.000-1906.000=3.000
mean0.578-0.593=-0.015
σ0.061-0.037=0.024
min0.503-0.570=-0.067
max0.713-0.695=0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.691-284.705=-0.014
σ0.037-0.024=0.013
min284.641-284.681=-0.040
max284.734-284.733=0.001
mean1641.000-1639.000=2.000
σ0.000
min1641.000-1639.000=2.000
max1641.000-1639.000=2.000
mean0.391-0.395=-0.004
σ0.007-0.010=-0.004
min0.386-0.387=-0.002
max0.402-0.407=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.087-1295.076=0.011
σ0.123-0.105=0.018
min1294.957-1294.961=-0.004
max1295.238-1295.203=0.035
mean1641.000-1639.000=2.000
σ0.000
min1641.000-1639.000=2.000
max1641.000-1639.000=2.000
mean1.925-1.936=-0.011
σ0.104-0.102=0.002
min1.813-1.820=-0.008
max2.043-2.036=0.008
iters=5
new-facts=6402
prior-facts=1
mean1539.182-1539.191=-0.009
σ6.839-6.846=-0.008
min1535.937-1535.930=0.007
max1551.412-1551.433=-0.021
mean1641.000-1639.000=2.000
σ0.000
min1641.000-1639.000=2.000
max1641.000-1639.000=2.000
mean2.213-2.238=-0.025
σ0.186-0.174=0.012
min2.029-2.048=-0.019
max2.466-2.440=0.026
iters=5
new-facts=6402
prior-facts=6402
mean1856.991-1856.989=0.001
σ0.056-0.054=0.003
min1856.927-1856.936=-0.009
max1857.068-1857.066=0.002
mean1775.200-1773.000=2.200
σ131.218-130.689=0.530
min1641.000-1639.000=2.000
max1909.000-1906.000=3.000
mean3.074-3.088=-0.014
σ0.282-0.276=0.006
min2.864-2.876=-0.011
max3.562-3.566=-0.004

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.218-1.235=-0.017
σ0.328-0.278=0.050
min0.930-0.936=-0.005
max1.766-1.652=0.115

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.786=-0.000
σ581.212-581.212=-0.000
min157.179-157.179=-0.000
max1319.604-1319.605=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1641.000-1639.000=2.000
σ0.000
min1641.000-1639.000=2.000
max1641.000-1639.000=2.000
mean0.546-0.556=-0.011
σ0.571-0.588=-0.017
min0.256-0.260=-0.004
max1.402-1.439=-0.037
policies=20
mean1572.108-1572.099=0.009
σ0.363-0.345=0.017
min1571.864-1571.861=0.003
max1572.648-1572.611=0.036
mean920.000
σ0.000
min920.000
max920.000
mean1641.000-1639.000=2.000
σ0.000
min1641.000-1639.000=2.000
max1641.000-1639.000=2.000
mean2.633-2.631=0.002
σ0.015-0.014=0.001
min2.622-2.617=0.004
max2.654-2.651=0.003
policies=200
mean15729.064-15729.015=0.049
σ0.036-0.184=-0.148
min15729.028-15728.831=0.197
max15729.113-15729.270=-0.158
mean9200.000
σ0.000
min9200.000
max9200.000
mean1641.000-1639.000=2.000
σ0.000
min1641.000-1639.000=2.000
max1641.000-1639.000=2.000
mean26.492-26.514=-0.022
σ0.183-0.064=0.119
min26.362-26.446=-0.083
max26.763-26.581=0.182