Compare commits

Home / Compare 2be88b2c .. 53c31eff

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.964-54.015=-0.050
σ0.370-0.371=-0.001
min53.819-53.868=-0.049
max55.016-55.069=-0.053
mean417.000-415.700=1.300
σ0.000-0.483=-0.483
min417.000-415.000=2.000
max417.000-416.000=1.000
mean0.140-0.137=0.002
σ0.003-0.006=-0.003
min0.136-0.129=0.007
max0.146-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.321-43.322=-0.001
σ0.007-0.005=0.002
min43.311-43.315=-0.004
max43.334-43.330=0.004
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.123-0.122=0.002
σ0.005-0.004=0.001
min0.119-0.118=0.002
max0.135-0.129=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.517-1006.312=0.205
σ1.165-1.164=0.001
min1005.951-1005.744=0.207
max1011.394-1011.181=0.213
mean1065.550-1049.350=16.200
σ319.832-303.784=16.048
min561.000-597.000=-36.000
max1618.000-1640.000=-22.000
mean1.528-1.556=-0.027
σ0.042-0.091=-0.049
min1.468-1.454=0.014
max1.606-1.837=-0.231

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.866=0.018
σ0.003
min0.882-0.864=0.018
max0.887-0.869=0.018
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean0.418-0.414=0.005
σ0.145-0.166=-0.020
min0.330-0.311=0.019
max0.676-0.706=-0.030
name=error_case.art
mean2.339-2.337=0.002
σ0.003-0.003=0.000
min2.337-2.336=0.001
max2.344-2.341=0.003
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean0.881-0.924=-0.043
σ0.083-0.164=-0.081
min0.825-0.831=-0.007
max1.025-1.217=-0.192
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002-0.002=0.000
min1.522-1.522=0.001
max1.526-1.526=0.001
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean0.536-0.534=0.002
σ0.049-0.049=0.000
min0.500-0.489=0.011
max0.621-0.613=0.008
name=nested_use.art
mean2.361-2.361=0.000
σ0.003-0.003=-0.000
min2.360-2.359=0.001
max2.366-2.365=0.001
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean0.863-0.844=0.020
σ0.046-0.033=0.013
min0.833-0.816=0.017
max0.944-0.897=0.047

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.830-964.112=0.718
σ0.027-0.022=0.004
min964.802-964.090=0.712
max964.864-964.145=0.719
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean0.827-0.810=0.017
σ0.038-0.043=-0.005
min0.781-0.739=0.042
max0.858-0.850=0.008
name=cdr_enhanced_4k_loc.art
mean885.512-884.713=0.799
σ0.008-0.001=0.007
min885.504-884.712=0.792
max885.523-884.714=0.809
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean0.691-0.708=-0.016
σ0.026-0.036=-0.010
min0.658-0.666=-0.008
max0.730-0.739=-0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.715=0.002
σ0.002-0.002=0.000
min7.715-7.714=0.002
max7.721-7.719=0.002
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean4.237-4.277=-0.040
σ0.079-0.090=-0.011
min4.098-4.134=-0.036
max4.483-4.695=-0.213
name=record_render_large_syntax_err.art
mean7.665-7.663=0.002
σ0.002-0.002=-0.000
min7.664-7.662=0.002
max7.668-7.666=0.002
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean4.227-4.246=-0.019
σ0.084-0.071=0.012
min4.084-4.133=-0.049
max4.621-4.539=0.082
name=record_render_success.art
mean2.291-2.289=0.001
σ0.002
min2.290-2.289=0.001
max2.294-2.292=0.001
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean0.741-0.732=0.009
σ0.019-0.017=0.002
min0.711-0.705=0.006
max0.849-0.834=0.015
name=record_render_syntax_err.art
mean2.166-2.165=0.001
σ0.002
min2.165-2.164=0.001
max2.169-2.168=0.001
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean0.701-0.691=0.010
σ0.028-0.017=0.011
min0.538-0.649=-0.111
max0.765-0.780=-0.015

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.292-296.193=0.100
σ0.264-0.190=0.075
min296.122-296.010=0.112
max297.016-296.705=0.312
mean1919.000-1906.000=13.000
σ0.000
min1919.000-1906.000=13.000
max1919.000-1906.000=13.000
mean0.573-0.594=-0.021
σ0.042-0.035=0.008
min0.510-0.550=-0.041
max0.644-0.680=-0.037

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.026-284.693=0.333
σ0.042-0.038=0.004
min284.980-284.642=0.338
max285.071-284.736=0.335
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean0.397-0.395=0.001
σ0.006-0.011=-0.005
min0.390-0.383=0.007
max0.405-0.407=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.415-1295.074=0.342
σ0.117-0.109=0.007
min1295.279-1294.963=0.316
max1295.558-1295.207=0.351
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean2.001-1.915=0.086
σ0.129-0.100=0.029
min1.806-1.798=0.008
max2.157-2.020=0.137
iters=5
new-facts=6402
prior-facts=1
mean1539.518-1539.186=0.332
σ6.848-6.840=0.008
min1536.238-1535.924=0.314
max1551.763-1551.419=0.344
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean2.259-2.240=0.019
σ0.198-0.263=-0.065
min2.022-2.040=-0.017
max2.492-2.666=-0.174
iters=5
new-facts=6402
prior-facts=6402
mean1857.318-1856.980=0.338
σ0.057-0.063=-0.007
min1857.272-1856.907=0.365
max1857.407-1857.069=0.338
mean1771.800-1773.200=-1.400
σ143.888-130.433=13.455
min1618.000-1640.000=-22.000
max1919.000-1906.000=13.000
mean3.059-3.061=-0.002
σ0.253-0.289=-0.036
min2.851-2.851=0.000
max3.496-3.566=-0.070

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.364-1.137=0.227
σ0.307-0.254=0.053
min1.065-0.936=0.129
max1.814-1.526=0.287

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.195-447.785=0.410
σ581.341-581.212=0.129
min157.522-157.177=0.345
max1320.206-1319.603=0.603
mean96.250
σ8.500
min92.000
max109.000
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean0.546-0.535=0.010
σ0.566-0.549=0.017
min0.261-0.258=0.002
max1.394-1.359=0.035
policies=20
mean1575.575-1572.103=3.472
σ0.385-0.355=0.030
min1575.320-1571.867=3.453
max1576.148-1572.631=3.517
mean920.000
σ0.000
min920.000
max920.000
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean2.671-2.629=0.042
σ0.076-0.024=0.052
min2.613-2.607=0.006
max2.781-2.655=0.126
policies=200
mean15763.759-15728.972=34.787
σ0.097-0.076=0.021
min15763.676-15728.902=34.774
max15763.897-15729.050=34.847
mean9200.000
σ0.000
min9200.000
max9200.000
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean26.534-26.535=-0.001
σ0.071-0.082=-0.011
min26.459-26.470=-0.010
max26.624-26.654=-0.030