Compare commits

Home / Compare 61aef6b9 .. fe82e004

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.962-54.016=-0.054
σ0.369-0.370=-0.001
min53.816-53.869=-0.053
max55.011-55.068=-0.057
mean416.000
σ0.000
min416.000
max416.000
mean0.141-0.140=0.001
σ0.004-0.005=-0.001
min0.136-0.136=0.000
max0.148-0.150=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.324-43.323=0.001
σ0.007-0.007=0.001
min43.308-43.308=0.000
max43.335-43.333=0.001
mean416.000
σ0.000
min416.000
max416.000
mean0.121-0.122=-0.001
σ0.005-0.004=0.001
min0.115-0.117=-0.003
max0.131-0.128=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.511-1006.302=0.209
σ1.245-1.170=0.074
min1005.978-1005.769=0.209
max1011.730-1011.205=0.524
mean1050.450-1047.450=3.000
σ303.994-313.647=-9.653
min586.000-597.000=-11.000
max1639.000-1644.000=-5.000
mean1.587-1.564=0.023
σ0.139-0.083=0.056
min1.482-1.477=0.005
max2.085-1.780=0.304

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.866=0.018
σ0.003
min0.882-0.864=0.018
max0.887-0.869=0.018
mean1639.000-1644.000=-5.000
σ0.000
min1639.000-1644.000=-5.000
max1639.000-1644.000=-5.000
mean0.428-0.415=0.012
σ0.136-0.147=-0.010
min0.347-0.333=0.014
max0.668-0.676=-0.009
name=error_case.art
mean2.339-2.337=0.001
σ0.003
min2.337-2.336=0.001
max2.342-2.341=0.001
mean1639.000-1644.000=-5.000
σ0.000
min1639.000-1644.000=-5.000
max1639.000-1644.000=-5.000
mean0.929-0.882=0.047
σ0.094-0.096=-0.001
min0.846-0.817=0.029
max1.076-1.048=0.028
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002
min1.522-1.522=0.001
max1.526-1.526=0.001
mean1639.000-1644.000=-5.000
σ0.000
min1639.000-1644.000=-5.000
max1639.000-1644.000=-5.000
mean0.537-0.542=-0.005
σ0.054-0.054=-0.000
min0.500-0.491=0.009
max0.632-0.628=0.004
name=nested_use.art
mean2.361-2.360=0.001
σ0.002
min2.360-2.359=0.001
max2.364-2.363=0.001
mean1639.000-1644.000=-5.000
σ0.000
min1639.000-1644.000=-5.000
max1639.000-1644.000=-5.000
mean0.853-0.844=0.009
σ0.042-0.033=0.009
min0.821-0.822=-0.000
max0.924-0.901=0.024

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.115=0.724
σ0.034-0.035=-0.001
min964.811-964.086=0.725
max964.896-964.173=0.722
mean1639.000-1644.000=-5.000
σ0.000
min1639.000-1644.000=-5.000
max1639.000-1644.000=-5.000
mean0.834-0.842=-0.007
σ0.030-0.018=0.012
min0.794-0.817=-0.024
max0.861-0.859=0.002
name=cdr_enhanced_4k_loc.art
mean885.512-884.712=0.800
σ0.007-0.008=-0.000
min885.504-884.705=0.799
max885.522-884.723=0.799
mean1639.000-1644.000=-5.000
σ0.000
min1639.000-1644.000=-5.000
max1639.000-1644.000=-5.000
mean0.708-0.688=0.020
σ0.044-0.039=0.005
min0.638-0.640=-0.002
max0.743-0.732=0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.715=0.002
σ0.002-0.002=0.000
min7.715-7.714=0.002
max7.721-7.718=0.003
mean1639.000-1644.000=-5.000
σ0.000
min1639.000-1644.000=-5.000
max1639.000-1644.000=-5.000
mean3.490-4.270=-0.779
σ0.080-0.093=-0.013
min3.361-4.123=-0.762
max3.873-4.549=-0.676
name=record_render_large_syntax_err.art
mean7.665-7.663=0.002
σ0.002-0.002=-0.000
min7.664-7.662=0.002
max7.668-7.667=0.000
mean1639.000-1644.000=-5.000
σ0.000
min1639.000-1644.000=-5.000
max1639.000-1644.000=-5.000
mean3.484-4.234=-0.750
σ0.072-0.060=0.012
min3.343-4.142=-0.799
max3.766-4.402=-0.636
name=record_render_success.art
mean2.291-2.289=0.001
σ0.002
min2.290-2.289=0.001
max2.294-2.292=0.001
mean1639.000-1644.000=-5.000
σ0.000
min1639.000-1644.000=-5.000
max1639.000-1644.000=-5.000
mean0.742-0.735=0.007
σ0.017-0.018=-0.001
min0.707-0.706=0.002
max0.837-0.855=-0.018
name=record_render_syntax_err.art
mean2.166-2.165=0.001
σ0.002
min2.165-2.164=0.001
max2.169-2.168=0.001
mean1639.000-1644.000=-5.000
σ0.000
min1639.000-1644.000=-5.000
max1639.000-1644.000=-5.000
mean0.689-0.693=-0.004
σ0.041-0.020=0.020
min0.510-0.567=-0.058
max0.794-0.755=0.039

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.394-296.083=0.311
σ0.247-0.208=0.038
min296.182-295.960=0.222
max297.058-296.660=0.398
mean1913.000-1921.000=-8.000
σ0.000
min1913.000-1921.000=-8.000
max1913.000-1921.000=-8.000
mean0.583-0.588=-0.005
σ0.053-0.046=0.007
min0.505-0.510=-0.005
max0.689-0.691=-0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.031-284.700=0.331
σ0.037-0.036=0.001
min284.985-284.655=0.330
max285.073-284.742=0.331
mean1639.000-1644.000=-5.000
σ0.000
min1639.000-1644.000=-5.000
max1639.000-1644.000=-5.000
mean0.396-0.398=-0.002
σ0.008-0.011=-0.003
min0.386-0.385=0.001
max0.405-0.410=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.414-1295.080=0.335
σ0.111-0.110=0.001
min1295.288-1294.956=0.332
max1295.550-1295.214=0.336
mean1639.000-1644.000=-5.000
σ0.000
min1639.000-1644.000=-5.000
max1639.000-1644.000=-5.000
mean1.985-1.937=0.048
σ0.123-0.113=0.010
min1.814-1.807=0.006
max2.156-2.113=0.043
iters=5
new-facts=6402
prior-facts=1
mean1539.574-1539.214=0.361
σ6.807-6.860=-0.053
min1536.320-1535.912=0.408
max1551.747-1551.479=0.268
mean1639.000-1644.000=-5.000
σ0.000
min1639.000-1644.000=-5.000
max1639.000-1644.000=-5.000
mean2.386-2.339=0.047
σ0.240-0.199=0.041
min2.030-2.050=-0.020
max2.673-2.545=0.129
iters=5
new-facts=6402
prior-facts=6402
mean1857.315-1856.986=0.329
σ0.057-0.055=0.002
min1857.272-1856.933=0.339
max1857.400-1857.066=0.333
mean1773.600-1778.200=-4.600
σ135.188-138.017=-2.829
min1639.000-1644.000=-5.000
max1913.000-1921.000=-8.000
mean3.054-3.060=-0.006
σ0.385-0.260=0.124
min2.642-2.818=-0.176
max3.687-3.499=0.188

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.214-1.182=0.033
σ0.317-0.308=0.008
min0.932-0.923=0.009
max1.740-1.562=0.178

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.191-447.787=0.405
σ581.331-581.212=0.119
min157.525-157.178=0.346
max1320.188-1319.605=0.584
mean96.250
σ8.500
min92.000
max109.000
mean1639.000-1644.000=-5.000
σ0.000
min1639.000-1644.000=-5.000
max1639.000-1644.000=-5.000
mean0.536-0.539=-0.003
σ0.527-0.559=-0.032
min0.270-0.249=0.021
max1.326-1.378=-0.052
policies=20
mean1575.570-1572.098=3.472
σ0.349-0.352=-0.003
min1575.333-1571.864=3.469
max1576.089-1572.622=3.467
mean920.000
σ0.000
min920.000
max920.000
mean1639.000-1644.000=-5.000
σ0.000
min1639.000-1644.000=-5.000
max1639.000-1644.000=-5.000
mean2.629-2.628=0.002
σ0.018-0.013=0.006
min2.608-2.612=-0.004
max2.652-2.642=0.009
policies=200
mean15763.773-15729.097=34.676
σ0.086-0.141=-0.055
min15763.694-15728.929=34.765
max15763.895-15729.262=34.634
mean9200.000
σ0.000
min9200.000
max9200.000
mean1639.000-1644.000=-5.000
σ0.000
min1639.000-1644.000=-5.000
max1639.000-1644.000=-5.000
mean26.586-26.452=0.134
σ0.024-0.059=-0.034
min26.551-26.386=0.165
max26.604-26.504=0.099