Compare commits

Home / Compare 756f4f72 .. ce6206d3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.016=-0.002
σ0.369-0.370=-0.001
min53.872-53.879=-0.006
max55.065-55.068=-0.004
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.137-0.139=-0.001
σ0.003-0.004=-0.000
min0.131-0.135=-0.004
max0.142-0.145=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.001
σ0.005-0.007=-0.002
min43.314-43.314=-0.001
max43.332-43.336=-0.004
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.121-0.122=-0.001
σ0.005-0.005=0.001
min0.113-0.116=-0.003
max0.128-0.130=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.307-1006.309=-0.002
σ1.175-1.175=0.000
min1005.764-1005.763=0.002
max1011.228-1011.231=-0.003
mean1045.450-1051.150=-5.700
σ313.228-304.913=8.315
min597.000-595.000=2.000
max1639.000-1645.000=-6.000
mean1.560-1.543=0.017
σ0.099-0.060=0.039
min1.480-1.475=0.005
max1.843-1.668=0.175

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.408-0.411=-0.002
σ0.143-0.142=0.001
min0.325-0.326=-0.001
max0.663-0.663=-0.000
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.876-0.875=0.001
σ0.093-0.096=-0.003
min0.818-0.809=0.009
max1.040-1.041=-0.002
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.542-0.540=0.002
σ0.053-0.050=0.004
min0.507-0.488=0.019
max0.635-0.621=0.014
name=nested_use.art
mean2.360-2.360=0.000
σ0.002-0.002=0.000
min2.359
max2.363
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.849-0.842=0.007
σ0.038-0.036=0.002
min0.821-0.816=0.005
max0.914-0.904=0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.111=0.003
σ0.032-0.030=0.002
min964.085-964.086=-0.001
max964.166-964.162=0.004
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.830-0.824=0.007
σ0.039-0.031=0.009
min0.768-0.790=-0.022
max0.859-0.855=0.003
name=cdr_enhanced_4k_loc.art
mean884.712-884.711=0.001
σ0.007-0.004=0.003
min884.705-884.705=0.000
max884.723-884.716=0.007
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.679-0.727=-0.048
σ0.049-0.024=0.025
min0.609-0.696=-0.087
max0.742-0.756=-0.014

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.719=-0.001
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean3.532-4.240=-0.708
σ0.083-0.076=0.006
min3.387-4.125=-0.737
max3.840-4.556=-0.717
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.667-7.666=0.001
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean3.532-4.238=-0.706
σ0.072-0.067=0.006
min3.384-4.096=-0.712
max3.828-4.477=-0.649
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.528-0.736=-0.208
σ0.019-0.019=0.000
min0.500-0.698=-0.198
max0.634-0.851=-0.217
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.505-0.696=-0.191
σ0.026-0.014=0.012
min0.478-0.665=-0.187
max0.678-0.758=-0.080

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.298-296.176=0.122
σ0.224-0.204=0.020
min296.125-296.009=0.117
max296.907-296.726=0.180
mean1921.000-1897.000=24.000
σ0.000
min1921.000-1897.000=24.000
max1921.000-1897.000=24.000
mean0.570-0.584=-0.014
σ0.044-0.053=-0.009
min0.508-0.511=-0.002
max0.636-0.704=-0.068

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.693-284.702=-0.009
σ0.035-0.026=0.009
min284.649-284.674=-0.024
max284.735-284.731=0.003
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.404-0.398=0.006
σ0.017-0.010=0.008
min0.386-0.387=-0.001
max0.427-0.405=0.021
iters=5
new-facts=1
prior-facts=6402
mean1295.033-1295.077=-0.045
σ0.103-0.100=0.002
min1294.953-1294.959=-0.006
max1295.199-1295.190=0.008
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean1.919-1.897=0.022
σ0.195-0.074=0.121
min1.782-1.805=-0.023
max2.247-1.967=0.280
iters=5
new-facts=6402
prior-facts=1
mean1539.236-1539.270=-0.033
σ6.820-6.819=0.000
min1536.084-1536.013=0.071
max1551.434-1551.465=-0.031
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean2.305-2.452=-0.147
σ0.270-0.255=0.016
min2.097-2.047=0.050
max2.765-2.667=0.098
iters=5
new-facts=6402
prior-facts=6402
mean1856.983-1857.001=-0.018
σ0.062-0.079=-0.018
min1856.920-1856.920=-0.000
max1857.070-1857.098=-0.028
mean1777.200-1768.200=9.000
σ139.051-123.074=15.977
min1639.000-1645.000=-6.000
max1921.000-1897.000=24.000
mean3.011-3.110=-0.099
σ0.185-0.266=-0.081
min2.836-2.856=-0.020
max3.318-3.513=-0.195

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.191-1.291=-0.100
σ0.339-0.331=0.008
min0.929-0.930=-0.001
max1.745-1.778=-0.033

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.784-447.785=-0.001
σ581.213-581.212=0.001
min157.174-157.177=-0.003
max1319.603-1319.603=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean0.547-0.556=-0.009
σ0.565-0.590=-0.025
min0.261-0.259=0.002
max1.394-1.441=-0.046
policies=20
mean1572.086-1572.097=-0.011
σ0.357-0.366=-0.009
min1571.845-1571.852=-0.007
max1572.616-1572.642=-0.025
mean920.000
σ0.000
min920.000
max920.000
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean2.634-2.636=-0.002
σ0.010-0.020=-0.010
min2.623-2.608=0.015
max2.647-2.653=-0.006
policies=200
mean15729.038-15728.976=0.061
σ0.147-0.109=0.038
min15728.872-15728.817=0.055
max15729.229-15729.056=0.173
mean9200.000
σ0.000
min9200.000
max9200.000
mean1639.000-1645.000=-6.000
σ0.000
min1639.000-1645.000=-6.000
max1639.000-1645.000=-6.000
mean26.512-26.525=-0.013
σ0.155-0.065=0.090
min26.319-26.453=-0.135
max26.696-26.608=0.088