Compare commits

Home / Compare 96215b53 .. 537b226c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=-0.000
σ0.369-0.368=0.000
min53.911-53.911=-0.000
max55.103-55.103=0.000
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.140-0.137=0.002
σ0.006-0.004=0.002
min0.132-0.130=0.002
max0.149-0.144=0.005
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=-0.001
σ0.007-0.005=0.001
min43.383-43.384=-0.001
max43.407-43.403=0.004
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.122-0.124=-0.001
σ0.003-0.004=-0.001
min0.118-0.119=-0.001
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.007-1007.005=0.002
σ1.189-1.187=0.002
min1006.432-1006.434=-0.002
max1011.989-1011.981=0.008
mean1048.500-1052.950=-4.450
σ306.947-304.832=2.115
min575.000-579.000=-4.000
max1632.000-1642.000=-10.000
mean1.543-1.525=0.017
σ0.097-0.068=0.029
min1.465-1.466=-0.001
max1.826-1.671=0.155

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean0.418-0.421=-0.003
σ0.136-0.123=0.013
min0.328-0.350=-0.022
max0.658-0.638=0.020
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean0.882-0.900=-0.017
σ0.082-0.089=-0.007
min0.837-0.848=-0.011
max1.028-1.057=-0.028
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean0.538-0.548=-0.010
σ0.046-0.046=0.000
min0.494-0.506=-0.012
max0.614-0.619=-0.005
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean0.853-0.856=-0.003
σ0.033-0.033=0.000
min0.826-0.831=-0.004
max0.909-0.913=-0.004

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.838=0.001
σ0.034-0.033=0.001
min964.810-964.811=-0.002
max964.896-964.892=0.004
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean0.813-0.807=0.007
σ0.050-0.038=0.011
min0.730-0.766=-0.037
max0.860-0.864=-0.005
name=cdr_enhanced_4k_loc.art
mean885.512-885.513=-0.000
σ0.008-0.008=-0.000
min885.505-885.504=0.001
max885.524-885.524=0.001
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean0.717-0.668=0.049
σ0.032-0.049=-0.017
min0.674-0.608=0.066
max0.746-0.744=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean3.529-4.256=-0.728
σ0.075-0.142=-0.067
min3.409-3.512=-0.104
max3.819-4.603=-0.784
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean3.513-4.249=-0.737
σ0.075-0.072=0.002
min3.374-4.127=-0.752
max3.839-4.533=-0.694
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean0.752-0.756=-0.004
σ0.018-0.018=0.001
min0.717-0.723=-0.006
max0.856-0.862=-0.005
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean0.718-0.711=0.007
σ0.013-0.015=-0.002
min0.694-0.678=0.016
max0.775-0.789=-0.014

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.877-297.179=-0.303
σ0.255-0.225=0.030
min296.694-297.024=-0.330
max297.579-297.784=-0.206
mean1893.000-1901.000=-8.000
σ0.000
min1893.000-1901.000=-8.000
max1893.000-1901.000=-8.000
mean0.576-0.601=-0.025
σ0.044-0.024=0.020
min0.506-0.576=-0.070
max0.672-0.649=0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.827-286.826=0.001
σ0.038-0.038=-0.000
min286.780-286.776=0.005
max286.868-286.871=-0.003
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean0.394-0.398=-0.005
σ0.004-0.006=-0.002
min0.390-0.392=-0.002
max0.400-0.405=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1297.232-1297.208=0.024
σ0.043-0.099=-0.056
min1297.173-1297.096=0.076
max1297.287-1297.337=-0.050
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean2.059-1.878=0.181
σ0.118-0.064=0.054
min1.996-1.804=0.192
max2.269-1.956=0.312
iters=5
new-facts=6402
prior-facts=1
mean1541.362-1541.337=0.025
σ6.825-6.821=0.004
min1538.140-1538.110=0.030
max1553.568-1553.537=0.032
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean2.320-2.138=0.182
σ0.217-0.128=0.089
min2.047-2.014=0.033
max2.501-2.349=0.152
iters=5
new-facts=6402
prior-facts=6402
mean1859.117-1859.123=-0.005
σ0.084-0.059=0.025
min1858.991-1859.055=-0.064
max1859.205-1859.201=0.004
mean1774.400-1774.000=0.400
σ124.380-126.345=-1.965
min1632.000-1642.000=-10.000
max1893.000-1901.000=-8.000
mean2.971-3.073=-0.102
σ0.196-0.286=-0.090
min2.747-2.855=-0.109
max3.249-3.569=-0.320

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.228-1.245=-0.017
σ0.382-0.291=0.091
min0.934-1.065=-0.132
max1.836-1.747=0.089

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.822=0.001
σ581.372-581.372=-0.000
min158.135-158.134=0.001
max1320.880-1320.879=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean0.564-0.555=0.009
σ0.603-0.576=0.027
min0.260-0.263=-0.003
max1.468-1.418=0.050
policies=20
mean1581.633-1581.635=-0.002
σ0.366-0.361=0.004
min1581.387-1581.392=-0.006
max1582.177-1582.172=0.005
mean920.000
σ0.000
min920.000
max920.000
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean2.653-2.647=0.006
σ0.027-0.012=0.016
min2.623-2.633=-0.010
max2.689-2.657=0.032
policies=200
mean15824.160-15824.254=-0.093
σ0.114-0.093=0.021
min15824.065-15824.176=-0.111
max15824.323-15824.388=-0.065
mean9200.000
σ0.000
min9200.000
max9200.000
mean1632.000-1642.000=-10.000
σ0.000
min1632.000-1642.000=-10.000
max1632.000-1642.000=-10.000
mean26.534-26.585=-0.051
σ0.033-0.041=-0.008
min26.486-26.546=-0.061
max26.556-26.641=-0.086