Compare commits

Home / Compare 547a1bf2 .. 46278566

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.055=-0.001
σ0.367-0.369=-0.002
min53.916-53.911=0.005
max55.098-55.105=-0.007
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.140-0.138=0.002
σ0.004-0.004=0.000
min0.137-0.135=0.001
max0.146-0.146=0.000
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.002
σ0.008-0.005=0.002
min43.385-43.386=-0.001
max43.411-43.402=0.009
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.121-0.120=0.001
σ0.004-0.004=-0.001
min0.115-0.113=0.002
max0.127-0.127=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.004-1007.003=0.002
σ1.187-1.196=-0.009
min1006.435-1006.447=-0.012
max1011.980-1012.020=-0.040
mean1052.250-1051.000=1.250
σ305.556-307.854=-2.297
min579.000-578.000=1.000
max1646.000-1640.000=6.000
mean1.550-1.554=-0.004
σ0.094-0.086=0.008
min1.385-1.402=-0.018
max1.844-1.775=0.069

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.000
σ0.003-0.002=0.000
min0.882
max0.887
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean0.433-0.420=0.012
σ0.153-0.141=0.011
min0.345-0.323=0.022
max0.703-0.668=0.035
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean0.899-0.888=0.011
σ0.120-0.097=0.023
min0.824-0.826=-0.002
max1.109-1.057=0.052
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean0.537-0.540=-0.003
σ0.058-0.042=0.015
min0.482-0.515=-0.033
max0.629-0.615=0.014
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean0.850-0.863=-0.012
σ0.043-0.038=0.005
min0.823-0.838=-0.015
max0.923-0.929=-0.006

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.838=-0.003
σ0.032-0.032=-0.001
min964.802-964.811=-0.009
max964.885-964.894=-0.009
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean0.835-0.819=0.016
σ0.039-0.087=-0.048
min0.775-0.664=0.111
max0.872-0.868=0.004
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.006-0.007=-0.001
min885.505-885.504=0.001
max885.520-885.522=-0.002
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean0.696-0.712=-0.016
σ0.065-0.041=0.024
min0.615-0.664=-0.049
max0.753-0.747=0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.723-7.721=0.003
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean3.532-4.263=-0.732
σ0.098-0.092=0.005
min3.413-4.118=-0.705
max4.136-4.572=-0.436
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean3.500-4.246=-0.746
σ0.066-0.070=-0.004
min3.382-4.136=-0.754
max3.755-4.492=-0.737
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean0.743-0.751=-0.008
σ0.018-0.022=-0.004
min0.710-0.719=-0.009
max0.848-0.880=-0.032
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean0.700-0.706=-0.005
σ0.033-0.019=0.014
min0.522-0.680=-0.158
max0.764-0.847=-0.083

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.845-297.027=-0.182
σ0.223-0.180=0.043
min296.636-296.838=-0.202
max297.362-297.468=-0.106
mean1909.000-2036.000=-127.000
σ0.000
min1909.000-2036.000=-127.000
max1909.000-2036.000=-127.000
mean0.589-0.544=0.045
σ0.041-0.035=0.006
min0.550-0.498=0.052
max0.696-0.595=0.101

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.822-286.824=-0.002
σ0.036-0.038=-0.002
min286.776-286.774=0.002
max286.860-286.864=-0.004
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean0.398-0.400=-0.002
σ0.007-0.008=-0.000
min0.390-0.390=-0.001
max0.405-0.408=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1297.264-1297.285=-0.021
σ0.087-0.068=0.019
min1297.150-1297.214=-0.065
max1297.375-1297.383=-0.008
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean2.207-2.190=0.017
σ0.033-0.076=-0.043
min2.167-2.071=0.096
max2.252-2.263=-0.011
iters=5
new-facts=6402
prior-facts=1
mean1541.367-1541.331=0.036
σ6.818-6.836=-0.018
min1538.194-1538.093=0.100
max1553.561-1553.555=0.006
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean2.295-2.193=0.102
σ0.193-0.113=0.080
min2.143-2.109=0.034
max2.587-2.389=0.199
iters=5
new-facts=6402
prior-facts=6402
mean1859.115-1859.117=-0.002
σ0.065-0.063=0.002
min1859.028-1859.027=0.001
max1859.190-1859.185=0.005
mean1774.600-1781.000=-6.400
σ128.893-171.604=-42.712
min1646.000-1640.000=6.000
max1909.000-2036.000=-127.000
mean3.139-2.928=0.212
σ0.321-0.125=0.196
min2.855-2.827=0.029
max3.621-3.143=0.478

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.315-1.262=0.053
σ0.303-0.350=-0.047
min0.937-0.937=0.001
max1.738-1.847=-0.109

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.821=-0.001
σ581.372-581.373=-0.000
min158.133-158.131=0.002
max1320.879-1320.880=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean0.561-0.556=0.006
σ0.578-0.575=0.003
min0.269-0.262=0.006
max1.428-1.419=0.009
policies=20
mean1581.613-1581.629=-0.016
σ0.362-0.365=-0.003
min1581.369-1581.387=-0.018
max1582.151-1582.172=-0.021
mean920.000
σ0.000
min920.000
max920.000
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean2.647-2.647=0.000
σ0.020-0.010=0.010
min2.618-2.636=-0.017
max2.664-2.655=0.009
policies=200
mean15824.213-15824.239=-0.026
σ0.131-0.139=-0.008
min15824.061-15824.094=-0.033
max15824.376-15824.403=-0.027
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000-1640.000=6.000
σ0.000
min1646.000-1640.000=6.000
max1646.000-1640.000=6.000
mean26.705-26.651=0.054
σ0.043-0.117=-0.074
min26.645-26.545=0.100
max26.739-26.808=-0.069