Compare commits

Home / Compare 6f56546a .. e0ef96ab

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.055=0.002
σ0.370-0.367=0.002
min53.908-53.911=-0.004
max55.109-55.099=0.009
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.138-0.140=-0.002
σ0.004-0.005=-0.000
min0.134-0.132=0.002
max0.147-0.148=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.395-43.394=0.001
σ0.006-0.005=0.001
min43.385-43.387=-0.003
max43.403-43.402=0.002
mean415.100-416.000=-0.900
σ0.316-0.000=0.316
min415.000-416.000=-1.000
max416.000
mean0.122-0.122=-0.000
σ0.004-0.004=-0.000
min0.118-0.119=-0.001
max0.129-0.129=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.962-1007.003=-0.041
σ0.904-1.201=-0.297
min1006.487-1006.433=0.055
max1010.713-1012.040=-1.327
mean1050.600-1051.400=-0.800
σ310.102-307.021=3.081
min551.000-578.000=-27.000
max1643.000-1635.000=8.000
mean1.561-1.545=0.016
σ0.119-0.058=0.061
min1.471-1.491=-0.020
max1.841-1.704=0.137

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1643.000-1635.000=8.000
σ0.000
min1643.000-1635.000=8.000
max1643.000-1635.000=8.000
mean0.425-0.415=0.010
σ0.141-0.125=0.017
min0.325-0.336=-0.011
max0.665-0.634=0.031
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1643.000-1635.000=8.000
σ0.000
min1643.000-1635.000=8.000
max1643.000-1635.000=8.000
mean0.879-0.879=-0.000
σ0.109-0.095=0.014
min0.815-0.802=0.013
max1.073-1.043=0.030
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1643.000-1635.000=8.000
σ0.000
min1643.000-1635.000=8.000
max1643.000-1635.000=8.000
mean0.528-0.536=-0.007
σ0.049-0.045=0.005
min0.478-0.488=-0.010
max0.611-0.605=0.006
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1643.000-1635.000=8.000
σ0.000
min1643.000-1635.000=8.000
max1643.000-1635.000=8.000
mean0.838-0.848=-0.009
σ0.044-0.041=0.002
min0.805-0.819=-0.014
max0.914-0.919=-0.005

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.839=0.001
σ0.034-0.034=-0.000
min964.811-964.811=0.001
max964.896-964.896=0.000
mean1643.000-1635.000=8.000
σ0.000
min1643.000-1635.000=8.000
max1643.000-1635.000=8.000
mean0.848-0.791=0.057
σ0.028-0.036=-0.008
min0.799-0.748=0.051
max0.867-0.829=0.038
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.006-0.007=-0.002
min885.505
max885.518-885.523=-0.005
mean1643.000-1635.000=8.000
σ0.000
min1643.000-1635.000=8.000
max1643.000-1635.000=8.000
mean0.726-0.694=0.032
σ0.023-0.048=-0.026
min0.686-0.643=0.043
max0.740-0.755=-0.015

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.001
mean1643.000-1635.000=8.000
σ0.000
min1643.000-1635.000=8.000
max1643.000-1635.000=8.000
mean4.244-4.210=0.034
σ0.087-0.098=-0.011
min4.116-4.076=0.040
max4.480-4.701=-0.221
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1643.000-1635.000=8.000
σ0.000
min1643.000-1635.000=8.000
max1643.000-1635.000=8.000
mean4.257-4.183=0.074
σ0.080-0.074=0.006
min4.124-4.053=0.072
max4.517-4.417=0.100
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1643.000-1635.000=8.000
σ0.000
min1643.000-1635.000=8.000
max1643.000-1635.000=8.000
mean0.744-0.744=-0.001
σ0.027-0.017=0.010
min0.607-0.712=-0.105
max0.855-0.854=0.001
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1643.000-1635.000=8.000
σ0.000
min1643.000-1635.000=8.000
max1643.000-1635.000=8.000
mean0.701-0.619=0.081
σ0.023-0.099=-0.075
min0.586-0.493=0.093
max0.797-0.773=0.024

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.426-296.955=-1.530
σ0.268-0.205=0.063
min295.280-296.838=-1.557
max296.172-297.519=-1.347
mean1913.000-2054.000=-141.000
σ0.000
min1913.000-2054.000=-141.000
max1913.000-2054.000=-141.000
mean0.574-0.545=0.029
σ0.033-0.030=0.003
min0.535-0.509=0.025
max0.635-0.578=0.057

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.394-286.817=-1.423
σ0.038-0.036=0.002
min285.350-286.770=-1.421
max285.434-286.852=-1.418
mean1643.000-1635.000=8.000
σ0.000
min1643.000-1635.000=8.000
max1643.000-1635.000=8.000
mean0.390-0.392=-0.002
σ0.008-0.008=-0.000
min0.380-0.386=-0.006
max0.397-0.406=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1295.782-1297.244=-1.463
σ0.117-0.074=0.043
min1295.655-1297.162=-1.507
max1295.926-1297.301=-1.375
mean1643.000-1635.000=8.000
σ0.000
min1643.000-1635.000=8.000
max1643.000-1635.000=8.000
mean1.898-2.041=-0.143
σ0.075-0.037=0.037
min1.809-1.978=-0.169
max1.982-2.070=-0.088
iters=5
new-facts=6402
prior-facts=1
mean1539.897-1541.301=-1.404
σ6.868-6.846=0.021
min1536.643-1538.029=-1.386
max1552.178-1553.543=-1.364
mean1643.000-1635.000=8.000
σ0.000
min1643.000-1635.000=8.000
max1643.000-1635.000=8.000
mean2.230-2.167=0.063
σ0.195-0.131=0.064
min2.035-2.089=-0.054
max2.472-2.397=0.075
iters=5
new-facts=6402
prior-facts=6402
mean1857.684-1859.121=-1.438
σ0.063-0.082=-0.019
min1857.613-1859.001=-1.387
max1857.770-1859.212=-1.442
mean1772.400-1793.400=-21.000
σ135.579-181.230=-45.650
min1643.000-1635.000=8.000
max1913.000-2054.000=-141.000
mean3.130-3.019=0.111
σ0.373-0.050=0.322
min2.862-2.969=-0.108
max3.785-3.080=0.706

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.238-1.240=-0.002
σ0.376-0.306=0.069
min0.930-0.924=0.005
max1.851-1.733=0.118

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.705-448.821=-3.116
σ580.934-581.373=-0.439
min155.236-158.133=-2.898
max1317.106-1320.880=-3.774
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1635.000=8.000
σ0.000
min1643.000-1635.000=8.000
max1643.000-1635.000=8.000
mean0.526-0.541=-0.014
σ0.528-0.564=-0.036
min0.262-0.243=0.019
max1.319-1.387=-0.068
policies=20
mean1552.633-1581.618=-28.985
σ0.333-0.360=-0.027
min1552.401-1581.377=-28.976
max1553.128-1582.153=-29.026
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1635.000=8.000
σ0.000
min1643.000-1635.000=8.000
max1643.000-1635.000=8.000
mean2.590-2.638=-0.048
σ0.016-0.026=-0.011
min2.571-2.610=-0.039
max2.609-2.669=-0.060
policies=200
mean15534.642-15824.184=-289.543
σ0.134-0.076=0.057
min15534.555-15824.114=-289.559
max15534.839-15824.290=-289.451
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1635.000=8.000
σ0.000
min1643.000-1635.000=8.000
max1643.000-1635.000=8.000
mean26.082-26.647=-0.566
σ0.055-0.024=0.031
min26.049-26.625=-0.576
max26.163-26.669=-0.506