Compare commits

Home / Compare 2e725c5f .. 7f54161c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.056=0.001
σ0.370-0.370=0.001
min53.918-53.915=0.003
max55.111-55.108=0.003
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.139-0.139=0.000
σ0.004-0.005=-0.000
min0.134-0.132=0.001
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.395-43.395=0.000
σ0.007-0.007=-0.000
min43.388-43.385=0.003
max43.412-43.412=0.001
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.122-0.122=0.001
σ0.004-0.002=0.001
min0.119-0.120=-0.001
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.029-1007.028=0.000
σ1.189-1.178=0.011
min1006.451-1006.456=-0.005
max1012.011-1011.961=0.050
mean1053.000-1050.600=2.400
σ307.619-320.498=-12.879
min578.000-568.000=10.000
max1645.000-1619.000=26.000
mean1.521-1.521=-0.000
σ0.058-0.085=-0.028
min1.439-1.342=0.097
max1.659-1.719=-0.060

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1645.000-1619.000=26.000
σ0.000
min1645.000-1619.000=26.000
max1645.000-1619.000=26.000
mean0.414-0.407=0.006
σ0.124-0.129=-0.005
min0.344-0.335=0.008
max0.633-0.636=-0.003
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1645.000-1619.000=26.000
σ0.000
min1645.000-1619.000=26.000
max1645.000-1619.000=26.000
mean0.886-0.878=0.008
σ0.095-0.098=-0.003
min0.827-0.799=0.028
max1.052-1.048=0.004
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1645.000-1619.000=26.000
σ0.000
min1645.000-1619.000=26.000
max1645.000-1619.000=26.000
mean0.536-0.530=0.006
σ0.048-0.043=0.005
min0.490-0.493=-0.002
max0.614-0.602=0.012
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1645.000-1619.000=26.000
σ0.000
min1645.000-1619.000=26.000
max1645.000-1619.000=26.000
mean0.850-0.841=0.009
σ0.033-0.034=-0.001
min0.818-0.811=0.007
max0.901-0.899=0.002

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.838=0.001
σ0.036-0.034=0.002
min964.809-964.811=-0.002
max964.899-964.894=0.005
mean1645.000-1619.000=26.000
σ0.000
min1645.000-1619.000=26.000
max1645.000-1619.000=26.000
mean0.839-0.777=0.061
σ0.022-0.083=-0.061
min0.815-0.639=0.175
max0.858-0.852=0.006
name=cdr_enhanced_4k_loc.art
mean885.512-885.511=0.001
σ0.008-0.006=0.002
min885.504-885.506=-0.001
max885.523-885.520=0.004
mean1645.000-1619.000=26.000
σ0.000
min1645.000-1619.000=26.000
max1645.000-1619.000=26.000
mean0.727-0.738=-0.010
σ0.017-0.009=0.008
min0.698-0.722=-0.024
max0.741-0.744=-0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.002
mean1645.000-1619.000=26.000
σ0.000
min1645.000-1619.000=26.000
max1645.000-1619.000=26.000
mean4.244-4.182=0.062
σ0.076-0.090=-0.014
min4.101-4.042=0.059
max4.521-4.573=-0.052
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668
mean1645.000-1619.000=26.000
σ0.000
min1645.000-1619.000=26.000
max1645.000-1619.000=26.000
mean4.259-4.186=0.073
σ0.073-0.081=-0.008
min4.131-4.012=0.120
max4.646-4.512=0.134
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1645.000-1619.000=26.000
σ0.000
min1645.000-1619.000=26.000
max1645.000-1619.000=26.000
mean0.752-0.745=0.007
σ0.018-0.020=-0.002
min0.718-0.708=0.010
max0.859-0.863=-0.004
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1645.000-1619.000=26.000
σ0.000
min1645.000-1619.000=26.000
max1645.000-1619.000=26.000
mean0.710-0.707=0.003
σ0.016-0.017=-0.001
min0.679-0.632=0.047
max0.796-0.773=0.024

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.898-296.904=-0.007
σ0.243-0.214=0.028
min296.613-296.734=-0.122
max297.498-297.477=0.022
mean1902.000-1950.000=-48.000
σ0.000
min1902.000-1950.000=-48.000
max1902.000-1950.000=-48.000
mean0.575-0.589=-0.015
σ0.055-0.025=0.030
min0.499-0.576=-0.077
max0.691-0.659=0.032

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.839-286.841=-0.002
σ0.039-0.038=0.001
min286.790-286.791=-0.002
max286.879-286.880=-0.001
mean1645.000-1619.000=26.000
σ0.000
min1645.000-1619.000=26.000
max1645.000-1619.000=26.000
mean0.393-0.402=-0.009
σ0.005-0.009=-0.004
min0.388-0.388=-0.000
max0.400-0.412=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1297.234-1297.235=-0.001
σ0.111-0.116=-0.005
min1297.107-1297.116=-0.009
max1297.367-1297.403=-0.036
mean1645.000-1619.000=26.000
σ0.000
min1645.000-1619.000=26.000
max1645.000-1619.000=26.000
mean1.890-1.884=0.006
σ0.091-0.085=0.006
min1.799-1.807=-0.008
max2.023-2.015=0.008
iters=5
new-facts=6402
prior-facts=1
mean1541.378-1541.356=0.022
σ6.834-6.820=0.014
min1538.101-1538.125=-0.024
max1553.599-1553.553=0.045
mean1645.000-1619.000=26.000
σ0.000
min1645.000-1619.000=26.000
max1645.000-1619.000=26.000
mean2.365-2.126=0.239
σ0.244-0.115=0.130
min2.013-2.018=-0.005
max2.617-2.303=0.314
iters=5
new-facts=6402
prior-facts=6402
mean1859.149-1859.136=0.013
σ0.061-0.067=-0.006
min1859.086-1859.051=0.035
max1859.233-1859.215=0.017
mean1784.200-1781.400=2.800
σ123.242-165.420=-42.178
min1645.000-1619.000=26.000
max1902.000-1950.000=-48.000
mean2.952-2.975=-0.023
σ0.085-0.235=-0.150
min2.828-2.830=-0.002
max3.063-3.386=-0.323

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.204-1.226=-0.021
σ0.374-0.271=0.104
min0.932-0.930=0.002
max1.826-1.654=0.172

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.867-448.865=0.002
σ581.372-581.372=-0.001
min158.179-158.175=0.004
max1320.925-1320.924=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1619.000=26.000
σ0.000
min1645.000-1619.000=26.000
max1645.000-1619.000=26.000
mean0.563-0.525=0.038
σ0.602-0.513=0.088
min0.261-0.267=-0.007
max1.465-1.295=0.170
policies=20
mean1582.074-1582.076=-0.001
σ0.356-0.362=-0.007
min1581.833-1581.833=0.000
max1582.603-1582.615=-0.012
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1619.000=26.000
σ0.000
min1645.000-1619.000=26.000
max1645.000-1619.000=26.000
mean2.630-2.635=-0.006
σ0.016-0.007=0.009
min2.607-2.628=-0.021
max2.643-2.643=0.000
policies=200
mean15828.830-15828.702=0.129
σ0.105-0.063=0.042
min15828.745-15828.611=0.135
max15828.982-15828.747=0.235
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1619.000=26.000
σ0.000
min1645.000-1619.000=26.000
max1645.000-1619.000=26.000
mean26.677-26.685=-0.009
σ0.035-0.148=-0.113
min26.647-26.514=0.132
max26.726-26.872=-0.146