Compare commits

Home / Compare b568f04b .. 847a65ef

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.054=0.001
σ0.369-0.370=-0.001
min53.912-53.917=-0.005
max55.103-55.106=-0.003
mean415.000
σ0.000
min415.000
max415.000
mean0.141-0.137=0.004
σ0.004-0.004=-0.001
min0.137-0.131=0.006
max0.147-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=0.000
σ0.006-0.006=-0.001
min43.385-43.382=0.004
max43.402-43.406=-0.003
mean415.000
σ0.000
min415.000
max415.000
mean0.121-0.122=-0.001
σ0.004-0.004=0.000
min0.118-0.120=-0.002
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.001-1007.004=-0.003
σ1.204-1.236=-0.031
min1006.462-1006.442=0.020
max1012.052-1012.193=-0.140
mean1052.150-1049.000=3.150
σ304.685-304.158=0.527
min591.000-597.000=-6.000
max1452.000-1638.000=-186.000
mean1.545-1.548=-0.003
σ0.090-0.120=-0.030
min1.377-1.468=-0.091
max1.764-2.004=-0.239

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.000
σ0.002-0.003=-0.000
min0.882
max0.887
mean1452.000-1638.000=-186.000
σ0.000
min1452.000-1638.000=-186.000
max1452.000-1638.000=-186.000
mean0.349-0.416=-0.066
σ0.099-0.123=-0.024
min0.255-0.348=-0.092
max0.508-0.635=-0.127
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1452.000-1638.000=-186.000
σ0.000
min1452.000-1638.000=-186.000
max1452.000-1638.000=-186.000
mean0.891-0.883=0.008
σ0.093-0.085=0.008
min0.817-0.820=-0.003
max1.052-1.024=0.029
name=heavy_item.art
mean1.524-1.524=0.000
σ0.003-0.002=0.001
min1.522
max1.528-1.526=0.002
mean1452.000-1638.000=-186.000
σ0.000
min1452.000-1638.000=-186.000
max1452.000-1638.000=-186.000
mean0.539-0.535=0.004
σ0.045-0.047=-0.001
min0.495-0.487=0.009
max0.609-0.608=0.001
name=nested_use.art
mean2.361-2.361=0.000
σ0.002-0.002=-0.000
min2.360
max2.364
mean1452.000-1638.000=-186.000
σ0.000
min1452.000-1638.000=-186.000
max1452.000-1638.000=-186.000
mean0.855-0.848=0.007
σ0.040-0.032=0.007
min0.826-0.807=0.019
max0.921-0.894=0.028

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.824-964.839=-0.015
σ0.029-0.034=-0.005
min964.802-964.810=-0.009
max964.873-964.896=-0.022
mean1452.000-1638.000=-186.000
σ0.000
min1452.000-1638.000=-186.000
max1452.000-1638.000=-186.000
mean0.825-0.801=0.024
σ0.043-0.040=0.002
min0.753-0.758=-0.005
max0.859-0.860=-0.001
name=cdr_enhanced_4k_loc.art
mean885.511-885.512=-0.001
σ0.006-0.008=-0.002
min885.504-885.505=-0.001
max885.518-885.524=-0.006
mean1452.000-1638.000=-186.000
σ0.000
min1452.000-1638.000=-186.000
max1452.000-1638.000=-186.000
mean0.714-0.730=-0.016
σ0.025-0.019=0.006
min0.675-0.711=-0.036
max0.742-0.758=-0.015

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.722=-0.003
mean1452.000-1638.000=-186.000
σ0.000
min1452.000-1638.000=-186.000
max1452.000-1638.000=-186.000
mean4.244-3.517=0.727
σ0.083-0.088=-0.005
min4.104-3.373=0.732
max4.537-3.910=0.627
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1452.000-1638.000=-186.000
σ0.000
min1452.000-1638.000=-186.000
max1452.000-1638.000=-186.000
mean4.221-3.517=0.704
σ0.078-0.086=-0.008
min4.102-3.388=0.714
max4.556-3.775=0.781
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1452.000-1638.000=-186.000
σ0.000
min1452.000-1638.000=-186.000
max1452.000-1638.000=-186.000
mean0.636-0.673=-0.037
σ0.109-0.103=0.006
min0.510-0.512=-0.003
max0.870-0.863=0.006
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1452.000-1638.000=-186.000
σ0.000
min1452.000-1638.000=-186.000
max1452.000-1638.000=-186.000
mean0.512-0.510=0.001
σ0.035-0.019=0.016
min0.487-0.486=0.001
max0.757-0.648=0.109

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.798-297.203=-0.405
σ0.277-0.237=0.040
min296.638-296.979=-0.341
max297.571-297.824=-0.253
mean1920.000-1898.000=22.000
σ0.000
min1920.000-1898.000=22.000
max1920.000-1898.000=22.000
mean0.586-0.600=-0.015
σ0.049-0.026=0.023
min0.505-0.554=-0.049
max0.671-0.645=0.026

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.829-286.823=0.005
σ0.037-0.039=-0.002
min286.782-286.772=0.010
max286.871-286.862=0.009
mean1452.000-1638.000=-186.000
σ0.000
min1452.000-1638.000=-186.000
max1452.000-1638.000=-186.000
mean0.403-0.401=0.002
σ0.013-0.006=0.007
min0.391-0.394=-0.003
max0.424-0.407=0.018
iters=5
new-facts=1
prior-facts=6402
mean1297.256-1297.269=-0.013
σ0.091-0.088=0.003
min1297.137-1297.155=-0.018
max1297.368-1297.385=-0.017
mean1452.000-1638.000=-186.000
σ0.000
min1452.000-1638.000=-186.000
max1452.000-1638.000=-186.000
mean2.191-2.227=-0.035
σ0.095-0.042=0.053
min2.073-2.179=-0.107
max2.329-2.279=0.050
iters=5
new-facts=6402
prior-facts=1
mean1541.360-1541.374=-0.014
σ6.819-6.791=0.028
min1538.183-1538.208=-0.025
max1553.557-1553.520=0.037
mean1452.000-1638.000=-186.000
σ0.000
min1452.000-1638.000=-186.000
max1452.000-1638.000=-186.000
mean2.274-2.305=-0.030
σ0.225-0.173=0.053
min2.069-2.143=-0.074
max2.637-2.575=0.062
iters=5
new-facts=6402
prior-facts=6402
mean1859.110-1859.113=-0.003
σ0.069-0.063=0.006
min1859.036-1859.027=0.009
max1859.183-1859.191=-0.008
mean1735.600-1767.200=-31.600
σ195.482-125.701=69.781
min1470.000-1638.000=-168.000
max1920.000-1898.000=22.000
mean3.059-3.146=-0.087
σ0.115-0.308=-0.193
min2.927-2.857=0.069
max3.239-3.655=-0.416

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.685-1.236=0.450
σ0.149-0.333=-0.184
min1.565-0.947=0.618
max1.886-1.793=0.093

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.822=-0.000
σ581.372-581.372=-0.000
min158.134-158.135=-0.000
max1320.879-1320.880=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1452.000-1638.000=-186.000
σ0.000
min1452.000-1638.000=-186.000
max1452.000-1638.000=-186.000
mean0.550-0.551=-0.001
σ0.561-0.565=-0.004
min0.266-0.268=-0.002
max1.392-1.399=-0.007
policies=20
mean1581.607-1581.638=-0.031
σ0.359-0.374=-0.015
min1581.379-1581.391=-0.012
max1582.142-1582.196=-0.053
mean920.000
σ0.000
min920.000
max920.000
mean1452.000-1638.000=-186.000
σ0.000
min1452.000-1638.000=-186.000
max1452.000-1638.000=-186.000
mean2.642-2.670=-0.028
σ0.013-0.019=-0.006
min2.630-2.654=-0.024
max2.656-2.697=-0.041
policies=200
mean15824.195-15824.286=-0.090
σ0.168-0.121=0.047
min15824.025-15824.175=-0.150
max15824.425-15824.450=-0.025
mean9200.000
σ0.000
min9200.000
max9200.000
mean1452.000-1638.000=-186.000
σ0.000
min1452.000-1638.000=-186.000
max1452.000-1638.000=-186.000
mean26.654-26.948=-0.295
σ0.050-0.039=0.011
min26.599-26.890=-0.291
max26.716-26.970=-0.253