Compare commits

Home / Compare 2f8db0ee .. a66807d7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.054=0.001
σ0.368-0.369=-0.000
min53.909-53.911=-0.002
max55.102-55.103=-0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.141-0.137=0.003
σ0.003-0.006=-0.003
min0.137-0.132=0.006
max0.147-0.151=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.001
σ0.006-0.006=-0.001
min43.384-43.382=0.002
max43.404-43.404=-0.000
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.123-0.122=0.001
σ0.004-0.004=0.000
min0.119-0.119=0.000
max0.129-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.004-1007.003=0.002
σ1.194-1.191=0.002
min1006.433-1006.430=0.003
max1012.010-1011.998=0.012
mean1048.150-1045.950=2.200
σ300.434-316.414=-15.980
min593.000-588.000=5.000
max1629.000-1647.000=-18.000
mean1.533-1.528=0.005
σ0.088-0.067=0.021
min1.468-1.402=0.066
max1.831-1.695=0.136

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1629.000-1647.000=-18.000
σ0.000
min1629.000-1647.000=-18.000
max1629.000-1647.000=-18.000
mean0.424-0.419=0.005
σ0.145-0.143=0.001
min0.339-0.326=0.013
max0.682-0.672=0.010
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1629.000-1647.000=-18.000
σ0.000
min1629.000-1647.000=-18.000
max1629.000-1647.000=-18.000
mean0.880-0.882=-0.002
σ0.093-0.097=-0.004
min0.826-0.813=0.013
max1.045-1.052=-0.007
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1629.000-1647.000=-18.000
σ0.000
min1629.000-1647.000=-18.000
max1629.000-1647.000=-18.000
mean0.545-0.543=0.002
σ0.054-0.049=0.006
min0.499-0.496=0.003
max0.637-0.624=0.014
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.002=0.000
min2.360
max2.364-2.364=-0.000
mean1629.000-1647.000=-18.000
σ0.000
min1629.000-1647.000=-18.000
max1629.000-1647.000=-18.000
mean0.852-0.853=-0.001
σ0.038-0.043=-0.005
min0.821-0.825=-0.004
max0.914-0.929=-0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=-0.000
σ0.034-0.019=0.015
min964.812-964.824=-0.012
max964.895-964.870=0.025
mean1629.000-1647.000=-18.000
σ0.000
min1629.000-1647.000=-18.000
max1629.000-1647.000=-18.000
mean0.845-0.848=-0.002
σ0.016-0.018=-0.002
min0.817-0.816=0.001
max0.859-0.863=-0.004
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.006-0.007=-0.001
min885.507-885.506=0.001
max885.521-885.523=-0.002
mean1629.000-1647.000=-18.000
σ0.000
min1629.000-1647.000=-18.000
max1629.000-1647.000=-18.000
mean0.670-0.738=-0.068
σ0.042-0.004=0.038
min0.628-0.733=-0.104
max0.739-0.744=-0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.721=0.000
mean1629.000-1647.000=-18.000
σ0.000
min1629.000-1647.000=-18.000
max1629.000-1647.000=-18.000
mean4.272-4.263=0.008
σ0.085-0.088=-0.003
min4.156-4.112=0.044
max4.591-4.604=-0.013
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1629.000-1647.000=-18.000
σ0.000
min1629.000-1647.000=-18.000
max1629.000-1647.000=-18.000
mean4.269-4.223=0.047
σ0.075-0.088=-0.013
min4.069-4.076=-0.007
max4.532-4.543=-0.011
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1629.000-1647.000=-18.000
σ0.000
min1629.000-1647.000=-18.000
max1629.000-1647.000=-18.000
mean0.752-0.751=0.001
σ0.016-0.022=-0.007
min0.726-0.632=0.094
max0.860-0.867=-0.007
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1629.000-1647.000=-18.000
σ0.000
min1629.000-1647.000=-18.000
max1629.000-1647.000=-18.000
mean0.712-0.717=-0.005
σ0.016-0.017=-0.002
min0.679-0.671=0.008
max0.805-0.788=0.017

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.860-296.888=-0.028
σ0.251-0.196=0.055
min296.733-296.758=-0.025
max297.554-297.414=0.139
mean1901.000-1952.000=-51.000
σ0.000
min1901.000-1952.000=-51.000
max1901.000-1952.000=-51.000
mean0.580-0.541=0.039
σ0.056-0.027=0.029
min0.503-0.504=-0.000
max0.703-0.578=0.125

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.825-286.829=-0.005
σ0.038-0.028=0.010
min286.774-286.798=-0.024
max286.864-286.861=0.003
mean1629.000-1647.000=-18.000
σ0.000
min1629.000-1647.000=-18.000
max1629.000-1647.000=-18.000
mean0.394-0.396=-0.002
σ0.006-0.007=-0.001
min0.387-0.388=-0.001
max0.401-0.404=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1297.189-1297.239=-0.051
σ0.092-0.077=0.016
min1297.098-1297.153=-0.055
max1297.329-1297.335=-0.006
mean1629.000-1647.000=-18.000
σ0.000
min1629.000-1647.000=-18.000
max1629.000-1647.000=-18.000
mean1.939-2.120=-0.181
σ0.163-0.063=0.099
min1.792-2.024=-0.232
max2.194-2.177=0.017
iters=5
new-facts=6402
prior-facts=1
mean1541.326-1541.341=-0.015
σ6.822-6.825=-0.003
min1538.081-1538.089=-0.007
max1553.527-1553.546=-0.020
mean1629.000-1647.000=-18.000
σ0.000
min1629.000-1647.000=-18.000
max1629.000-1647.000=-18.000
mean2.173-2.322=-0.148
σ0.082-0.141=-0.059
min2.103-2.153=-0.051
max2.315-2.489=-0.174
iters=5
new-facts=6402
prior-facts=6402
mean1859.126-1859.114=0.012
σ0.054-0.070=-0.016
min1859.066-1859.003=0.063
max1859.198-1859.181=0.017
mean1767.400-1778.800=-11.400
σ129.108-114.362=14.746
min1629.000-1647.000=-18.000
max1901.000-1952.000=-51.000
mean3.111-2.978=0.133
σ0.334-0.160=0.175
min2.864-2.864=0.000
max3.687-3.251=0.436

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.244-1.159=0.085
σ0.301-0.313=-0.013
min0.940-0.922=0.018
max1.730-1.669=0.061

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.821=0.001
σ581.372-581.372=-0.001
min158.134-158.133=0.001
max1320.879-1320.879=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1629.000-1647.000=-18.000
σ0.000
min1629.000-1647.000=-18.000
max1629.000-1647.000=-18.000
mean0.558-0.567=-0.010
σ0.580-0.595=-0.015
min0.265-0.265=-0.000
max1.428-1.460=-0.032
policies=20
mean1581.624-1581.589=0.035
σ0.350-0.298=0.052
min1581.389-1581.378=0.011
max1582.144-1582.030=0.114
mean920.000
σ0.000
min920.000
max920.000
mean1629.000-1647.000=-18.000
σ0.000
min1629.000-1647.000=-18.000
max1629.000-1647.000=-18.000
mean2.622-2.635=-0.013
σ0.010-0.012=-0.003
min2.608-2.618=-0.010
max2.630-2.645=-0.015
policies=200
mean15824.244-15824.158=0.086
σ0.095-0.106=-0.011
min15824.176-15824.012=0.163
max15824.380-15824.260=0.120
mean9200.000
σ0.000
min9200.000
max9200.000
mean1629.000-1647.000=-18.000
σ0.000
min1629.000-1647.000=-18.000
max1629.000-1647.000=-18.000
mean26.602-26.592=0.010
σ0.037-0.052=-0.014
min26.549-26.552=-0.004
max26.636-26.666=-0.030