Compare commits

Home / Compare fb1a049f .. 8735e4ad

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.056=0.001
σ0.370-0.369=0.000
min53.918-53.917=0.001
max55.109-55.106=0.002
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.140-0.140=-0.000
σ0.005-0.004=0.001
min0.136-0.136=-0.000
max0.147-0.147=0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=-0.000
σ0.007-0.006=0.001
min43.386-43.385=0.001
max43.410-43.405=0.005
mean419.000-416.900=2.100
σ0.000-0.316=-0.316
min419.000-416.000=3.000
max419.000-417.000=2.000
mean0.120-0.122=-0.002
σ0.005-0.003=0.002
min0.114-0.120=-0.006
max0.128-0.127=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.007-1007.002=0.005
σ1.196-1.207=-0.011
min1006.434-1006.443=-0.009
max1012.019-1012.067=-0.047
mean1053.300-1053.050=0.250
σ306.452-320.471=-14.019
min578.000-571.000=7.000
max1651.000-1620.000=31.000
mean1.554-1.541=0.013
σ0.084-0.069=0.015
min1.473-1.404=0.069
max1.750-1.710=0.040

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1651.000-1620.000=31.000
σ0.000
min1651.000-1620.000=31.000
max1651.000-1620.000=31.000
mean0.412-0.408=0.004
σ0.134-0.113=0.021
min0.338-0.343=-0.005
max0.651-0.610=0.041
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1651.000-1620.000=31.000
σ0.000
min1651.000-1620.000=31.000
max1651.000-1620.000=31.000
mean0.878-0.937=-0.059
σ0.095-0.202=-0.107
min0.812-0.827=-0.015
max1.043-1.297=-0.254
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1651.000-1620.000=31.000
σ0.000
min1651.000-1620.000=31.000
max1651.000-1620.000=31.000
mean0.540-0.539=0.002
σ0.041-0.043=-0.001
min0.510-0.505=0.005
max0.609-0.610=-0.001
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1651.000-1620.000=31.000
σ0.000
min1651.000-1620.000=31.000
max1651.000-1620.000=31.000
mean0.849-0.837=0.012
σ0.042-0.039=0.003
min0.814-0.792=0.023
max0.917-0.896=0.021

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=-0.001
σ0.034-0.034=-0.000
min964.811-964.810=0.000
max964.895-964.895=-0.001
mean1651.000-1620.000=31.000
σ0.000
min1651.000-1620.000=31.000
max1651.000-1620.000=31.000
mean0.832-0.839=-0.007
σ0.027-0.021=0.005
min0.799-0.815=-0.016
max0.860-0.866=-0.006
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.007-0.007=0.000
min885.504-885.506=-0.001
max885.522-885.523=-0.002
mean1651.000-1620.000=31.000
σ0.000
min1651.000-1620.000=31.000
max1651.000-1620.000=31.000
mean0.721-0.684=0.037
σ0.031-0.071=-0.039
min0.682-0.607=0.075
max0.750-0.745=0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721
mean1651.000-1620.000=31.000
σ0.000
min1651.000-1620.000=31.000
max1651.000-1620.000=31.000
mean4.215-4.242=-0.027
σ0.135-0.105=0.030
min4.062-4.072=-0.010
max5.092-4.771=0.321
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1651.000-1620.000=31.000
σ0.000
min1651.000-1620.000=31.000
max1651.000-1620.000=31.000
mean4.185-4.226=-0.041
σ0.072-0.073=-0.001
min4.065-4.108=-0.044
max4.468-4.478=-0.009
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1651.000-1620.000=31.000
σ0.000
min1651.000-1620.000=31.000
max1651.000-1620.000=31.000
mean0.744-0.741=0.003
σ0.017-0.021=-0.004
min0.709-0.669=0.040
max0.845-0.869=-0.025
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1651.000-1620.000=31.000
σ0.000
min1651.000-1620.000=31.000
max1651.000-1620.000=31.000
mean0.697-0.698=-0.001
σ0.056-0.016=0.040
min0.501-0.670=-0.169
max0.769-0.785=-0.016

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.906-297.144=-0.238
σ0.270-0.219=0.051
min296.703-296.884=-0.182
max297.636-297.577=0.058
mean1924.000-2032.000=-108.000
σ0.000
min1924.000-2032.000=-108.000
max1924.000-2032.000=-108.000
mean0.591-0.547=0.044
σ0.038-0.033=0.005
min0.524-0.499=0.025
max0.645-0.587=0.058

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.828-286.820=0.007
σ0.028-0.040=-0.012
min286.793-286.768=0.025
max286.858-286.862=-0.003
mean1651.000-1620.000=31.000
σ0.000
min1651.000-1620.000=31.000
max1651.000-1620.000=31.000
mean0.396-0.397=-0.001
σ0.009-0.007=0.002
min0.388-0.389=-0.000
max0.410-0.404=0.005
iters=5
new-facts=1
prior-facts=6402
mean1297.208-1297.208=0.000
σ0.106-0.110=-0.004
min1297.087-1297.085=0.002
max1297.331-1297.355=-0.024
mean1651.000-1620.000=31.000
σ0.000
min1651.000-1620.000=31.000
max1651.000-1620.000=31.000
mean1.939-1.874=0.065
σ0.114-0.067=0.047
min1.808-1.798=0.009
max2.061-1.933=0.127
iters=5
new-facts=6402
prior-facts=1
mean1541.401-1541.341=0.060
σ6.794-6.827=-0.033
min1538.132-1538.100=0.033
max1553.549-1553.550=-0.000
mean1651.000-1620.000=31.000
σ0.000
min1651.000-1620.000=31.000
max1651.000-1620.000=31.000
mean2.459-2.147=0.313
σ0.244-0.132=0.111
min2.060-2.047=0.012
max2.682-2.371=0.311
iters=5
new-facts=6402
prior-facts=6402
mean1859.120-1859.112=0.008
σ0.058-0.061=-0.004
min1859.069-1859.052=0.017
max1859.199-1859.193=0.006
mean1780.800-1771.200=9.600
σ137.320-178.469=-41.149
min1651.000-1620.000=31.000
max1924.000-2032.000=-108.000
mean2.969-2.889=0.080
σ0.105-0.041=0.064
min2.853-2.858=-0.005
max3.121-2.956=0.165

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.237-1.217=0.019
σ0.317-0.317=-0.000
min0.943-0.937=0.005
max1.762-1.746=0.017

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.822=0.000
σ581.372-581.372=0.000
min158.134-158.134=-0.000
max1320.880-1320.879=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1651.000-1620.000=31.000
σ0.000
min1651.000-1620.000=31.000
max1651.000-1620.000=31.000
mean0.544-0.547=-0.003
σ0.559-0.559=0.000
min0.263-0.265=-0.002
max1.383-1.386=-0.003
policies=20
mean1581.628-1581.629=-0.001
σ0.354-0.364=-0.010
min1581.389-1581.387=0.002
max1582.155-1582.171=-0.016
mean920.000
σ0.000
min920.000
max920.000
mean1651.000-1620.000=31.000
σ0.000
min1651.000-1620.000=31.000
max1651.000-1620.000=31.000
mean2.634-2.643=-0.009
σ0.015-0.007=0.008
min2.614-2.637=-0.023
max2.647-2.651=-0.004
policies=200
mean15824.191-15824.142=0.050
σ0.063-0.109=-0.046
min15824.117-15824.014=0.103
max15824.254-15824.273=-0.019
mean9200.000
σ0.000
min9200.000
max9200.000
mean1651.000-1620.000=31.000
σ0.000
min1651.000-1620.000=31.000
max1651.000-1620.000=31.000
mean26.611-26.595=0.016
σ0.077-0.025=0.052
min26.509-26.564=-0.055
max26.689-26.619=0.070