Compare commits

Home / Compare 8b3e068a .. 47bee893

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.053=0.002
σ0.368-0.368=-0.000
min53.919-53.914=0.005
max55.101-55.100=0.001
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.139-0.136=0.003
σ0.003-0.004=-0.001
min0.136-0.131=0.005
max0.145-0.143=0.002
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.006-0.007=-0.002
min43.385-43.384=0.001
max43.403-43.410=-0.007
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.119-0.121=-0.002
σ0.004-0.005=-0.001
min0.114-0.114=-0.000
max0.128-0.131=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.004-1007.004=0.001
σ1.188-1.190=-0.002
min1006.460-1006.443=0.017
max1011.982-1011.995=-0.013
mean1050.900-1053.200=-2.300
σ311.518-319.324=-7.807
min591.000
max1652.000-1620.000=32.000
mean1.569-1.555=0.014
σ0.082-0.079=0.003
min1.426-1.481=-0.054
max1.812-1.833=-0.021

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1652.000-1620.000=32.000
σ0.000
min1652.000-1620.000=32.000
max1652.000-1620.000=32.000
mean0.420-0.408=0.012
σ0.140-0.135=0.005
min0.329-0.328=0.000
max0.667-0.645=0.021
name=error_case.art
mean2.339-2.339=-0.000
σ0.003-0.002=0.000
min2.337
max2.342
mean1652.000-1620.000=32.000
σ0.000
min1652.000-1620.000=32.000
max1652.000-1620.000=32.000
mean0.891-0.886=0.005
σ0.097-0.093=0.004
min0.821-0.814=0.007
max1.062-1.048=0.014
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1652.000-1620.000=32.000
σ0.000
min1652.000-1620.000=32.000
max1652.000-1620.000=32.000
mean0.529-0.525=0.003
σ0.053-0.046=0.007
min0.482-0.485=-0.003
max0.619-0.598=0.022
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1652.000-1620.000=32.000
σ0.000
min1652.000-1620.000=32.000
max1652.000-1620.000=32.000
mean0.840-0.834=0.006
σ0.035-0.038=-0.003
min0.812-0.798=0.014
max0.901-0.894=0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=0.000
σ0.035-0.036=-0.001
min964.807-964.810=-0.003
max964.896-964.896=-0.000
mean1652.000-1620.000=32.000
σ0.000
min1652.000-1620.000=32.000
max1652.000-1620.000=32.000
mean0.808-0.830=-0.022
σ0.062-0.035=0.027
min0.703-0.789=-0.087
max0.858-0.861=-0.003
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.008-0.004=0.004
min885.504-885.505=-0.001
max885.523-885.515=0.008
mean1652.000-1620.000=32.000
σ0.000
min1652.000-1620.000=32.000
max1652.000-1620.000=32.000
mean0.723-0.727=-0.004
σ0.025-0.028=-0.003
min0.680-0.680=-0.000
max0.739-0.751=-0.011

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.720=0.000
mean1652.000-1620.000=32.000
σ0.000
min1652.000-1620.000=32.000
max1652.000-1620.000=32.000
mean4.231-4.227=0.004
σ0.098-0.083=0.015
min4.071-4.063=0.008
max4.808-4.722=0.086
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1652.000-1620.000=32.000
σ0.000
min1652.000-1620.000=32.000
max1652.000-1620.000=32.000
mean4.219-4.208=0.011
σ0.083-0.089=-0.006
min4.090-4.005=0.085
max4.528-4.482=0.046
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1652.000-1620.000=32.000
σ0.000
min1652.000-1620.000=32.000
max1652.000-1620.000=32.000
mean0.738-0.722=0.016
σ0.021-0.029=-0.008
min0.701-0.676=0.025
max0.855-0.930=-0.074
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1652.000-1620.000=32.000
σ0.000
min1652.000-1620.000=32.000
max1652.000-1620.000=32.000
mean0.704-0.692=0.012
σ0.015-0.020=-0.005
min0.669-0.661=0.008
max0.762-0.834=-0.073

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.972-296.936=0.035
σ0.206-0.212=-0.006
min296.849-296.728=0.121
max297.539-297.503=0.036
mean1929.000-1960.000=-31.000
σ0.000
min1929.000-1960.000=-31.000
max1929.000-1960.000=-31.000
mean0.595-0.591=0.004
σ0.040-0.045=-0.005
min0.513-0.526=-0.013
max0.672-0.696=-0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.824-286.822=0.001
σ0.036-0.035=0.002
min286.779-286.778=0.001
max286.861-286.862=-0.001
mean1652.000-1620.000=32.000
σ0.000
min1652.000-1620.000=32.000
max1652.000-1620.000=32.000
mean0.392-0.399=-0.007
σ0.008-0.008=-0.001
min0.386-0.389=-0.003
max0.405-0.407=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1297.243-1297.249=-0.007
σ0.063-0.065=-0.002
min1297.168-1297.176=-0.009
max1297.294-1297.299=-0.006
mean1652.000-1620.000=32.000
σ0.000
min1652.000-1620.000=32.000
max1652.000-1620.000=32.000
mean2.097-2.030=0.067
σ0.087-0.041=0.046
min1.997-1.985=0.012
max2.201-2.089=0.112
iters=5
new-facts=6402
prior-facts=1
mean1541.347-1541.310=0.037
σ6.810-6.847=-0.038
min1538.138-1538.054=0.084
max1553.525-1553.554=-0.029
mean1652.000-1620.000=32.000
σ0.000
min1652.000-1620.000=32.000
max1652.000-1620.000=32.000
mean2.308-2.193=0.115
σ0.132-0.113=0.019
min2.137-2.090=0.047
max2.471-2.374=0.097
iters=5
new-facts=6402
prior-facts=6402
mean1859.102-1859.115=-0.012
σ0.091-0.076=0.015
min1858.959-1859.003=-0.044
max1859.193-1859.190=0.004
mean1786.000-1787.200=-1.200
σ138.865-169.662=-30.797
min1652.000-1620.000=32.000
max1929.000-1960.000=-31.000
mean3.145-2.975=0.170
σ0.361-0.070=0.291
min2.859-2.877=-0.019
max3.767-3.044=0.723

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.212-1.261=-0.049
σ0.329-0.368=-0.040
min0.942-0.938=0.003
max1.762-1.886=-0.124

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.820=0.001
σ581.370-581.372=-0.001
min158.135-158.133=0.002
max1320.877-1320.878=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1652.000-1620.000=32.000
σ0.000
min1652.000-1620.000=32.000
max1652.000-1620.000=32.000
mean0.564-0.556=0.008
σ0.597-0.583=0.014
min0.263-0.261=0.002
max1.459-1.430=0.029
policies=20
mean1581.622-1581.608=0.014
σ0.344-0.349=-0.004
min1581.389-1581.374=0.015
max1582.134-1582.127=0.007
mean920.000
σ0.000
min920.000
max920.000
mean1652.000-1620.000=32.000
σ0.000
min1652.000-1620.000=32.000
max1652.000-1620.000=32.000
mean2.615-2.628=-0.012
σ0.012-0.011=0.001
min2.599-2.611=-0.013
max2.625-2.637=-0.012
policies=200
mean15824.232-15824.189=0.043
σ0.019-0.131=-0.112
min15824.206-15824.027=0.179
max15824.252-15824.341=-0.089
mean9200.000
σ0.000
min9200.000
max9200.000
mean1652.000-1620.000=32.000
σ0.000
min1652.000-1620.000=32.000
max1652.000-1620.000=32.000
mean26.671-26.621=0.050
σ0.042-0.046=-0.004
min26.628-26.569=0.059
max26.710-26.679=0.032