Compare commits

Home / Compare 8ab9d161 .. ae36e91b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.049-54.051=-0.001
σ0.364-0.368=-0.004
min53.906-53.907=-0.002
max55.086-55.097=-0.011
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.151-0.155=-0.004
σ0.011-0.010=0.001
min0.135-0.135=0.001
max0.162-0.166=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.384-43.385=-0.002
σ0.007-0.008=-0.001
min43.370-43.375=-0.005
max43.395-43.400=-0.005
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.122-0.129=-0.007
σ0.006-0.011=-0.005
min0.114-0.119=-0.005
max0.133-0.148=-0.015

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.987=-0.009
σ0.887-0.865=0.021
min1006.494-1006.473=0.022
max1010.659-1010.552=0.108
mean1052.100-1056.800=-4.700
σ317.843-319.502=-1.659
min550.000-581.000=-31.000
max1653.000-1624.000=29.000
mean1.557-1.538=0.019
σ0.110-0.076=0.034
min1.394-1.387=0.007
max1.823-1.745=0.077

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.001
σ0.002-0.003=-0.000
min0.882
max0.887
mean1653.000-1624.000=29.000
σ0.000
min1653.000-1624.000=29.000
max1653.000-1624.000=29.000
mean0.417-0.412=0.005
σ0.134-0.134=-0.001
min0.332-0.336=-0.004
max0.654-0.651=0.003
name=error_case.art
mean2.339-2.339=0.001
σ0.003-0.003=-0.000
min2.337
max2.342
mean1653.000-1624.000=29.000
σ0.000
min1653.000-1624.000=29.000
max1653.000-1624.000=29.000
mean0.872-0.877=-0.004
σ0.096-0.088=0.007
min0.816-0.815=0.000
max1.041-1.030=0.011
name=heavy_item.art
mean1.523-1.524=-0.001
σ0.001-0.002=-0.001
min1.522
max1.525-1.526=-0.001
mean1653.000-1624.000=29.000
σ0.000
min1653.000-1624.000=29.000
max1653.000-1624.000=29.000
mean0.527-0.533=-0.006
σ0.044-0.044=-0.000
min0.497-0.487=0.010
max0.599-0.607=-0.008
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1653.000-1624.000=29.000
σ0.000
min1653.000-1624.000=29.000
max1653.000-1624.000=29.000
mean0.846-0.846=0.000
σ0.035-0.040=-0.006
min0.821-0.816=0.005
max0.907-0.914=-0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.829-964.831=-0.001
σ0.029-0.024=0.006
min964.802-964.803=-0.001
max964.876-964.859=0.017
mean1653.000-1624.000=29.000
σ0.000
min1653.000-1624.000=29.000
max1653.000-1624.000=29.000
mean0.829-0.838=-0.008
σ0.023-0.034=-0.011
min0.808-0.777=0.031
max0.861-0.857=0.003
name=cdr_enhanced_4k_loc.art
mean885.514-885.513=0.001
σ0.005-0.009=-0.004
min885.508-885.504=0.004
max885.518-885.524=-0.006
mean1653.000-1624.000=29.000
σ0.000
min1653.000-1624.000=29.000
max1653.000-1624.000=29.000
mean0.726-0.647=0.079
σ0.024-0.098=-0.074
min0.683-0.530=0.153
max0.743-0.728=0.014

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.719=0.003
mean1653.000-1624.000=29.000
σ0.000
min1653.000-1624.000=29.000
max1653.000-1624.000=29.000
mean3.509-2.615=0.894
σ0.080-0.100=-0.021
min3.378-2.432=0.946
max3.834-3.011=0.824
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1653.000-1624.000=29.000
σ0.000
min1653.000-1624.000=29.000
max1653.000-1624.000=29.000
mean4.179-2.599=1.580
σ0.162-0.100=0.063
min3.487-2.438=1.049
max4.437-3.172=1.264
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1653.000-1624.000=29.000
σ0.000
min1653.000-1624.000=29.000
max1653.000-1624.000=29.000
mean0.762-0.303=0.460
σ0.038-0.008=0.030
min0.551-0.289=0.262
max0.854-0.344=0.510
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1653.000-1624.000=29.000
σ0.000
min1653.000-1624.000=29.000
max1653.000-1624.000=29.000
mean0.717-0.288=0.429
σ0.035-0.011=0.024
min0.658-0.275=0.384
max0.801-0.362=0.438

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.523-295.628=-0.105
σ0.237-0.184=0.054
min295.367-295.463=-0.096
max296.182-296.128=0.053
mean1928.000-1914.000=14.000
σ0.000
min1928.000-1914.000=14.000
max1928.000-1914.000=14.000
mean0.569-0.562=0.007
σ0.039-0.068=-0.029
min0.502-0.448=0.054
max0.611-0.646=-0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.413-285.409=0.004
σ0.035-0.038=-0.003
min285.372-285.358=0.013
max285.448-285.447=0.001
mean1653.000-1624.000=29.000
σ0.000
min1653.000-1624.000=29.000
max1653.000-1624.000=29.000
mean0.394-0.387=0.006
σ0.008-0.006=0.002
min0.387-0.383=0.004
max0.403-0.397=0.006
iters=5
new-facts=1
prior-facts=6402
mean1295.792-1295.809=-0.018
σ0.102-0.121=-0.019
min1295.670-1295.680=-0.010
max1295.919-1295.983=-0.063
mean1653.000-1624.000=29.000
σ0.000
min1653.000-1624.000=29.000
max1653.000-1624.000=29.000
mean1.915-1.882=0.033
σ0.070-0.086=-0.015
min1.810-1.799=0.011
max1.978-2.013=-0.035
iters=5
new-facts=6402
prior-facts=1
mean1538.697-1539.909=-1.212
σ3.971-6.863=-2.892
min1536.686-1536.623=0.063
max1545.790-1552.181=-6.391
mean1653.000-1624.000=29.000
σ0.000
min1653.000-1624.000=29.000
max1653.000-1624.000=29.000
mean2.368-2.238=0.130
σ0.299-0.215=0.085
min2.117-2.008=0.109
max2.876-2.489=0.387
iters=5
new-facts=6402
prior-facts=6402
mean1857.719-1857.706=0.014
σ0.079-0.056=0.023
min1857.617-1857.651=-0.035
max1857.821-1857.787=0.035
mean1786.200-1781.200=5.000
σ137.836-137.787=0.049
min1653.000-1624.000=29.000
max1928.000-1914.000=14.000
mean3.110-3.068=0.042
σ0.326-0.257=0.069
min2.863-2.872=-0.009
max3.669-3.511=0.157

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.446-1.385=0.061
σ0.254-0.292=-0.038
min1.262-1.110=0.152
max1.819-1.874=-0.055

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.059-445.741=-1.683
σ577.575-580.934=-3.359
min155.267-155.273=-0.006
max1310.422-1317.142=-6.721
mean96.250
σ8.500
min92.000
max109.000
mean1653.000-1624.000=29.000
σ0.000
min1653.000-1624.000=29.000
max1653.000-1624.000=29.000
mean0.544-0.562=-0.018
σ0.555-0.585=-0.030
min0.262-0.262=-0.000
max1.376-1.438=-0.063
policies=20
mean1552.977-1552.991=-0.014
σ0.334-0.351=-0.017
min1552.749-1552.755=-0.006
max1553.473-1553.513=-0.040
mean920.000
σ0.000
min920.000
max920.000
mean1653.000-1624.000=29.000
σ0.000
min1653.000-1624.000=29.000
max1653.000-1624.000=29.000
mean2.596-2.618=-0.022
σ0.016-0.056=-0.040
min2.576-2.565=0.011
max2.615-2.698=-0.082
policies=200
mean15538.035-15538.045=-0.011
σ0.110-0.062=0.048
min15537.908-15537.970=-0.062
max15538.176-15538.120=0.056
mean9200.000
σ0.000
min9200.000
max9200.000
mean1653.000-1624.000=29.000
σ0.000
min1653.000-1624.000=29.000
max1653.000-1624.000=29.000
mean26.223-26.211=0.012
σ0.109-0.140=-0.031
min26.129-26.114=0.015
max26.362-26.412=-0.050