Compare commits

Home / Compare 4a298f59 .. 1e36cdc7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.964-53.965=-0.000
σ0.370-0.370=0.000
min53.816-53.821=-0.004
max55.016-55.016=-0.000
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.141-0.136=0.006
σ0.009-0.005=0.004
min0.131-0.129=0.002
max0.160-0.143=0.016
cache=y
dps=1
iters=10
policies=100
mean43.323-43.323=0.000
σ0.007-0.006=0.001
min43.311-43.314=-0.003
max43.334-43.334=-0.001
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.122-0.120=0.001
σ0.004-0.005=-0.001
min0.114-0.113=0.001
max0.127-0.127=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.516-1006.521=-0.006
σ1.132-1.172=-0.040
min1005.950-1005.947=0.003
max1011.240-1011.423=-0.182
mean1044.650-1054.750=-10.100
σ314.923-312.362=2.561
min568.000-557.000=11.000
max1642.000-1519.000=123.000
mean1.536-1.512=0.024
σ0.072-0.088=-0.016
min1.459-1.365=0.094
max1.744-1.767=-0.023

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1642.000-1519.000=123.000
σ0.000
min1642.000-1519.000=123.000
max1642.000-1519.000=123.000
mean0.417-0.417=-0.000
σ0.132-0.143=-0.011
min0.334-0.341=-0.007
max0.650-0.671=-0.021
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1642.000-1519.000=123.000
σ0.000
min1642.000-1519.000=123.000
max1642.000-1519.000=123.000
mean0.894-0.883=0.011
σ0.088-0.092=-0.003
min0.837-0.804=0.033
max1.049-1.040=0.010
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1642.000-1519.000=123.000
σ0.000
min1642.000-1519.000=123.000
max1642.000-1519.000=123.000
mean0.551-0.530=0.021
σ0.043-0.046=-0.002
min0.515-0.496=0.019
max0.624-0.608=0.017
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1642.000-1519.000=123.000
σ0.000
min1642.000-1519.000=123.000
max1642.000-1519.000=123.000
mean0.850-0.837=0.013
σ0.042-0.043=-0.001
min0.816-0.803=0.013
max0.919-0.910=0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.831=0.008
σ0.029-0.038=-0.009
min964.813-964.806=0.008
max964.886-964.897=-0.011
mean1642.000-1519.000=123.000
σ0.000
min1642.000-1519.000=123.000
max1642.000-1519.000=123.000
mean0.827-0.835=-0.008
σ0.025-0.029=-0.003
min0.802-0.784=0.018
max0.860-0.855=0.006
name=cdr_enhanced_4k_loc.art
mean885.512-885.510=0.001
σ0.007-0.008=-0.000
min885.504
max885.522-885.521=0.002
mean1642.000-1519.000=123.000
σ0.000
min1642.000-1519.000=123.000
max1642.000-1519.000=123.000
mean0.693-0.714=-0.021
σ0.056-0.042=0.014
min0.611-0.664=-0.052
max0.746-0.754=-0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.001
mean1642.000-1519.000=123.000
σ0.000
min1642.000-1519.000=123.000
max1642.000-1519.000=123.000
mean4.287-4.264=0.022
σ0.091-0.089=0.002
min4.150-4.124=0.026
max4.722-4.581=0.141
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=0.000
min7.664
max7.668
mean1642.000-1519.000=123.000
σ0.000
min1642.000-1519.000=123.000
max1642.000-1519.000=123.000
mean4.286-4.261=0.024
σ0.093-0.084=0.009
min4.117-4.105=0.012
max4.846-4.596=0.251
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1642.000-1519.000=123.000
σ0.000
min1642.000-1519.000=123.000
max1642.000-1519.000=123.000
mean0.752-0.740=0.012
σ0.022-0.016=0.006
min0.640-0.715=-0.075
max0.863-0.857=0.006
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1642.000-1519.000=123.000
σ0.000
min1642.000-1519.000=123.000
max1642.000-1519.000=123.000
mean0.706-0.697=0.009
σ0.021-0.015=0.005
min0.627-0.670=-0.043
max0.813-0.772=0.042

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.261-296.353=-0.092
σ0.226-0.210=0.015
min296.107-296.216=-0.109
max296.883-296.932=-0.049
mean1918.000-2031.000=-113.000
σ0.000
min1918.000-2031.000=-113.000
max1918.000-2031.000=-113.000
mean0.560-0.576=-0.016
σ0.040-0.026=0.014
min0.502-0.518=-0.017
max0.610-0.598=0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.036-285.031=0.005
σ0.038-0.039=-0.000
min284.984-284.983=0.001
max285.074-285.075=-0.001
mean1642.000-1519.000=123.000
σ0.000
min1642.000-1519.000=123.000
max1642.000-1519.000=123.000
mean0.394-0.393=0.001
σ0.008-0.008=-0.001
min0.385-0.383=0.002
max0.403-0.405=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.417-1295.424=-0.007
σ0.113-0.121=-0.008
min1295.294-1295.295=-0.001
max1295.550-1295.590=-0.039
mean1642.000-1519.000=123.000
σ0.000
min1642.000-1519.000=123.000
max1642.000-1519.000=123.000
mean1.902-1.889=0.013
σ0.094-0.091=0.003
min1.804-1.807=-0.002
max2.013-2.025=-0.012
iters=5
new-facts=6402
prior-facts=1
mean1539.516-1539.541=-0.025
σ6.838-6.784=0.055
min1536.253-1536.269=-0.015
max1551.744-1551.672=0.072
mean1642.000-1519.000=123.000
σ0.000
min1642.000-1519.000=123.000
max1642.000-1519.000=123.000
mean2.223-2.258=-0.035
σ0.155-0.258=-0.103
min2.042-2.003=0.038
max2.381-2.634=-0.252
iters=5
new-facts=6402
prior-facts=6402
mean1857.321-1857.333=-0.012
σ0.072-0.069=0.003
min1857.231-1857.239=-0.008
max1857.396-1857.397=-0.001
mean1774.800-1738.600=36.200
σ138.489-212.893=-74.404
min1642.000-1519.000=123.000
max1918.000-2031.000=-113.000
mean2.984-2.892=0.093
σ0.191-0.071=0.119
min2.711-2.822=-0.111
max3.123-2.987=0.136

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.205-1.561=-0.355
σ0.362-0.191=0.171
min0.937-1.258=-0.321
max1.807-1.738=0.070

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.188-448.190=-0.002
σ581.331-581.332=-0.001
min157.521-157.521=0.000
max1320.185-1320.188=-0.003
mean96.250
σ8.500
min92.000
max109.000
mean1642.000-1519.000=123.000
σ0.000
min1642.000-1519.000=123.000
max1642.000-1519.000=123.000
mean0.542-0.526=0.017
σ0.560-0.529=0.032
min0.259-0.257=0.002
max1.383-1.319=0.064
policies=20
mean1575.554-1575.565=-0.011
σ0.361-0.349=0.012
min1575.311-1575.330=-0.019
max1576.091-1576.084=0.007
mean920.000
σ0.000
min920.000
max920.000
mean1642.000-1519.000=123.000
σ0.000
min1642.000-1519.000=123.000
max1642.000-1519.000=123.000
mean2.631-2.623=0.008
σ0.016-0.020=-0.004
min2.609-2.603=0.006
max2.645-2.646=-0.002
policies=200
mean15763.694-15763.664=0.029
σ0.141-0.154=-0.013
min15763.564-15763.564=-0.001
max15763.858-15763.892=-0.035
mean9200.000
σ0.000
min9200.000
max9200.000
mean1642.000-1519.000=123.000
σ0.000
min1642.000-1519.000=123.000
max1642.000-1519.000=123.000
mean26.567-26.484=0.083
σ0.103-0.040=0.063
min26.492-26.437=0.055
max26.717-26.526=0.191