Compare commits

Home / Compare 23cf9a90 .. 2c016cbd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean52.580-52.578=0.002
σ0.349-0.349=-0.000
min52.437-52.438=-0.001
max53.572-53.571=0.001
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.136-0.133=0.002
σ0.005-0.005=0.000
min0.130-0.128=0.001
max0.143-0.140=0.002
cache=y
dps=1
iters=10
policies=100
mean43.902-43.903=-0.001
σ0.006-0.007=-0.001
min43.891-43.893=-0.002
max43.914-43.913=0.000
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.123-0.125=-0.002
σ0.003-0.004=-0.001
min0.121-0.121=0.000
max0.130-0.133=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.033-1007.034=-0.001
σ0.877-0.879=-0.001
min1006.529-1006.565=-0.036
max1010.653-1010.667=-0.014
mean1052.300-1060.150=-7.850
σ312.526-320.885=-8.359
min553.000-558.000=-5.000
max1516.000-1527.000=-11.000
mean1.552-1.529=0.023
σ0.085-0.054=0.031
min1.428-1.442=-0.014
max1.812-1.643=0.169

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.885=-0.001
σ0.003-0.003=-0.000
min0.882
max0.887-0.888=-0.002
mean1516.000-1527.000=-11.000
σ0.000
min1516.000-1527.000=-11.000
max1516.000-1527.000=-11.000
mean0.414-0.423=-0.009
σ0.134-0.138=-0.005
min0.340-0.348=-0.008
max0.650-0.668=-0.019
name=error_case.art
mean2.339-2.339=-0.000
σ0.003-0.003=-0.000
min2.337
max2.342
mean1516.000-1527.000=-11.000
σ0.000
min1516.000-1527.000=-11.000
max1516.000-1527.000=-11.000
mean0.917-0.898=0.019
σ0.087-0.088=-0.001
min0.826-0.840=-0.015
max1.044-1.052=-0.008
name=heavy_item.art
mean1.524-1.525=-0.001
σ0.002-0.002=-0.000
min1.522
max1.526-1.527=-0.001
mean1516.000-1527.000=-11.000
σ0.000
min1516.000-1527.000=-11.000
max1516.000-1527.000=-11.000
mean0.535-0.543=-0.008
σ0.050-0.047=0.002
min0.494-0.513=-0.020
max0.617-0.623=-0.006
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1516.000-1527.000=-11.000
σ0.000
min1516.000-1527.000=-11.000
max1516.000-1527.000=-11.000
mean0.848-0.860=-0.012
σ0.035-0.032=0.003
min0.820-0.832=-0.012
max0.908-0.915=-0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.827=0.004
σ0.038-0.034=0.004
min964.802
max964.898-964.887=0.010
mean1516.000-1527.000=-11.000
σ0.000
min1516.000-1527.000=-11.000
max1516.000-1527.000=-11.000
mean0.825-0.833=-0.008
σ0.030-0.020=0.011
min0.778-0.803=-0.025
max0.863-0.854=0.009
name=cdr_enhanced_4k_loc.art
mean885.511-885.511=0.000
σ0.007-0.007=0.000
min885.504
max885.518-885.519=-0.001
mean1516.000-1527.000=-11.000
σ0.000
min1516.000-1527.000=-11.000
max1516.000-1527.000=-11.000
mean0.703-0.741=-0.038
σ0.037-0.005=0.032
min0.674-0.736=-0.062
max0.745-0.749=-0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.721=-0.000
mean1516.000-1527.000=-11.000
σ0.000
min1516.000-1527.000=-11.000
max1516.000-1527.000=-11.000
mean4.269-4.206=0.063
σ0.083-0.084=-0.001
min4.106-4.048=0.057
max4.557-4.473=0.083
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1516.000-1527.000=-11.000
σ0.000
min1516.000-1527.000=-11.000
max1516.000-1527.000=-11.000
mean4.246-4.212=0.034
σ0.078-0.069=0.009
min4.131-4.098=0.032
max4.517-4.426=0.091
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1516.000-1527.000=-11.000
σ0.000
min1516.000-1527.000=-11.000
max1516.000-1527.000=-11.000
mean0.732-0.752=-0.020
σ0.058-0.018=0.040
min0.522-0.719=-0.198
max0.858-0.852=0.006
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1516.000-1527.000=-11.000
σ0.000
min1516.000-1527.000=-11.000
max1516.000-1527.000=-11.000
mean0.708-0.714=-0.007
σ0.015-0.015=-0.000
min0.684-0.675=0.009
max0.786-0.798=-0.012

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.607-295.620=-0.013
σ0.242-0.219=0.023
min295.384-295.472=-0.088
max296.259-296.212=0.047
mean1910.000
σ0.000
min1910.000
max1910.000
mean0.572-0.585=-0.013
σ0.042-0.052=-0.011
min0.500-0.520=-0.020
max0.636-0.703=-0.067

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.539-285.536=0.002
σ0.039-0.039=0.001
min285.482-285.479=0.003
max285.577-285.575=0.002
mean1516.000-1527.000=-11.000
σ0.000
min1516.000-1527.000=-11.000
max1516.000-1527.000=-11.000
mean0.404-0.395=0.008
σ0.009-0.005=0.004
min0.394-0.387=0.007
max0.416-0.401=0.015
iters=5
new-facts=1
prior-facts=6402
mean1295.905-1295.922=-0.018
σ0.076-0.105=-0.029
min1295.806-1295.808=-0.001
max1295.985-1296.047=-0.063
mean1516.000-1527.000=-11.000
σ0.000
min1516.000-1527.000=-11.000
max1516.000-1527.000=-11.000
mean1.905-1.910=-0.004
σ0.090-0.082=0.008
min1.800-1.812=-0.011
max2.005-2.005=0.001
iters=5
new-facts=6402
prior-facts=1
mean1540.066-1540.039=0.027
σ6.951-6.868=0.083
min1536.729-1536.702=0.027
max1552.494-1552.321=0.174
mean1516.000-1527.000=-11.000
σ0.000
min1516.000-1527.000=-11.000
max1516.000-1527.000=-11.000
mean2.332-2.280=0.051
σ0.356-0.265=0.092
min2.054-2.001=0.053
max2.906-2.627=0.279
iters=5
new-facts=6402
prior-facts=6402
mean1857.837-1857.834=0.003
σ0.053-0.062=-0.009
min1857.780-1857.763=0.018
max1857.904-1857.902=0.002
mean1752.800-1737.800=15.000
σ170.080-173.461=-3.381
min1516.000-1527.000=-11.000
max1910.000
mean3.073-3.014=0.059
σ0.281-0.188=0.093
min2.854-2.818=0.036
max3.557-3.231=0.326

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.565-1.632=-0.067
σ0.345-0.268=0.077
min1.035-1.319=-0.285
max1.890-1.899=-0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.795-445.795=0.001
σ580.934-580.934=0.000
min155.327-155.327=-0.000
max1317.196-1317.195=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1516.000-1527.000=-11.000
σ0.000
min1516.000-1527.000=-11.000
max1516.000-1527.000=-11.000
mean0.530-0.560=-0.030
σ0.544-0.592=-0.048
min0.257-0.264=-0.007
max1.346-1.448=-0.102
policies=20
mean1553.530-1553.525=0.005
σ0.329-0.335=-0.005
min1553.304-1553.284=0.020
max1554.019-1554.020=-0.001
mean920.000
σ0.000
min920.000
max920.000
mean1516.000-1527.000=-11.000
σ0.000
min1516.000-1527.000=-11.000
max1516.000-1527.000=-11.000
mean2.588-2.593=-0.005
σ0.016-0.008=0.008
min2.571-2.587=-0.016
max2.604-2.605=-0.001
policies=200
mean15543.286-15543.439=-0.153
σ0.110-0.096=0.014
min15543.141-15543.378=-0.237
max15543.377-15543.582=-0.205
mean9200.000
σ0.000
min9200.000
max9200.000
mean1516.000-1527.000=-11.000
σ0.000
min1516.000-1527.000=-11.000
max1516.000-1527.000=-11.000
mean26.167-26.187=-0.021
σ0.047-0.059=-0.012
min26.111-26.119=-0.008
max26.210-26.262=-0.053