Compare commits

Home / Compare bc5a2de9 .. 7aa0e667

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.054=0.001
σ0.367-0.370=-0.003
min53.916-53.910=0.006
max55.100-55.107=-0.007
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.143-0.140=0.003
σ0.004-0.004=0.000
min0.139-0.134=0.005
max0.148-0.146=0.002
cache=y
dps=1
iters=10
policies=100
mean43.395-43.393=0.002
σ0.006-0.007=-0.001
min43.385-43.383=0.002
max43.407-43.404=0.003
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.124-0.121=0.003
σ0.004-0.004=-0.000
min0.120-0.115=0.006
max0.130-0.126=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.002-1007.003=-0.002
σ1.254-1.190=0.064
min1006.470-1006.431=0.038
max1012.273-1011.992=0.281
mean1047.400-1046.950=0.450
σ319.731-304.813=14.918
min585.000-577.000=8.000
max1615.000-1661.000=-46.000
mean1.561-1.556=0.005
σ0.128-0.084=0.044
min1.466-1.479=-0.013
max2.036-1.799=0.237

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1615.000-1661.000=-46.000
σ0.000
min1615.000-1661.000=-46.000
max1615.000-1661.000=-46.000
mean0.413-0.413=0.001
σ0.118-0.137=-0.019
min0.343-0.339=0.004
max0.622-0.656=-0.034
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1615.000-1661.000=-46.000
σ0.000
min1615.000-1661.000=-46.000
max1615.000-1661.000=-46.000
mean0.920-0.888=0.032
σ0.187-0.097=0.090
min0.818-0.828=-0.010
max1.251-1.059=0.192
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1615.000-1661.000=-46.000
σ0.000
min1615.000-1661.000=-46.000
max1615.000-1661.000=-46.000
mean0.534-0.568=-0.034
σ0.054-0.056=-0.001
min0.491-0.509=-0.018
max0.628-0.633=-0.006
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1615.000-1661.000=-46.000
σ0.000
min1615.000-1661.000=-46.000
max1615.000-1661.000=-46.000
mean0.835-0.846=-0.011
σ0.043-0.047=-0.005
min0.800-0.811=-0.011
max0.906-0.930=-0.024

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.838=0.001
σ0.033-0.027=0.006
min964.810-964.815=-0.005
max964.894-964.883=0.011
mean1615.000-1661.000=-46.000
σ0.000
min1615.000-1661.000=-46.000
max1615.000-1661.000=-46.000
mean0.816-0.792=0.025
σ0.036-0.063=-0.027
min0.777-0.729=0.048
max0.858-0.858=-0.000
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.007-0.008=-0.000
min885.504
max885.522-885.523=-0.001
mean1615.000-1661.000=-46.000
σ0.000
min1615.000-1661.000=-46.000
max1615.000-1661.000=-46.000
mean0.735-0.710=0.025
σ0.015-0.053=-0.037
min0.709-0.620=0.088
max0.747-0.751=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719
mean1615.000-1661.000=-46.000
σ0.000
min1615.000-1661.000=-46.000
max1615.000-1661.000=-46.000
mean2.763-4.212=-1.449
σ0.071-0.095=-0.024
min2.634-4.054=-1.419
max3.030-4.649=-1.618
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1615.000-1661.000=-46.000
σ0.000
min1615.000-1661.000=-46.000
max1615.000-1661.000=-46.000
mean3.448-4.178=-0.730
σ0.239-0.076=0.163
min2.734-4.043=-1.309
max4.413-4.449=-0.035
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1615.000-1661.000=-46.000
σ0.000
min1615.000-1661.000=-46.000
max1615.000-1661.000=-46.000
mean0.535-0.732=-0.197
σ0.014-0.017=-0.003
min0.509-0.704=-0.195
max0.631-0.830=-0.199
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1615.000-1661.000=-46.000
σ0.000
min1615.000-1661.000=-46.000
max1615.000-1661.000=-46.000
mean0.504-0.695=-0.191
σ0.013-0.015=-0.002
min0.480-0.665=-0.185
max0.566-0.771=-0.204

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.013-297.053=-0.039
σ0.214-0.227=-0.013
min296.858-296.785=0.073
max297.604-297.594=0.011
mean1896.000-1937.000=-41.000
σ0.000
min1896.000-1937.000=-41.000
max1896.000-1937.000=-41.000
mean0.591-0.605=-0.014
σ0.036-0.046=-0.010
min0.519-0.519=-0.001
max0.659-0.711=-0.052

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.822-286.821=0.001
σ0.040-0.040=0.001
min286.772-286.773=-0.001
max286.863-286.865=-0.002
mean1615.000-1661.000=-46.000
σ0.000
min1615.000-1661.000=-46.000
max1615.000-1661.000=-46.000
mean0.401-0.396=0.004
σ0.014-0.007=0.007
min0.389-0.388=0.001
max0.423-0.404=0.019
iters=5
new-facts=1
prior-facts=6402
mean1297.225-1297.239=-0.013
σ0.078-0.080=-0.002
min1297.125-1297.144=-0.019
max1297.303-1297.316=-0.012
mean1615.000-1661.000=-46.000
σ0.000
min1615.000-1661.000=-46.000
max1615.000-1661.000=-46.000
mean2.040-2.069=-0.028
σ0.035-0.082=-0.047
min1.992-1.984=0.008
max2.072-2.188=-0.116
iters=5
new-facts=6402
prior-facts=1
mean1541.305-1541.302=0.003
σ6.845-6.839=0.007
min1538.055-1538.052=0.004
max1553.546-1553.531=0.015
mean1615.000-1661.000=-46.000
σ0.000
min1615.000-1661.000=-46.000
max1615.000-1661.000=-46.000
mean2.185-2.150=0.036
σ0.108-0.080=0.028
min2.090-2.086=0.004
max2.358-2.283=0.075
iters=5
new-facts=6402
prior-facts=6402
mean1859.113-1859.115=-0.002
σ0.081-0.080=0.001
min1858.998-1859.000=-0.001
max1859.200-1859.193=0.007
mean1761.600-1791.800=-30.200
σ131.728-138.936=-7.208
min1615.000-1661.000=-46.000
max1896.000-1937.000=-41.000
mean3.087-2.958=0.129
σ0.189-0.151=0.038
min2.850-2.702=0.148
max3.317-3.101=0.216

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.188-1.203=-0.015
σ0.258-0.312=-0.054
min0.936-0.932=0.005
max1.611-1.715=-0.104

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.819-448.819=0.000
σ581.372-581.373=-0.000
min158.131-158.131=0.000
max1320.878-1320.878=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1615.000-1661.000=-46.000
σ0.000
min1615.000-1661.000=-46.000
max1615.000-1661.000=-46.000
mean0.568-0.532=0.035
σ0.609-0.541=0.068
min0.263-0.260=0.003
max1.480-1.344=0.137
policies=20
mean1581.612-1581.608=0.003
σ0.366-0.376=-0.010
min1581.359-1581.360=-0.001
max1582.156-1582.169=-0.013
mean920.000
σ0.000
min920.000
max920.000
mean1615.000-1661.000=-46.000
σ0.000
min1615.000-1661.000=-46.000
max1615.000-1661.000=-46.000
mean2.642-2.669=-0.027
σ0.023-0.047=-0.024
min2.617-2.636=-0.019
max2.664-2.738=-0.073
policies=200
mean15824.169-15824.014=0.155
σ0.146-0.116=0.029
min15824.022-15823.874=0.148
max15824.354-15824.159=0.195
mean9200.000
σ0.000
min9200.000
max9200.000
mean1615.000-1661.000=-46.000
σ0.000
min1615.000-1661.000=-46.000
max1615.000-1661.000=-46.000
mean26.637-26.705=-0.068
σ0.070-0.089=-0.019
min26.538-26.622=-0.084
max26.701-26.808=-0.107