Compare commits

Home / Compare 04b7950e .. cd472128

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.048=0.007
σ0.368-0.369=-0.001
min53.914-53.902=0.012
max55.102-55.098=0.005
mean417.900-418.000=-0.100
σ0.316-0.000=0.316
min417.000-418.000=-1.000
max418.000
mean0.139-0.136=0.004
σ0.005-0.004=0.001
min0.132-0.131=0.001
max0.146-0.143=0.003
cache=y
dps=1
iters=10
policies=100
mean43.393-43.343=0.050
σ0.006-0.006=0.000
min43.386-43.336=0.050
max43.404-43.353=0.050
mean418.000
σ0.000
min418.000
max418.000
mean0.123-0.121=0.002
σ0.005-0.004=0.001
min0.116-0.115=0.001
max0.131-0.127=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.004-1017.203=-10.199
σ1.215-1.148=0.067
min1006.460-1016.625=-10.165
max1012.102-1022.001=-9.899
mean1055.350-1062.000=-6.650
σ307.959-311.576=-3.617
min580.000-592.000=-12.000
max1647.000-1632.000=15.000
mean1.573-1.527=0.046
σ0.081-0.051=0.030
min1.497-1.470=0.026
max1.788-1.672=0.116

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.433
σ0.138
min0.336
max0.668
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.876
σ0.104
min0.809
max1.058
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.528
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.523
σ0.051
min0.484
max0.612
name=nested_use.art
mean2.362
σ0.002
min2.360
max2.365
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.839
σ0.041
min0.814
max0.913

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.836
σ0.033
min964.811
max964.892
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.827
σ0.045
min0.753
max0.859
name=cdr_enhanced_4k_loc.art
mean885.511
σ0.005
min885.504
max885.516
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.717
σ0.034
min0.662
max0.745

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716
σ0.002
min7.715
max7.720
mean1647.000
σ0.000
min1647.000
max1647.000
mean4.271
σ0.099
min4.146
max4.791
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1647.000
σ0.000
min1647.000
max1647.000
mean4.251
σ0.074
min4.124
max4.511
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.729
σ0.021
min0.678
max0.850
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.694
σ0.018
min0.652
max0.794

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.082-302.066=-4.984
σ0.222-0.227=-0.004
min296.878-301.787=-4.909
max297.632-302.558=-4.926
mean1904.000-2045.000=-141.000
σ0.000
min1904.000-2045.000=-141.000
max1904.000-2045.000=-141.000
mean0.569-0.575=-0.007
σ0.028-0.031=-0.003
min0.520-0.507=0.013
max0.607-0.600=0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.823-303.788=-16.966
σ0.036-0.057=-0.021
min286.774-303.698=-16.924
max286.861-303.850=-16.989
mean1647.000-1632.000=15.000
σ0.000
min1647.000-1632.000=15.000
max1647.000-1632.000=15.000
mean0.394-0.395=-0.001
σ0.008-0.008=0.000
min0.386-0.391=-0.005
max0.404-0.409=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1297.266-1326.329=-29.063
σ0.097-0.110=-0.012
min1297.128-1326.195=-29.068
max1297.385-1326.455=-29.069
mean1647.000-1632.000=15.000
σ0.000
min1647.000-1632.000=15.000
max1647.000-1632.000=15.000
mean2.249-1.965=0.283
σ0.116-0.140=-0.024
min2.169-1.823=0.346
max2.453-2.134=0.319
iters=5
new-facts=6402
prior-facts=1
mean1541.392-1564.392=-23.000
σ6.775-6.919=-0.144
min1538.268-1561.084=-22.815
max1553.510-1576.765=-23.255
mean1647.000-1632.000=15.000
σ0.000
min1647.000-1632.000=15.000
max1647.000-1632.000=15.000
mean2.369-2.320=0.049
σ0.263-0.288=-0.025
min2.148-2.018=0.130
max2.767-2.700=0.066
iters=5
new-facts=6402
prior-facts=6402
mean1859.117-1894.277=-35.161
σ0.066-0.068=-0.002
min1859.027-1894.158=-35.132
max1859.193-1894.318=-35.125
mean1776.800-1776.000=0.800
σ126.308-174.698=-48.390
min1647.000-1632.000=15.000
max1904.000-2045.000=-141.000
mean3.101-3.024=0.077
σ0.274-0.325=-0.051
min2.854-2.858=-0.004
max3.527-3.603=-0.076

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.265-1.181=0.084
σ0.260-0.208=0.052
min0.964-0.967=-0.003
max1.634-1.442=0.192

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.337=0.485
σ581.373-581.802=-0.429
min158.134-157.433=0.701
max1320.881-1321.040=-0.159
mean96.250
σ8.500
min92.000
max109.000
mean1647.000-1632.000=15.000
σ0.000
min1647.000-1632.000=15.000
max1647.000-1632.000=15.000
mean0.554-0.539=0.015
σ0.581-0.551=0.030
min0.264-0.262=0.002
max1.425-1.365=0.060
policies=20
mean1581.632-1574.627=7.005
σ0.368-0.323=0.046
min1581.386-1574.454=6.932
max1582.180-1575.111=7.070
mean920.000
σ0.000
min920.000
max920.000
mean1647.000-1632.000=15.000
σ0.000
min1647.000-1632.000=15.000
max1647.000-1632.000=15.000
mean2.651-2.617=0.034
σ0.018-0.021=-0.004
min2.636-2.602=0.033
max2.676-2.647=0.029
policies=200
mean15824.059-15754.277=69.782
σ0.119-0.062=0.057
min15823.956-15754.216=69.740
max15824.222-15754.356=69.866
mean9200.000
σ0.000
min9200.000
max9200.000
mean1647.000-1632.000=15.000
σ0.000
min1647.000-1632.000=15.000
max1647.000-1632.000=15.000
mean26.718-26.679=0.039
σ0.051-0.145=-0.094
min26.670-26.511=0.159
max26.784-26.840=-0.056