Compare commits

Home / Compare 473a49e7 .. f42cacd7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.964-53.964=0.000
σ0.370-0.370=0.000
min53.822-53.821=0.000
max55.017-55.015=0.002
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.137-0.141=-0.004
σ0.005-0.003=0.002
min0.130-0.137=-0.007
max0.145-0.145=0.000
cache=y
dps=1
iters=10
policies=100
mean43.322-43.321=0.001
σ0.007-0.005=0.002
min43.313-43.315=-0.003
max43.336-43.334=0.002
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.122-0.122=-0.000
σ0.005-0.005=0.000
min0.114-0.114=0.001
max0.130-0.130=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.510-1011.209=-4.698
σ1.189-1.179=0.010
min1005.976-1010.655=-4.679
max1011.483-1016.150=-4.668
mean1035.450-1051.450=-16.000
σ310.951-309.839=1.111
min545.000-576.000=-31.000
max1504.000-1654.000=-150.000
mean1.548-1.544=0.005
σ0.075-0.077=-0.003
min1.423-1.462=-0.039
max1.776-1.767=0.010

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884
σ0.003
min0.882
max0.889
mean1504.000
σ0.000
min1504.000
max1504.000
mean0.443
σ0.187
min0.345
max0.777
name=error_case.art
mean2.339
σ0.002
min2.337
max2.342
mean1504.000
σ0.000
min1504.000
max1504.000
mean0.926
σ0.186
min0.830
max1.257
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1504.000
σ0.000
min1504.000
max1504.000
mean0.536
σ0.046
min0.493
max0.614
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1504.000
σ0.000
min1504.000
max1504.000
mean0.847
σ0.044
min0.812
max0.922

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.827
σ0.034
min964.802
max964.886
mean1504.000
σ0.000
min1504.000
max1504.000
mean0.801
σ0.026
min0.766
max0.833
name=cdr_enhanced_4k_loc.art
mean885.510
σ0.005
min885.504
max885.515
mean1504.000
σ0.000
min1504.000
max1504.000
mean0.703
σ0.033
min0.667
max0.735

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716
σ0.002
min7.715
max7.719
mean1504.000
σ0.000
min1504.000
max1504.000
mean4.223
σ0.085
min4.095
max4.578
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1504.000
σ0.000
min1504.000
max1504.000
mean4.221
σ0.064
min4.085
max4.409
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1504.000
σ0.000
min1504.000
max1504.000
mean0.739
σ0.020
min0.705
max0.853
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1504.000
σ0.000
min1504.000
max1504.000
mean0.696
σ0.014
min0.663
max0.749

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.398-301.120=-4.722
σ0.273-0.155=0.118
min296.184-300.950=-4.766
max297.121-301.489=-4.368
mean1920.000-1948.000=-28.000
σ0.000
min1920.000-1948.000=-28.000
max1920.000-1948.000=-28.000
mean0.582-0.559=0.023
σ0.037-0.040=-0.003
min0.505-0.503=0.002
max0.648-0.603=0.045

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.036-299.772=-14.736
σ0.023-0.062=-0.039
min285.014-299.675=-14.662
max285.061-299.830=-14.770
mean1504.000-1654.000=-150.000
σ0.000
min1504.000-1654.000=-150.000
max1504.000-1654.000=-150.000
mean0.398-0.394=0.005
σ0.007-0.009=-0.002
min0.387-0.386=0.001
max0.406-0.406=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.436-1310.211=-14.775
σ0.077-0.094=-0.017
min1295.344-1310.093=-14.749
max1295.533-1310.314=-14.781
mean1504.000-1654.000=-150.000
σ0.000
min1504.000-1654.000=-150.000
max1504.000-1654.000=-150.000
mean2.088-1.953=0.135
σ0.081-0.121=-0.039
min1.988-1.791=0.197
max2.170-2.077=0.093
iters=5
new-facts=6402
prior-facts=1
mean1539.528-1554.329=-14.801
σ6.840-6.890=-0.050
min1536.297-1551.013=-14.716
max1551.759-1566.648=-14.889
mean1504.000-1654.000=-150.000
σ0.000
min1504.000-1654.000=-150.000
max1504.000-1654.000=-150.000
mean2.247-2.329=-0.082
σ0.139-0.249=-0.110
min2.101-2.042=0.059
max2.418-2.634=-0.216
iters=5
new-facts=6402
prior-facts=6402
mean1857.317-1872.102=-14.785
σ0.079-0.051=0.029
min1857.205-1872.039=-14.834
max1857.402-1872.149=-14.747
mean1747.000-1764.800=-17.800
σ181.676-121.298=60.378
min1504.000-1654.000=-150.000
max1920.000-1948.000=-28.000
mean3.044-2.934=0.110
σ0.144-0.078=0.066
min2.872-2.859=0.013
max3.199-3.047=0.152

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.632-1.220=0.413
σ0.299-0.344=-0.046
min1.235-0.945=0.290
max1.898-1.801=0.097

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.194-448.217=-0.024
σ581.340-581.359=-0.020
min157.522-157.532=-0.010
max1320.203-1320.257=-0.053
mean96.250
σ8.500
min92.000
max109.000
mean1504.000-1654.000=-150.000
σ0.000
min1504.000-1654.000=-150.000
max1504.000-1654.000=-150.000
mean0.546-0.551=-0.005
σ0.567-0.572=-0.005
min0.261-0.261=-0.000
max1.397-1.409=-0.012
policies=20
mean1575.562-1575.596=-0.034
σ0.372-0.346=0.025
min1575.312-1575.398=-0.086
max1576.115-1576.114=0.000
mean920.000
σ0.000
min920.000
max920.000
mean1504.000-1654.000=-150.000
σ0.000
min1504.000-1654.000=-150.000
max1504.000-1654.000=-150.000
mean2.659-2.642=0.017
σ0.031-0.018=0.014
min2.623-2.621=0.001
max2.699-2.663=0.037
policies=200
mean15763.671-15763.736=-0.065
σ0.058-0.099=-0.042
min15763.594-15763.619=-0.025
max15763.732-15763.858=-0.126
mean9200.000
σ0.000
min9200.000
max9200.000
mean1504.000-1654.000=-150.000
σ0.000
min1504.000-1654.000=-150.000
max1504.000-1654.000=-150.000
mean26.697-26.717=-0.020
σ0.085-0.108=-0.022
min26.612-26.634=-0.022
max26.807-26.861=-0.054