Compare commits

Home / Compare 027e9a9c .. 37aaafa5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.039=-0.025
σ0.371-0.369=0.001
min53.870-53.894=-0.024
max55.069-55.090=-0.021
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.138-0.136=0.002
σ0.005-0.006=-0.000
min0.130-0.130=-0.000
max0.147-0.144=0.003
cache=y
dps=1
iters=10
policies=100
mean43.323-43.342=-0.019
σ0.007-0.006=0.001
min43.310-43.333=-0.023
max43.334-43.348=-0.014
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.123-0.121=0.003
σ0.004-0.004=-0.001
min0.120-0.114=0.006
max0.131-0.128=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.305-1017.203=-10.898
σ1.195-1.171=0.024
min1005.741-1016.630=-10.889
max1011.318-1022.108=-10.791
mean1048.300-1062.100=-13.800
σ305.990-310.203=-4.213
min584.000-605.000=-21.000
max1642.000-1630.000=12.000
mean1.524-1.538=-0.014
σ0.053-0.041=0.013
min1.467-1.487=-0.020
max1.639-1.611=0.028

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.412
σ0.133
min0.319
max0.646
name=error_case.art
mean2.338
σ0.002
min2.336
max2.341
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.889
σ0.106
min0.824
max1.075
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.542
σ0.051
min0.505
max0.629
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.851
σ0.041
min0.818
max0.923

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114
σ0.034
min964.086
max964.169
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.804
σ0.046
min0.727
max0.850
name=cdr_enhanced_4k_loc.art
mean884.712
σ0.008
min884.703
max884.723
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.692
σ0.048
min0.613
max0.739

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.714
σ0.002
min7.714
max7.718
mean1642.000
σ0.000
min1642.000
max1642.000
mean3.401
σ0.306
min2.669
max3.973
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.667
mean1642.000
σ0.000
min1642.000
max1642.000
mean3.550
σ0.068
min3.405
max3.762
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.496
σ0.083
min0.300
max0.608
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1642.000
σ0.000
min1642.000
max1642.000
mean0.282
σ0.007
min0.269
max0.320

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.038-302.047=-6.009
σ0.277-0.254=0.023
min295.792-301.855=-6.063
max296.778-302.741=-5.963
mean1902.000-2019.000=-117.000
σ0.000
min1902.000-2019.000=-117.000
max1902.000-2019.000=-117.000
mean0.579-0.584=-0.005
σ0.044-0.033=0.011
min0.508-0.503=0.005
max0.657-0.606=0.051

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.692-303.778=-19.086
σ0.037-0.070=-0.033
min284.646-303.662=-19.016
max284.732-303.839=-19.107
mean1642.000-1630.000=12.000
σ0.000
min1642.000-1630.000=12.000
max1642.000-1630.000=12.000
mean0.397-0.397=0.000
σ0.010-0.008=0.002
min0.390-0.390=-0.000
max0.414-0.407=0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.082-1326.329=-31.246
σ0.120-0.102=0.019
min1294.955-1326.197=-31.242
max1295.266-1326.456=-31.189
mean1642.000-1630.000=12.000
σ0.000
min1642.000-1630.000=12.000
max1642.000-1630.000=12.000
mean1.907-1.926=-0.019
σ0.092-0.099=-0.007
min1.819-1.818=0.001
max2.030-2.050=-0.020
iters=5
new-facts=6402
prior-facts=1
mean1537.947-1563.179=-25.232
σ4.019-4.062=-0.043
min1535.932-1561.194=-25.263
max1545.130-1570.438=-25.309
mean1642.000-1630.000=12.000
σ0.000
min1642.000-1630.000=12.000
max1642.000-1630.000=12.000
mean2.176-2.385=-0.209
σ0.147-0.233=-0.087
min2.040-2.050=-0.010
max2.393-2.635=-0.242
iters=5
new-facts=6402
prior-facts=6402
mean1856.987-1894.286=-37.300
σ0.052-0.069=-0.017
min1856.935-1894.166=-37.231
max1857.057-1894.327=-37.270
mean1770.600-1781.600=-11.000
σ128.467-170.436=-41.969
min1642.000-1630.000=12.000
max1902.000-2019.000=-117.000
mean3.049-3.117=-0.067
σ0.203-0.239=-0.036
min2.856-2.894=-0.039
max3.383-3.492=-0.109

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.195-1.217=-0.023
σ0.266-0.276=-0.010
min0.950-0.919=0.031
max1.622-1.645=-0.022

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean446.124-446.399=-0.275
σ577.890-577.910=-0.019
min157.174-157.432=-0.258
max1312.960-1313.263=-0.304
mean96.250
σ8.500
min92.000
max109.000
mean1642.000-1630.000=12.000
σ0.000
min1642.000-1630.000=12.000
max1642.000-1630.000=12.000
mean0.530-0.538=-0.008
σ0.534-0.547=-0.012
min0.260-0.262=-0.002
max1.331-1.358=-0.026
policies=20
mean1572.099-1574.613=-2.514
σ0.361-0.342=0.019
min1571.851-1574.410=-2.558
max1572.636-1575.126=-2.490
mean920.000
σ0.000
min920.000
max920.000
mean1642.000-1630.000=12.000
σ0.000
min1642.000-1630.000=12.000
max1642.000-1630.000=12.000
mean2.635-2.634=0.001
σ0.006-0.009=-0.002
min2.628-2.622=0.006
max2.643-2.644=-0.001
policies=200
mean15729.077-15753.973=-24.896
σ0.065-0.609=-0.544
min15729.006-15753.102=-24.096
max15729.156-15754.396=-25.241
mean9200.000
σ0.000
min9200.000
max9200.000
mean1642.000-1630.000=12.000
σ0.000
min1642.000-1630.000=12.000
max1642.000-1630.000=12.000
mean26.539-26.628=-0.088
σ0.146-0.162=-0.016
min26.385-26.442=-0.057
max26.738-26.791=-0.053