Compare commits

Home / Compare d983bcd3 .. e3a7c0f9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.041=0.016
σ0.370-0.370=-0.000
min53.908-53.901=0.007
max55.109-55.094=0.015
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.138-0.140=-0.002
σ0.004-0.003=0.001
min0.134-0.137=-0.003
max0.147-0.146=0.002
cache=y
dps=1
iters=10
policies=100
mean43.395-43.341=0.054
σ0.006-0.006=0.000
min43.385-43.335=0.050
max43.403-43.354=0.049
mean415.100-419.000=-3.900
σ0.316-0.000=0.316
min415.000-419.000=-4.000
max416.000-419.000=-3.000
mean0.122-0.122=0.000
σ0.004-0.005=-0.001
min0.118-0.114=0.004
max0.129-0.130=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.962-1017.199=-10.238
σ0.904-1.189=-0.285
min1006.487-1016.657=-10.170
max1010.713-1022.182=-11.468
mean1050.600-1060.550=-9.950
σ310.102-313.161=-3.059
min551.000-566.000=-15.000
max1643.000-1521.000=122.000
mean1.561-1.576=-0.015
σ0.119-0.064=0.055
min1.471-1.496=-0.026
max1.841-1.678=0.163

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.425
σ0.141
min0.325
max0.665
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.879
σ0.109
min0.815
max1.073
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.528
σ0.049
min0.478
max0.611
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.838
σ0.044
min0.805
max0.914

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840
σ0.034
min964.811
max964.896
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.848
σ0.028
min0.799
max0.867
name=cdr_enhanced_4k_loc.art
mean885.512
σ0.006
min885.505
max885.518
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.726
σ0.023
min0.686
max0.740

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716
σ0.002
min7.715
max7.719
mean1643.000
σ0.000
min1643.000
max1643.000
mean4.244
σ0.087
min4.116
max4.480
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1643.000
σ0.000
min1643.000
max1643.000
mean4.257
σ0.080
min4.124
max4.517
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.744
σ0.027
min0.607
max0.855
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.701
σ0.023
min0.586
max0.797

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.426-302.076=-6.651
σ0.268-0.237=0.031
min295.280-301.894=-6.614
max296.172-302.730=-6.558
mean1913.000-2034.000=-121.000
σ0.000
min1913.000-2034.000=-121.000
max1913.000-2034.000=-121.000
mean0.574-0.602=-0.028
σ0.033-0.012=0.020
min0.535-0.581=-0.046
max0.635-0.626=0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.394-303.782=-18.388
σ0.038-0.061=-0.024
min285.350-303.685=-18.336
max285.434-303.840=-18.406
mean1643.000-1521.000=122.000
σ0.000
min1643.000-1521.000=122.000
max1643.000-1521.000=122.000
mean0.390-0.396=-0.006
σ0.008-0.007=0.001
min0.380-0.390=-0.010
max0.397-0.409=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1295.782-1326.339=-30.557
σ0.117-0.112=0.006
min1295.655-1326.198=-30.543
max1295.926-1326.465=-30.539
mean1643.000-1521.000=122.000
σ0.000
min1643.000-1521.000=122.000
max1643.000-1521.000=122.000
mean1.898-1.933=-0.034
σ0.075-0.107=-0.032
min1.809-1.816=-0.007
max1.982-2.035=-0.053
iters=5
new-facts=6402
prior-facts=1
mean1539.897-1564.430=-24.534
σ6.868-6.881=-0.013
min1536.643-1561.172=-24.528
max1552.178-1576.735=-24.556
mean1643.000-1521.000=122.000
σ0.000
min1643.000-1521.000=122.000
max1643.000-1521.000=122.000
mean2.230-2.358=-0.128
σ0.195-0.270=-0.076
min2.035-1.968=0.067
max2.472-2.629=-0.157
iters=5
new-facts=6402
prior-facts=6402
mean1857.684-1894.283=-36.599
σ0.063-0.070=-0.008
min1857.613-1894.158=-36.545
max1857.770-1894.324=-36.554
mean1772.400-1764.400=8.000
σ135.579-210.991=-75.412
min1643.000-1521.000=122.000
max1913.000-2034.000=-121.000
mean3.130-3.070=0.060
σ0.373-0.121=0.252
min2.862-2.901=-0.039
max3.785-3.237=0.548

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.238-1.540=-0.302
σ0.376-0.291=0.084
min0.930-1.219=-0.289
max1.851-1.795=0.056

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.705-448.050=-2.345
σ580.934-581.229=-0.295
min155.236-157.432=-2.197
max1317.106-1319.894=-2.789
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1521.000=122.000
σ0.000
min1643.000-1521.000=122.000
max1643.000-1521.000=122.000
mean0.526-0.536=-0.009
σ0.528-0.541=-0.013
min0.262-0.263=-0.001
max1.319-1.347=-0.028
policies=20
mean1552.633-1574.608=-21.974
σ0.333-0.350=-0.017
min1552.401-1574.379=-21.978
max1553.128-1575.129=-22.001
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1521.000=122.000
σ0.000
min1643.000-1521.000=122.000
max1643.000-1521.000=122.000
mean2.590-2.641=-0.050
σ0.016-0.023=-0.007
min2.571-2.615=-0.044
max2.609-2.668=-0.059
policies=200
mean15534.642-15754.241=-219.599
σ0.134-0.068=0.065
min15534.555-15754.176=-219.621
max15534.839-15754.314=-219.476
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1521.000=122.000
σ0.000
min1643.000-1521.000=122.000
max1643.000-1521.000=122.000
mean26.082-26.797=-0.715
σ0.055-0.141=-0.086
min26.049-26.675=-0.627
max26.163-26.998=-0.835