Compare commits

Home / Compare 52489f95 .. d44d930e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.049=-0.035
σ0.371-0.369=0.002
min53.871-53.900=-0.029
max55.069-55.097=-0.029
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.137-0.140=-0.002
σ0.006-0.004=0.002
min0.132-0.136=-0.004
max0.147-0.147=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.321-43.343=-0.022
σ0.006-0.007=-0.000
min43.313-43.333=-0.020
max43.333-43.354=-0.020
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.121-0.120=0.001
σ0.004-0.005=-0.001
min0.115-0.114=0.001
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.333-1017.221=-10.888
σ1.178-1.172=0.005
min1005.792-1016.675=-10.883
max1011.266-1022.129=-10.863
mean1044.250-1059.000=-14.750
σ292.129-314.659=-22.530
min597.000-586.000=11.000
max1426.000-1622.000=-196.000
mean1.577-1.544=0.033
σ0.080-0.082=-0.002
min1.498-1.467=0.030
max1.780-1.812=-0.031

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1426.000
σ0.000
min1426.000
max1426.000
mean0.414
σ0.138
min0.339
max0.660
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1426.000
σ0.000
min1426.000
max1426.000
mean0.958
σ0.156
min0.835
max1.185
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1426.000
σ0.000
min1426.000
max1426.000
mean0.583
σ0.039
min0.541
max0.644
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1426.000
σ0.000
min1426.000
max1426.000
mean0.853
σ0.039
min0.812
max0.916

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.097
σ0.025
min964.077
max964.138
mean1426.000
σ0.000
min1426.000
max1426.000
mean0.819
σ0.033
min0.782
max0.855
name=cdr_enhanced_4k_loc.art
mean884.710
σ0.005
min884.703
max884.716
mean1426.000
σ0.000
min1426.000
max1426.000
mean0.713
σ0.036
min0.659
max0.741

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715
σ0.002
min7.714
max7.721
mean1426.000
σ0.000
min1426.000
max1426.000
mean4.213
σ0.077
min4.078
max4.473
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1426.000
σ0.000
min1426.000
max1426.000
mean4.229
σ0.088
min4.102
max4.533
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1426.000
σ0.000
min1426.000
max1426.000
mean0.745
σ0.035
min0.688
max0.888
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1426.000
σ0.000
min1426.000
max1426.000
mean0.528
σ0.064
min0.469
max0.849

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.214-302.092=-5.878
σ0.248-0.225=0.023
min296.060-301.945=-5.885
max296.889-302.700=-5.812
mean1906.000-2041.000=-135.000
σ0.000
min1906.000-2041.000=-135.000
max1906.000-2041.000=-135.000
mean0.595-0.597=-0.003
σ0.049-0.007=0.042
min0.504-0.580=-0.076
max0.701-0.606=0.095

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.724-303.804=-19.081
σ0.026-0.061=-0.034
min284.699-303.708=-19.009
max284.754-303.867=-19.113
mean1426.000-1622.000=-196.000
σ0.000
min1426.000-1622.000=-196.000
max1426.000-1622.000=-196.000
mean0.397-0.391=0.006
σ0.011-0.003=0.009
min0.387-0.389=-0.002
max0.412-0.395=0.016
iters=5
new-facts=1
prior-facts=6402
mean1295.116-1326.361=-31.245
σ0.072-0.108=-0.036
min1295.032-1326.225=-31.193
max1295.187-1326.481=-31.295
mean1426.000-1622.000=-196.000
σ0.000
min1426.000-1622.000=-196.000
max1426.000-1622.000=-196.000
mean2.097-1.878=0.219
σ0.113-0.057=0.056
min2.022-1.828=0.194
max2.291-1.958=0.333
iters=5
new-facts=6402
prior-facts=1
mean1539.272-1564.433=-25.161
σ6.809-6.911=-0.102
min1536.084-1561.142=-25.058
max1551.450-1576.791=-25.341
mean1426.000-1622.000=-196.000
σ0.000
min1426.000-1622.000=-196.000
max1426.000-1622.000=-196.000
mean2.355-2.391=-0.036
σ0.205-0.313=-0.108
min2.108-2.059=0.049
max2.557-2.749=-0.192
iters=5
new-facts=6402
prior-facts=6402
mean1857.007-1894.301=-37.294
σ0.060-0.063=-0.003
min1856.924-1894.191=-37.267
max1857.068-1894.346=-37.278
mean1736.600-1767.400=-30.800
σ181.524-175.289=6.234
min1481.000-1622.000=-141.000
max1906.000-2041.000=-135.000
mean3.098-3.001=0.098
σ0.307-0.188=0.119
min2.844-2.860=-0.016
max3.598-3.304=0.293

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.746-1.256=0.490
σ0.080-0.329=-0.249
min1.609-0.936=0.673
max1.812-1.797=0.015

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.832-448.384=-0.552
σ581.212-581.799=-0.586
min157.224-157.480=-0.257
max1319.650-1321.081=-1.431
mean96.250
σ8.500
min92.000
max109.000
mean1426.000-1622.000=-196.000
σ0.000
min1426.000-1622.000=-196.000
max1426.000-1622.000=-196.000
mean0.544-0.552=-0.008
σ0.562-0.576=-0.015
min0.260-0.261=-0.001
max1.386-1.416=-0.030
policies=20
mean1572.567-1575.074=-2.507
σ0.359-0.331=0.028
min1572.327-1574.870=-2.543
max1573.102-1575.569=-2.467
mean920.000
σ0.000
min920.000
max920.000
mean1426.000-1622.000=-196.000
σ0.000
min1426.000-1622.000=-196.000
max1426.000-1622.000=-196.000
mean2.637-2.617=0.020
σ0.027-0.026=0.001
min2.620-2.582=0.037
max2.677-2.640=0.038
policies=200
mean15733.601-15758.770=-25.169
σ0.060-0.049=0.011
min15733.564-15758.710=-25.145
max15733.691-15758.831=-25.140
mean9200.000
σ0.000
min9200.000
max9200.000
mean1426.000-1622.000=-196.000
σ0.000
min1426.000-1622.000=-196.000
max1426.000-1622.000=-196.000
mean26.623-26.497=0.127
σ0.043-0.121=-0.078
min26.572-26.342=0.230
max26.660-26.597=0.063