Compare commits

Home / Compare 68bfdd77 .. f701c012

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-53.964=0.090
σ0.371-0.367=0.003
min53.908-53.819=0.089
max55.108-55.009=0.099
mean414.000-420.000=-6.000
σ0.000
min414.000-420.000=-6.000
max414.000-420.000=-6.000
mean0.139-0.139=-0.000
σ0.006-0.004=0.002
min0.130-0.134=-0.004
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.393-43.322=0.071
σ0.006-0.007=-0.001
min43.386-43.311=0.075
max43.401-43.334=0.067
mean414.000-420.000=-6.000
σ0.000
min414.000-420.000=-6.000
max414.000-420.000=-6.000
mean0.123-0.121=0.002
σ0.004-0.004=-0.001
min0.119-0.114=0.005
max0.128-0.129=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.006-1006.513=0.494
σ1.189-1.183=0.006
min1006.434-1005.975=0.460
max1011.987-1011.453=0.533
mean1055.100-1042.000=13.100
σ314.791-311.068=3.723
min585.000-552.000=33.000
max1618.000-1510.000=108.000
mean1.530-1.563=-0.033
σ0.053-0.084=-0.032
min1.459-1.475=-0.016
max1.631-1.831=-0.199

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1618.000-1510.000=108.000
σ0.000
min1618.000-1510.000=108.000
max1618.000-1510.000=108.000
mean0.447-0.418=0.030
σ0.147-0.133=0.013
min0.362-0.340=0.023
max0.705-0.655=0.050
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1618.000-1510.000=108.000
σ0.000
min1618.000-1510.000=108.000
max1618.000-1510.000=108.000
mean0.940-0.877=0.063
σ0.214-0.097=0.118
min0.827-0.809=0.018
max1.322-1.046=0.277
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1618.000-1510.000=108.000
σ0.000
min1618.000-1510.000=108.000
max1618.000-1510.000=108.000
mean0.554-0.538=0.016
σ0.057-0.052=0.004
min0.487-0.497=-0.009
max0.615-0.625=-0.010
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1618.000-1510.000=108.000
σ0.000
min1618.000-1510.000=108.000
max1618.000-1510.000=108.000
mean0.868-0.852=0.016
σ0.039-0.047=-0.008
min0.843-0.817=0.026
max0.936-0.933=0.004

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.829=0.011
σ0.035-0.039=-0.004
min964.810-964.806=0.005
max964.898-964.897=0.001
mean1618.000-1510.000=108.000
σ0.000
min1618.000-1510.000=108.000
max1618.000-1510.000=108.000
mean0.810-0.805=0.005
σ0.060-0.042=0.018
min0.727-0.734=-0.006
max0.861-0.842=0.018
name=cdr_enhanced_4k_loc.art
mean885.513-885.510=0.002
σ0.008-0.009=-0.002
min885.506-885.504=0.001
max885.525-885.525=-0.000
mean1618.000-1510.000=108.000
σ0.000
min1618.000-1510.000=108.000
max1618.000-1510.000=108.000
mean0.696-0.700=-0.003
σ0.039-0.045=-0.007
min0.648-0.632=0.016
max0.751-0.745=0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1618.000-1510.000=108.000
σ0.000
min1618.000-1510.000=108.000
max1618.000-1510.000=108.000
mean4.281-4.234=0.047
σ0.080-0.085=-0.005
min4.132-4.106=0.026
max4.671-4.710=-0.040
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.002
mean1618.000-1510.000=108.000
σ0.000
min1618.000-1510.000=108.000
max1618.000-1510.000=108.000
mean4.262-4.230=0.032
σ0.117-0.079=0.038
min4.096-4.077=0.020
max5.012-4.529=0.483
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1618.000-1510.000=108.000
σ0.000
min1618.000-1510.000=108.000
max1618.000-1510.000=108.000
mean0.750-0.747=0.003
σ0.017-0.017=0.000
min0.711-0.718=-0.007
max0.863-0.864=-0.001
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1618.000-1510.000=108.000
σ0.000
min1618.000-1510.000=108.000
max1618.000-1510.000=108.000
mean0.703-0.706=-0.003
σ0.015-0.014=0.001
min0.674-0.677=-0.003
max0.780-0.779=0.001

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.935-296.429=0.506
σ0.246-0.189=0.057
min296.719-296.270=0.450
max297.559-296.939=0.620
mean2032.000-1898.000=134.000
σ0.000
min2032.000-1898.000=134.000
max2032.000-1898.000=134.000
mean0.577-0.598=-0.021
σ0.020-0.037=-0.016
min0.537-0.557=-0.019
max0.595-0.693=-0.097

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.818-285.029=1.789
σ0.039-0.037=0.002
min286.767-284.981=1.786
max286.858-285.071=1.786
mean1618.000-1510.000=108.000
σ0.000
min1618.000-1510.000=108.000
max1618.000-1510.000=108.000
mean0.396-0.395=0.000
σ0.005-0.006=-0.001
min0.388-0.388=0.000
max0.400-0.403=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1297.211-1295.445=1.766
σ0.121-0.061=0.059
min1297.088-1295.374=1.714
max1297.363-1295.532=1.831
mean1618.000-1510.000=108.000
σ0.000
min1618.000-1510.000=108.000
max1618.000-1510.000=108.000
mean1.879-2.110=-0.232
σ0.094-0.094=-0.000
min1.804-1.995=-0.190
max2.017-2.235=-0.218
iters=5
new-facts=6402
prior-facts=1
mean1541.335-1539.563=1.773
σ6.843-6.814=0.029
min1538.054-1536.329=1.725
max1553.573-1551.748=1.825
mean1618.000-1510.000=108.000
σ0.000
min1618.000-1510.000=108.000
max1618.000-1510.000=108.000
mean2.230-2.310=-0.079
σ0.156-0.241=-0.086
min2.119-2.001=0.118
max2.489-2.650=-0.161
iters=5
new-facts=6402
prior-facts=6402
mean1859.123-1857.329=1.794
σ0.065-0.068=-0.003
min1859.032-1857.240=1.792
max1859.199-1857.408=1.791
mean1763.000-1741.000=22.000
σ178.827-165.366=13.460
min1618.000-1510.000=108.000
max2032.000-1898.000=134.000
mean2.891-3.254=-0.363
σ0.145-0.347=-0.202
min2.777-2.858=-0.081
max3.143-3.617=-0.474

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.228-1.534=-0.305
σ0.363-0.184=0.179
min0.932-1.254=-0.322
max1.843-1.699=0.144

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.190=0.631
σ581.372-581.331=0.041
min158.131-157.523=0.608
max1320.880-1320.187=0.693
mean96.250
σ8.500
min92.000
max109.000
mean1618.000-1510.000=108.000
σ0.000
min1618.000-1510.000=108.000
max1618.000-1510.000=108.000
mean0.533-0.553=-0.020
σ0.538-0.567=-0.030
min0.260-0.266=-0.006
max1.339-1.404=-0.065
policies=20
mean1581.621-1575.552=6.069
σ0.340-0.354=-0.014
min1581.390-1575.312=6.078
max1582.126-1576.079=6.047
mean920.000
σ0.000
min920.000
max920.000
mean1618.000-1510.000=108.000
σ0.000
min1618.000-1510.000=108.000
max1618.000-1510.000=108.000
mean2.608-2.639=-0.030
σ0.014-0.013=0.001
min2.591-2.628=-0.037
max2.623-2.656=-0.032
policies=200
mean15824.268-15763.749=60.519
σ0.067-0.117=-0.051
min15824.218-15763.632=60.586
max15824.366-15763.904=60.461
mean9200.000
σ0.000
min9200.000
max9200.000
mean1618.000-1510.000=108.000
σ0.000
min1618.000-1510.000=108.000
max1618.000-1510.000=108.000
mean26.573-26.593=-0.020
σ0.048-0.070=-0.021
min26.517-26.502=0.015
max26.630-26.666=-0.036