Compare commits

Home / Compare bf5ffa27 .. c4999213

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.015=0.039
σ0.371-0.371=-0.000
min53.908-53.868=0.039
max55.108-55.069=0.039
mean414.000-415.700=-1.700
σ0.000-0.483=-0.483
min414.000-415.000=-1.000
max414.000-416.000=-2.000
mean0.139-0.137=0.001
σ0.006-0.006=0.001
min0.130-0.129=0.001
max0.147-0.148=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.393-43.322=0.071
σ0.006-0.005=0.001
min43.386-43.315=0.071
max43.401-43.330=0.071
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.123-0.122=0.001
σ0.004-0.004=-0.000
min0.119-0.118=0.001
max0.128-0.129=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.006-1006.312=0.694
σ1.189-1.164=0.024
min1006.434-1005.744=0.690
max1011.987-1011.181=0.805
mean1055.100-1049.350=5.750
σ314.791-303.784=11.007
min585.000-597.000=-12.000
max1618.000-1640.000=-22.000
mean1.530-1.556=-0.026
σ0.053-0.091=-0.038
min1.459-1.454=0.005
max1.631-1.837=-0.206

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.866=0.018
σ0.003
min0.882-0.864=0.018
max0.887-0.869=0.018
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean0.447-0.414=0.034
σ0.147-0.166=-0.019
min0.362-0.311=0.052
max0.705-0.706=-0.002
name=error_case.art
mean2.339-2.337=0.001
σ0.003
min2.337-2.336=0.001
max2.342-2.341=0.001
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean0.940-0.924=0.016
σ0.214-0.164=0.050
min0.827-0.831=-0.004
max1.322-1.217=0.106
name=heavy_item.art
mean1.524-1.523=0.000
σ0.002-0.002=0.000
min1.522-1.522=0.001
max1.526-1.526=0.001
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean0.554-0.534=0.020
σ0.057-0.049=0.008
min0.487-0.489=-0.002
max0.615-0.613=0.002
name=nested_use.art
mean2.361-2.361=0.000
σ0.002-0.003=-0.001
min2.360-2.359=0.001
max2.364-2.365=-0.001
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean0.868-0.844=0.024
σ0.039-0.033=0.005
min0.843-0.816=0.027
max0.936-0.897=0.039

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.112=0.728
σ0.035-0.022=0.013
min964.810-964.090=0.720
max964.898-964.145=0.752
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean0.810-0.810=-0.000
σ0.060-0.043=0.017
min0.727-0.739=-0.011
max0.861-0.850=0.011
name=cdr_enhanced_4k_loc.art
mean885.513-884.713=0.800
σ0.008-0.001=0.007
min885.506-884.712=0.794
max885.525-884.714=0.811
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean0.696-0.708=-0.012
σ0.039-0.036=0.003
min0.648-0.666=-0.019
max0.751-0.739=0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.715=0.002
σ0.002-0.002=0.000
min7.715-7.714=0.002
max7.720-7.719=0.002
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean4.281-4.277=0.003
σ0.080-0.090=-0.010
min4.132-4.134=-0.002
max4.671-4.695=-0.025
name=record_render_large_syntax_err.art
mean7.665-7.663=0.002
σ0.002-0.002=-0.000
min7.664-7.662=0.002
max7.668-7.666=0.002
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean4.262-4.246=0.016
σ0.117-0.071=0.046
min4.096-4.133=-0.037
max5.012-4.539=0.473
name=record_render_success.art
mean2.291-2.289=0.001
σ0.002
min2.290-2.289=0.001
max2.294-2.292=0.001
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean0.750-0.732=0.017
σ0.017-0.017=0.001
min0.711-0.705=0.007
max0.863-0.834=0.029
name=record_render_syntax_err.art
mean2.166-2.165=0.001
σ0.002
min2.165-2.164=0.001
max2.169-2.168=0.001
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean0.703-0.691=0.012
σ0.015-0.017=-0.002
min0.674-0.649=0.025
max0.780-0.780=-0.000

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.935-296.193=0.743
σ0.246-0.190=0.056
min296.719-296.010=0.709
max297.559-296.705=0.854
mean2032.000-1906.000=126.000
σ0.000
min2032.000-1906.000=126.000
max2032.000-1906.000=126.000
mean0.577-0.594=-0.017
σ0.020-0.035=-0.014
min0.537-0.550=-0.013
max0.595-0.680=-0.085

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.818-284.693=2.126
σ0.039-0.038=0.001
min286.767-284.642=2.125
max286.858-284.736=2.122
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean0.396-0.395=0.000
σ0.005-0.011=-0.005
min0.388-0.383=0.005
max0.400-0.407=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1297.211-1295.074=2.137
σ0.121-0.109=0.012
min1297.088-1294.963=2.125
max1297.363-1295.207=2.156
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean1.879-1.915=-0.036
σ0.094-0.100=-0.006
min1.804-1.798=0.006
max2.017-2.020=-0.003
iters=5
new-facts=6402
prior-facts=1
mean1541.335-1539.186=2.149
σ6.843-6.840=0.003
min1538.054-1535.924=2.130
max1553.573-1551.419=2.154
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean2.230-2.240=-0.010
σ0.156-0.263=-0.107
min2.119-2.040=0.079
max2.489-2.666=-0.177
iters=5
new-facts=6402
prior-facts=6402
mean1859.123-1856.980=2.143
σ0.065-0.063=0.002
min1859.032-1856.907=2.126
max1859.199-1857.069=2.129
mean1763.000-1773.200=-10.200
σ178.827-130.433=48.394
min1618.000-1640.000=-22.000
max2032.000-1906.000=126.000
mean2.891-3.061=-0.170
σ0.145-0.289=-0.143
min2.777-2.851=-0.074
max3.143-3.566=-0.423

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.228-1.137=0.091
σ0.363-0.254=0.109
min0.932-0.936=-0.004
max1.843-1.526=0.316

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-447.785=1.036
σ581.372-581.212=0.161
min158.131-157.177=0.953
max1320.880-1319.603=1.277
mean96.250
σ8.500
min92.000
max109.000
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean0.533-0.535=-0.003
σ0.538-0.549=-0.011
min0.260-0.258=0.002
max1.339-1.359=-0.020
policies=20
mean1581.621-1572.103=9.518
σ0.340-0.355=-0.015
min1581.390-1571.867=9.523
max1582.126-1572.631=9.495
mean920.000
σ0.000
min920.000
max920.000
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean2.608-2.629=-0.021
σ0.014-0.024=-0.010
min2.591-2.607=-0.016
max2.623-2.655=-0.031
policies=200
mean15824.268-15728.972=95.297
σ0.067-0.076=-0.010
min15824.218-15728.902=95.316
max15824.366-15729.050=95.316
mean9200.000
σ0.000
min9200.000
max9200.000
mean1618.000-1640.000=-22.000
σ0.000
min1618.000-1640.000=-22.000
max1618.000-1640.000=-22.000
mean26.573-26.535=0.038
σ0.048-0.082=-0.033
min26.517-26.470=0.048
max26.630-26.654=-0.024