Compare commits

Home / Compare 207601da .. fc98a1a4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.016=0.038
σ0.368-0.370=-0.002
min53.910-53.873=0.038
max55.101-55.069=0.032
mean419.000-415.800=3.200
σ0.000-0.422=-0.422
min419.000-415.000=4.000
max419.000-416.000=3.000
mean0.141-0.139=0.002
σ0.004-0.004=0.000
min0.135-0.135=0.000
max0.148-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean43.393-43.322=0.071
σ0.006-0.007=-0.001
min43.385-43.310=0.075
max43.402-43.333=0.068
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.122-0.123=-0.001
σ0.004-0.004=-0.000
min0.116-0.118=-0.002
max0.128-0.130=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1006.306=0.700
σ1.199-1.175=0.024
min1006.439-1005.766=0.673
max1012.035-1011.234=0.801
mean1055.300-1054.450=0.850
σ309.411-321.905=-12.494
min579.000-577.000=2.000
max1653.000-1635.000=18.000
mean1.534-1.552=-0.018
σ0.081-0.099=-0.017
min1.452-1.471=-0.019
max1.771-1.918=-0.147

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.866=0.018
σ0.003
min0.882-0.864=0.018
max0.887-0.869=0.018
mean1653.000-1635.000=18.000
σ0.000
min1653.000-1635.000=18.000
max1653.000-1635.000=18.000
mean0.416-0.410=0.006
σ0.125-0.123=0.002
min0.342-0.331=0.011
max0.636-0.625=0.011
name=error_case.art
mean2.339-2.337=0.001
σ0.003
min2.337-2.336=0.001
max2.342-2.341=0.001
mean1653.000-1635.000=18.000
σ0.000
min1653.000-1635.000=18.000
max1653.000-1635.000=18.000
mean0.877-0.900=-0.022
σ0.092-0.086=0.006
min0.820-0.845=-0.025
max1.035-1.048=-0.013
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002
min1.522-1.522=0.001
max1.526-1.526=0.001
mean1653.000-1635.000=18.000
σ0.000
min1653.000-1635.000=18.000
max1653.000-1635.000=18.000
mean0.540-0.554=-0.014
σ0.049-0.054=-0.005
min0.504-0.517=-0.013
max0.620-0.642=-0.022
name=nested_use.art
mean2.361-2.360=0.001
σ0.002
min2.360-2.359=0.001
max2.364-2.363=0.001
mean1653.000-1635.000=18.000
σ0.000
min1653.000-1635.000=18.000
max1653.000-1635.000=18.000
mean0.836-0.846=-0.010
σ0.047-0.044=0.003
min0.796-0.808=-0.011
max0.910-0.919=-0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.115=0.724
σ0.023-0.034=-0.012
min964.818-964.086=0.732
max964.876-964.172=0.705
mean1653.000-1635.000=18.000
σ0.000
min1653.000-1635.000=18.000
max1653.000-1635.000=18.000
mean0.826-0.834=-0.008
σ0.038-0.030=0.008
min0.781-0.798=-0.017
max0.873-0.862=0.011
name=cdr_enhanced_4k_loc.art
mean885.512-884.710=0.802
σ0.007-0.007=0.000
min885.504-884.705=0.799
max885.521-884.721=0.800
mean1653.000-1635.000=18.000
σ0.000
min1653.000-1635.000=18.000
max1653.000-1635.000=18.000
mean0.695-0.669=0.026
σ0.051-0.043=0.008
min0.633-0.622=0.011
max0.742-0.714=0.028

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.715=0.002
σ0.002-0.002=0.000
min7.715-7.714=0.002
max7.720-7.719=0.002
mean1653.000-1635.000=18.000
σ0.000
min1653.000-1635.000=18.000
max1653.000-1635.000=18.000
mean3.552-4.253=-0.701
σ0.088-0.086=0.002
min3.369-4.111=-0.742
max3.831-4.585=-0.754
name=record_render_large_syntax_err.art
mean7.665-7.663=0.002
σ0.002
min7.664-7.662=0.002
max7.668-7.666=0.002
mean1653.000-1635.000=18.000
σ0.000
min1653.000-1635.000=18.000
max1653.000-1635.000=18.000
mean3.549-4.226=-0.677
σ0.070-0.102=-0.031
min3.421-4.076=-0.655
max3.812-4.953=-1.141
name=record_render_success.art
mean2.291-2.289=0.001
σ0.002
min2.290-2.289=0.001
max2.294-2.292=0.001
mean1653.000-1635.000=18.000
σ0.000
min1653.000-1635.000=18.000
max1653.000-1635.000=18.000
mean0.539-0.744=-0.204
σ0.013-0.027=-0.014
min0.515-0.701=-0.185
max0.614-0.874=-0.260
name=record_render_syntax_err.art
mean2.166-2.165=0.001
σ0.002
min2.165-2.164=0.001
max2.169-2.168=0.001
mean1653.000-1635.000=18.000
σ0.000
min1653.000-1635.000=18.000
max1653.000-1635.000=18.000
mean0.512-0.695=-0.183
σ0.011-0.014=-0.004
min0.485-0.668=-0.183
max0.559-0.769=-0.210

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.841-296.215=0.626
σ0.248-0.204=0.044
min296.661-296.061=0.599
max297.503-296.736=0.768
mean1902.000-1908.000=-6.000
σ0.000
min1902.000-1908.000=-6.000
max1902.000-1908.000=-6.000
mean0.601-0.601=-0.000
σ0.032-0.042=-0.010
min0.568-0.543=0.025
max0.682-0.710=-0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.824-284.692=2.132
σ0.034-0.036=-0.002
min286.782-284.646=2.136
max286.867-284.730=2.137
mean1653.000-1635.000=18.000
σ0.000
min1653.000-1635.000=18.000
max1653.000-1635.000=18.000
mean0.401-0.395=0.005
σ0.013-0.009=0.004
min0.390-0.385=0.006
max0.419-0.403=0.016
iters=5
new-facts=1
prior-facts=6402
mean1297.226-1295.076=2.150
σ0.074-0.112=-0.038
min1297.143-1294.953=2.190
max1297.327-1295.208=2.119
mean1653.000-1635.000=18.000
σ0.000
min1653.000-1635.000=18.000
max1653.000-1635.000=18.000
mean2.079-1.893=0.186
σ0.065-0.110=-0.045
min2.014-1.758=0.255
max2.174-2.028=0.147
iters=5
new-facts=6402
prior-facts=1
mean1541.396-1539.177=2.219
σ6.823-6.837=-0.014
min1538.199-1535.964=2.236
max1553.598-1551.404=2.194
mean1653.000-1635.000=18.000
σ0.000
min1653.000-1635.000=18.000
max1653.000-1635.000=18.000
mean2.397-2.200=0.198
σ0.175-0.166=0.009
min2.139-2.040=0.098
max2.542-2.400=0.142
iters=5
new-facts=6402
prior-facts=6402
mean1859.117-1856.982=2.134
σ0.063-0.064=-0.001
min1859.040-1856.908=2.132
max1859.193-1857.069=2.124
mean1773.000-1774.400=-1.400
σ123.219-131.986=-8.767
min1653.000-1635.000=18.000
max1902.000-1908.000=-6.000
mean3.080-3.084=-0.004
σ0.264-0.307=-0.043
min2.789-2.845=-0.056
max3.420-3.617=-0.197

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.184-1.222=-0.038
σ0.352-0.380=-0.029
min0.926-0.933=-0.007
max1.763-1.857=-0.094

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-447.784=1.035
σ581.372-581.213=0.159
min158.133-157.174=0.959
max1320.877-1319.604=1.274
mean96.250
σ8.500
min92.000
max109.000
mean1653.000-1635.000=18.000
σ0.000
min1653.000-1635.000=18.000
max1653.000-1635.000=18.000
mean0.537-0.531=0.006
σ0.551-0.542=0.009
min0.259-0.259=0.000
max1.364-1.345=0.019
policies=20
mean1581.609-1572.094=9.515
σ0.357-0.358=-0.001
min1581.369-1571.854=9.515
max1582.140-1572.627=9.513
mean920.000
σ0.000
min920.000
max920.000
mean1653.000-1635.000=18.000
σ0.000
min1653.000-1635.000=18.000
max1653.000-1635.000=18.000
mean2.633-2.629=0.004
σ0.013-0.018=-0.005
min2.620-2.605=0.015
max2.650-2.643=0.007
policies=200
mean15824.211-15728.871=95.341
σ0.147-0.063=0.085
min15824.075-15728.807=95.268
max15824.416-15728.950=95.466
mean9200.000
σ0.000
min9200.000
max9200.000
mean1653.000-1635.000=18.000
σ0.000
min1653.000-1635.000=18.000
max1653.000-1635.000=18.000
mean26.600-26.592=0.008
σ0.039-0.153=-0.113
min26.557-26.472=0.085
max26.645-26.814=-0.169