Compare commits

Home / Compare 8d2b06e3 .. 90061216

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.054=0.002
σ0.370-0.369=0.001
min53.917-53.912=0.005
max55.109-55.103=0.006
mean418.700-416.000=2.700
σ0.483-0.000=0.483
min418.000-416.000=2.000
max419.000-416.000=3.000
mean0.140-0.138=0.001
σ0.003-0.005=-0.002
min0.136-0.129=0.007
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.001
σ0.006-0.006=-0.001
min43.385-43.387=-0.003
max43.406-43.407=-0.000
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.122-0.121=0.001
σ0.004-0.004=0.000
min0.119-0.115=0.004
max0.129-0.125=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.929-1007.001=-0.072
σ0.868-1.213=-0.345
min1006.428-1006.447=-0.020
max1010.523-1012.093=-1.570
mean1053.650-1049.700=3.950
σ311.042-307.867=3.175
min557.000-574.000=-17.000
max1652.000-1641.000=11.000
mean1.513-1.552=-0.038
σ0.074-0.080=-0.007
min1.407-1.404=0.003
max1.763-1.781=-0.018

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1652.000-1641.000=11.000
σ0.000
min1652.000-1641.000=11.000
max1652.000-1641.000=11.000
mean0.399-0.415=-0.016
σ0.106-0.142=-0.035
min0.331-0.332=-0.002
max0.587-0.666=-0.079
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1652.000-1641.000=11.000
σ0.000
min1652.000-1641.000=11.000
max1652.000-1641.000=11.000
mean0.877-0.881=-0.004
σ0.102-0.095=0.007
min0.816-0.806=0.010
max1.058-1.045=0.012
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1652.000-1641.000=11.000
σ0.000
min1652.000-1641.000=11.000
max1652.000-1641.000=11.000
mean0.534-0.532=0.002
σ0.050-0.051=-0.000
min0.490-0.480=0.010
max0.619-0.611=0.008
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1652.000-1641.000=11.000
σ0.000
min1652.000-1641.000=11.000
max1652.000-1641.000=11.000
mean0.838-0.855=-0.017
σ0.045-0.042=0.003
min0.815-0.813=0.001
max0.918-0.921=-0.003

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.835=0.005
σ0.029-0.030=-0.001
min964.818-964.809=0.009
max964.888-964.885=0.002
mean1652.000-1641.000=11.000
σ0.000
min1652.000-1641.000=11.000
max1652.000-1641.000=11.000
mean0.844-0.826=0.018
σ0.024-0.036=-0.012
min0.804-0.787=0.017
max0.867-0.869=-0.003
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.007-0.005=0.001
min885.505-885.505=0.000
max885.522-885.517=0.004
mean1652.000-1641.000=11.000
σ0.000
min1652.000-1641.000=11.000
max1652.000-1641.000=11.000
mean0.715-0.740=-0.026
σ0.035-0.011=0.024
min0.676-0.732=-0.057
max0.743-0.760=-0.017

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.723-7.721=0.002
mean1652.000-1641.000=11.000
σ0.000
min1652.000-1641.000=11.000
max1652.000-1641.000=11.000
mean4.269-4.210=0.060
σ0.085-0.081=0.004
min4.114-4.083=0.031
max4.579-4.603=-0.024
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1652.000-1641.000=11.000
σ0.000
min1652.000-1641.000=11.000
max1652.000-1641.000=11.000
mean4.252-4.212=0.039
σ0.078-0.081=-0.003
min4.123-4.073=0.050
max4.553-4.499=0.054
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1652.000-1641.000=11.000
σ0.000
min1652.000-1641.000=11.000
max1652.000-1641.000=11.000
mean0.735-0.678=0.056
σ0.019-0.088=-0.070
min0.702-0.510=0.192
max0.852-0.844=0.008
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1652.000-1641.000=11.000
σ0.000
min1652.000-1641.000=11.000
max1652.000-1641.000=11.000
mean0.703-0.498=0.205
σ0.015-0.042=-0.027
min0.674-0.283=0.390
max0.790-0.652=0.139

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.395-296.933=-1.538
σ0.236-0.232=0.004
min295.247-296.722=-1.475
max296.057-297.552=-1.495
mean1897.000-1938.000=-41.000
σ0.000
min1897.000-1938.000=-41.000
max1897.000-1938.000=-41.000
mean0.575-0.570=0.005
σ0.057-0.052=0.004
min0.506-0.505=0.001
max0.685-0.683=0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.365-286.824=-1.460
σ0.038-0.037=0.000
min285.310-286.774=-1.463
max285.401-286.861=-1.461
mean1652.000-1641.000=11.000
σ0.000
min1652.000-1641.000=11.000
max1652.000-1641.000=11.000
mean0.391-0.394=-0.004
σ0.009-0.005=0.004
min0.381-0.388=-0.007
max0.404-0.401=0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.745-1297.265=-1.520
σ0.113-0.092=0.020
min1295.625-1297.131=-1.505
max1295.883-1297.373=-1.490
mean1652.000-1641.000=11.000
σ0.000
min1652.000-1641.000=11.000
max1652.000-1641.000=11.000
mean1.900-2.282=-0.382
σ0.081-0.139=-0.058
min1.806-2.133=-0.327
max1.975-2.485=-0.510
iters=5
new-facts=6402
prior-facts=1
mean1539.900-1541.389=-1.489
σ6.853-6.841=0.012
min1536.612-1538.210=-1.597
max1552.154-1553.626=-1.472
mean1652.000-1641.000=11.000
σ0.000
min1652.000-1641.000=11.000
max1652.000-1641.000=11.000
mean2.360-2.308=0.052
σ0.233-0.234=-0.001
min2.009-2.147=-0.138
max2.564-2.704=-0.140
iters=5
new-facts=6402
prior-facts=6402
mean1857.657-1859.117=-1.460
σ0.070-0.064=0.006
min1857.570-1859.040=-1.470
max1857.751-1859.200=-1.449
mean1778.200-1786.800=-8.600
σ120.082-147.955=-27.873
min1652.000-1641.000=11.000
max1897.000-1938.000=-41.000
mean2.985-3.059=-0.074
σ0.108-0.184=-0.075
min2.841-2.887=-0.045
max3.086-3.355=-0.269

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.189-1.304=-0.115
σ0.341-0.358=-0.017
min0.930-0.936=-0.006
max1.752-1.828=-0.077

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.634-448.968=-3.333
σ580.934-581.664=-0.730
min155.164-158.134=-2.971
max1317.035-1321.463=-4.428
mean96.250
σ8.500
min92.000
max109.000
mean1652.000-1641.000=11.000
σ0.000
min1652.000-1641.000=11.000
max1652.000-1641.000=11.000
mean0.531-0.551=-0.020
σ0.537-0.580=-0.043
min0.256-0.257=-0.001
max1.337-1.421=-0.085
policies=20
mean1551.945-1581.630=-29.686
σ0.331-0.363=-0.032
min1551.715-1581.386=-29.671
max1552.435-1582.170=-29.736
mean920.000
σ0.000
min920.000
max920.000
mean1652.000-1641.000=11.000
σ0.000
min1652.000-1641.000=11.000
max1652.000-1641.000=11.000
mean2.586-2.642=-0.056
σ0.015-0.012=0.002
min2.568-2.627=-0.058
max2.604-2.656=-0.052
policies=200
mean15527.664-15824.169=-296.505
σ0.091-0.115=-0.024
min15527.588-15824.081=-296.493
max15527.784-15824.327=-296.543
mean9200.000
σ0.000
min9200.000
max9200.000
mean1652.000-1641.000=11.000
σ0.000
min1652.000-1641.000=11.000
max1652.000-1641.000=11.000
mean26.051-26.753=-0.702
σ0.122-0.095=0.027
min25.943-26.670=-0.727
max26.220-26.880=-0.660