Compare commits

Home / Compare e60acb5f .. e367ecbd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=0.000
σ0.368-0.367=0.001
min53.912-53.909=0.003
max55.102-55.100=0.003
mean421.000-420.000=1.000
σ0.000
min421.000-420.000=1.000
max421.000-420.000=1.000
mean0.139-0.141=-0.002
σ0.004-0.004=0.000
min0.135-0.138=-0.003
max0.148-0.149=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=-0.000
σ0.006-0.007=-0.001
min43.385-43.385=-0.000
max43.403-43.410=-0.006
mean421.000-420.000=1.000
σ0.000
min421.000-420.000=1.000
max421.000-420.000=1.000
mean0.123-0.123=-0.000
σ0.003-0.004=-0.000
min0.118-0.120=-0.001
max0.129-0.129=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.008-1007.005=0.003
σ1.196-1.201=-0.005
min1006.433-1006.459=-0.026
max1012.020-1012.038=-0.018
mean1056.250-1055.250=1.000
σ307.971-307.841=0.130
min581.000-580.000=1.000
max1648.000-1647.000=1.000
mean1.558-1.551=0.007
σ0.098-0.086=0.012
min1.472-1.418=0.054
max1.814-1.783=0.031

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.000
σ0.003-0.002=0.000
min0.882
max0.887
mean1648.000-1647.000=1.000
σ0.000
min1648.000-1647.000=1.000
max1648.000-1647.000=1.000
mean0.479-0.419=0.061
σ0.168-0.132=0.036
min0.349-0.347=0.003
max0.703-0.654=0.048
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.003=-0.000
min2.337
max2.342-2.342=-0.000
mean1648.000-1647.000=1.000
σ0.000
min1648.000-1647.000=1.000
max1648.000-1647.000=1.000
mean0.895-0.895=0.000
σ0.137-0.104=0.034
min0.808-0.827=-0.019
max1.137-1.076=0.061
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1648.000-1647.000=1.000
σ0.000
min1648.000-1647.000=1.000
max1648.000-1647.000=1.000
mean0.526-0.544=-0.018
σ0.048-0.052=-0.004
min0.484-0.505=-0.021
max0.607-0.632=-0.025
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1648.000-1647.000=1.000
σ0.000
min1648.000-1647.000=1.000
max1648.000-1647.000=1.000
mean0.835-0.890=-0.055
σ0.054-0.060=-0.006
min0.782-0.834=-0.052
max0.926-0.977=-0.051

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.834=0.005
σ0.034-0.030=0.003
min964.811-964.810=0.002
max964.895-964.886=0.009
mean1648.000-1647.000=1.000
σ0.000
min1648.000-1647.000=1.000
max1648.000-1647.000=1.000
mean0.808-0.828=-0.020
σ0.048-0.042=0.006
min0.735-0.760=-0.025
max0.861-0.857=0.005
name=cdr_enhanced_4k_loc.art
mean885.511-885.512=-0.001
σ0.007-0.004=0.003
min885.504-885.505=-0.001
max885.522-885.516=0.006
mean1648.000-1647.000=1.000
σ0.000
min1648.000-1647.000=1.000
max1648.000-1647.000=1.000
mean0.696-0.721=-0.025
σ0.041-0.038=0.003
min0.625-0.654=-0.028
max0.729-0.740=-0.011

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.002
mean1648.000-1647.000=1.000
σ0.000
min1648.000-1647.000=1.000
max1648.000-1647.000=1.000
mean4.215-4.249=-0.033
σ0.097-0.096=0.001
min4.067-4.111=-0.044
max4.736-4.769=-0.033
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.002
mean1648.000-1647.000=1.000
σ0.000
min1648.000-1647.000=1.000
max1648.000-1647.000=1.000
mean4.179-4.209=-0.030
σ0.070-0.068=0.003
min4.060-4.081=-0.021
max4.400-4.443=-0.043
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1648.000-1647.000=1.000
σ0.000
min1648.000-1647.000=1.000
max1648.000-1647.000=1.000
mean0.740-0.744=-0.005
σ0.016-0.017=-0.000
min0.704-0.716=-0.012
max0.841-0.851=-0.010
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1648.000-1647.000=1.000
σ0.000
min1648.000-1647.000=1.000
max1648.000-1647.000=1.000
mean0.694-0.701=-0.006
σ0.014-0.019=-0.005
min0.664-0.662=0.002
max0.755-0.795=-0.040

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.956-297.003=-0.047
σ0.201-0.258=-0.057
min296.758-296.849=-0.091
max297.430-297.709=-0.279
mean1956.000-1904.000=52.000
σ0.000
min1956.000-1904.000=52.000
max1956.000-1904.000=52.000
mean0.582-0.591=-0.009
σ0.040-0.039=0.001
min0.504-0.539=-0.035
max0.657-0.679=-0.022

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.819-286.828=-0.009
σ0.037-0.038=-0.001
min286.765-286.781=-0.016
max286.857-286.873=-0.016
mean1648.000-1647.000=1.000
σ0.000
min1648.000-1647.000=1.000
max1648.000-1647.000=1.000
mean0.393-0.401=-0.007
σ0.006-0.009=-0.003
min0.388-0.391=-0.003
max0.402-0.412=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1297.281-1297.273=0.009
σ0.082-0.081=0.000
min1297.190-1297.197=-0.007
max1297.401-1297.388=0.013
mean1648.000-1647.000=1.000
σ0.000
min1648.000-1647.000=1.000
max1648.000-1647.000=1.000
mean2.230-2.198=0.032
σ0.050-0.080=-0.030
min2.159-2.067=0.092
max2.299-2.261=0.037
iters=5
new-facts=6402
prior-facts=1
mean1541.323-1541.337=-0.014
σ6.823-6.833=-0.010
min1538.092-1538.121=-0.030
max1553.525-1553.558=-0.033
mean1648.000-1647.000=1.000
σ0.000
min1648.000-1647.000=1.000
max1648.000-1647.000=1.000
mean2.195-2.221=-0.026
σ0.100-0.132=-0.032
min2.098-2.112=-0.014
max2.337-2.393=-0.055
iters=5
new-facts=6402
prior-facts=6402
mean1859.116-1859.112=0.003
σ0.066-0.067=-0.001
min1859.032-1859.033=-0.000
max1859.189-1859.193=-0.003
mean1796.200-1781.000=15.200
σ154.545-125.178=29.367
min1648.000-1647.000=1.000
max1956.000-1904.000=52.000
mean3.028-3.097=-0.069
σ0.167-0.321=-0.153
min2.858-2.754=0.104
max3.250-3.532=-0.281

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.244-1.293=-0.049
σ0.304-0.316=-0.012
min0.936-0.938=-0.002
max1.602-1.745=-0.143

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.821=-0.001
σ581.372-581.371=0.001
min158.132-158.133=-0.001
max1320.878-1320.877=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1648.000-1647.000=1.000
σ0.000
min1648.000-1647.000=1.000
max1648.000-1647.000=1.000
mean0.535-0.552=-0.017
σ0.545-0.579=-0.034
min0.261-0.260=0.001
max1.353-1.420=-0.067
policies=20
mean1581.608-1581.616=-0.008
σ0.357-0.338=0.019
min1581.368-1581.388=-0.020
max1582.139-1582.119=0.020
mean920.000
σ0.000
min920.000
max920.000
mean1648.000-1647.000=1.000
σ0.000
min1648.000-1647.000=1.000
max1648.000-1647.000=1.000
mean2.634-2.634=0.000
σ0.007-0.013=-0.006
min2.624-2.621=0.003
max2.639-2.649=-0.010
policies=200
mean15824.062-15824.167=-0.105
σ0.124-0.102=0.022
min15823.961-15824.034=-0.073
max15824.226-15824.260=-0.035
mean9200.000
σ0.000
min9200.000
max9200.000
mean1648.000-1647.000=1.000
σ0.000
min1648.000-1647.000=1.000
max1648.000-1647.000=1.000
mean26.665-26.706=-0.040
σ0.043-0.117=-0.074
min26.630-26.616=0.014
max26.727-26.868=-0.140