Compare commits

Home / Compare 24255eab .. 061daa62

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.054=0.001
σ0.370-0.370=0.000
min53.906-53.908=-0.002
max55.107-55.106=0.001
mean417.000
σ0.000
min417.000
max417.000
mean0.141-0.141=-0.000
σ0.004-0.005=-0.000
min0.133-0.137=-0.003
max0.147-0.149=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.392-43.393=-0.000
σ0.007-0.008=-0.001
min43.383-43.382=0.001
max43.406-43.409=-0.003
mean417.000
σ0.000
min417.000
max417.000
mean0.122-0.121=0.001
σ0.004-0.004=0.000
min0.116-0.115=0.000
max0.131-0.127=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.002-1007.000=0.001
σ1.209-1.225=-0.016
min1006.435-1006.465=-0.030
max1012.079-1012.141=-0.062
mean1051.150-1045.800=5.350
σ305.534-304.331=1.203
min578.000-577.000=1.000
max1644.000-1660.000=-16.000
mean1.549-1.571=-0.022
σ0.069-0.105=-0.036
min1.481-1.471=0.010
max1.715-1.808=-0.093

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1644.000-1660.000=-16.000
σ0.000
min1644.000-1660.000=-16.000
max1644.000-1660.000=-16.000
mean0.415-0.411=0.004
σ0.113-0.111=0.002
min0.338-0.345=-0.008
max0.613-0.607=0.006
name=error_case.art
mean2.339-2.339=-0.000
σ0.003-0.003=-0.000
min2.337
max2.342
mean1644.000-1660.000=-16.000
σ0.000
min1644.000-1660.000=-16.000
max1644.000-1660.000=-16.000
mean0.880-0.881=-0.002
σ0.093-0.100=-0.007
min0.807-0.819=-0.012
max1.042-1.058=-0.016
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1644.000-1660.000=-16.000
σ0.000
min1644.000-1660.000=-16.000
max1644.000-1660.000=-16.000
mean0.533-0.532=0.001
σ0.046-0.048=-0.002
min0.498-0.491=0.008
max0.611-0.610=0.000
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1644.000-1660.000=-16.000
σ0.000
min1644.000-1660.000=-16.000
max1644.000-1660.000=-16.000
mean0.850-0.878=-0.028
σ0.039-0.068=-0.029
min0.807-0.813=-0.006
max0.912-0.975=-0.063

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.840=-0.005
σ0.031-0.034=-0.003
min964.811-964.811=-0.001
max964.890-964.894=-0.004
mean1644.000-1660.000=-16.000
σ0.000
min1644.000-1660.000=-16.000
max1644.000-1660.000=-16.000
mean0.814-0.852=-0.039
σ0.056-0.006=0.051
min0.722-0.845=-0.123
max0.855-0.860=-0.005
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.008-0.007=0.001
min885.504-885.505=-0.001
max885.523-885.522=0.001
mean1644.000-1660.000=-16.000
σ0.000
min1644.000-1660.000=-16.000
max1644.000-1660.000=-16.000
mean0.723-0.728=-0.005
σ0.029-0.025=0.004
min0.671-0.683=-0.012
max0.738-0.742=-0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.719=0.001
mean1644.000-1660.000=-16.000
σ0.000
min1644.000-1660.000=-16.000
max1644.000-1660.000=-16.000
mean4.203-4.224=-0.021
σ0.076-0.091=-0.015
min4.089-3.782=0.308
max4.509-4.588=-0.079
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.670=-0.003
mean1644.000-1660.000=-16.000
σ0.000
min1644.000-1660.000=-16.000
max1644.000-1660.000=-16.000
mean4.200-4.221=-0.021
σ0.076-0.124=-0.048
min4.087-4.087=-0.001
max4.474-5.183=-0.710
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1644.000-1660.000=-16.000
σ0.000
min1644.000-1660.000=-16.000
max1644.000-1660.000=-16.000
mean0.735-0.735=0.001
σ0.018-0.019=-0.001
min0.708-0.700=0.008
max0.859-0.850=0.009
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1644.000-1660.000=-16.000
σ0.000
min1644.000-1660.000=-16.000
max1644.000-1660.000=-16.000
mean0.689-0.691=-0.002
σ0.025-0.025=-0.000
min0.508-0.483=0.025
max0.791-0.768=0.023

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.949-297.037=-0.088
σ0.210-0.229=-0.019
min296.801-296.888=-0.087
max297.515-297.673=-0.158
mean1900.000-1952.000=-52.000
σ0.000
min1900.000-1952.000=-52.000
max1900.000-1952.000=-52.000
mean0.576-0.568=0.007
σ0.043-0.033=0.010
min0.509-0.511=-0.002
max0.648-0.602=0.046

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.819-286.823=-0.004
σ0.036-0.036=0.000
min286.774-286.777=-0.003
max286.862-286.861=0.002
mean1644.000-1660.000=-16.000
σ0.000
min1644.000-1660.000=-16.000
max1644.000-1660.000=-16.000
mean0.407-0.395=0.012
σ0.019-0.007=0.012
min0.389-0.389=0.000
max0.434-0.403=0.031
iters=5
new-facts=1
prior-facts=6402
mean1297.262-1297.256=0.006
σ0.080-0.111=-0.031
min1297.160-1297.100=0.060
max1297.366-1297.396=-0.030
mean1644.000-1660.000=-16.000
σ0.000
min1644.000-1660.000=-16.000
max1644.000-1660.000=-16.000
mean2.351-2.287=0.065
σ0.189-0.230=-0.041
min2.111-2.093=0.019
max2.532-2.660=-0.128
iters=5
new-facts=6402
prior-facts=1
mean1541.406-1541.348=0.058
σ6.817-6.840=-0.023
min1538.236-1538.090=0.146
max1553.598-1553.580=0.018
mean1644.000-1660.000=-16.000
σ0.000
min1644.000-1660.000=-16.000
max1644.000-1660.000=-16.000
mean2.423-2.280=0.144
σ0.198-0.180=0.018
min2.203-2.124=0.079
max2.650-2.527=0.124
iters=5
new-facts=6402
prior-facts=6402
mean1859.113-1859.112=0.000
σ0.063-0.065=-0.002
min1859.025-1859.020=0.006
max1859.184-1859.186=-0.002
mean1769.800-1770.400=-0.600
σ124.901-120.544=4.357
min1644.000-1660.000=-16.000
max1900.000-1952.000=-52.000
mean3.122-2.965=0.157
σ0.244-0.103=0.141
min2.951-2.861=0.090
max3.548-3.087=0.461

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.313-1.197=0.116
σ0.356-0.142=0.214
min0.946-1.021=-0.075
max1.805-1.346=0.459

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.821=0.001
σ581.372-581.372=-0.001
min158.134-158.134=0.000
max1320.879-1320.880=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1644.000-1660.000=-16.000
σ0.000
min1644.000-1660.000=-16.000
max1644.000-1660.000=-16.000
mean0.546-0.554=-0.007
σ0.566-0.571=-0.005
min0.262-0.264=-0.002
max1.395-1.410=-0.015
policies=20
mean1581.627-1581.621=0.005
σ0.359-0.359=0.000
min1581.387-1581.385=0.002
max1582.160-1582.155=0.004
mean920.000
σ0.000
min920.000
max920.000
mean1644.000-1660.000=-16.000
σ0.000
min1644.000-1660.000=-16.000
max1644.000-1660.000=-16.000
mean2.643-2.651=-0.008
σ0.015-0.015=0.000
min2.622-2.631=-0.009
max2.659-2.668=-0.008
policies=200
mean15824.255-15824.170=0.085
σ0.119-0.184=-0.065
min15824.161-15823.996=0.165
max15824.409-15824.424=-0.016
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000-1660.000=-16.000
σ0.000
min1644.000-1660.000=-16.000
max1644.000-1660.000=-16.000
mean26.646-26.668=-0.022
σ0.079-0.054=0.025
min26.548-26.599=-0.051
max26.742-26.718=0.024