Compare commits

Home / Compare 0df3bf96 .. db90b2c7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.013=0.001
σ0.371-0.369=0.002
min53.878-53.879=-0.001
max55.069-55.063=0.006
mean415.800-417.000=-1.200
σ0.422-0.000=0.422
min415.000-417.000=-2.000
max416.000-417.000=-1.000
mean0.138-0.135=0.004
σ0.005-0.005=0.000
min0.132-0.129=0.003
max0.146-0.142=0.004
cache=y
dps=1
iters=10
policies=100
mean43.321-43.321=0.000
σ0.006-0.007=-0.000
min43.315-43.312=0.003
max43.335-43.337=-0.002
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.121-0.117=0.004
σ0.004-0.003=0.001
min0.115-0.115=0.001
max0.127-0.122=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.310-1006.307=0.003
σ1.166-1.165=0.002
min1005.743-1005.774=-0.030
max1011.191-1011.178=0.013
mean1051.800-1048.400=3.400
σ304.936-313.630=-8.695
min596.000-598.000=-2.000
max1645.000-1646.000=-1.000
mean1.561-1.561=0.000
σ0.089-0.079=0.010
min1.491-1.478=0.013
max1.884-1.786=0.098

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean0.418-0.416=0.002
σ0.141-0.136=0.004
min0.340-0.329=0.011
max0.667-0.657=0.011
name=error_case.art
mean2.338-2.337=0.000
σ0.002-0.003=-0.000
min2.336
max2.341
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean0.893-0.895=-0.002
σ0.108-0.114=-0.006
min0.827-0.828=-0.000
max1.083-1.097=-0.014
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean0.548-0.575=-0.028
σ0.062-0.074=-0.012
min0.493-0.497=-0.004
max0.652-0.673=-0.021
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean0.859-0.861=-0.002
σ0.031-0.045=-0.013
min0.836-0.822=0.014
max0.911-0.930=-0.019

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.113=0.003
σ0.034-0.023=0.012
min964.086-964.092=-0.007
max964.171-964.151=0.020
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean0.845-0.826=0.019
σ0.013-0.031=-0.018
min0.822-0.795=0.027
max0.854-0.864=-0.009
name=cdr_enhanced_4k_loc.art
mean884.712-884.713=-0.001
σ0.006-0.006=0.000
min884.705
max884.720-884.722=-0.002
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean0.733-0.720=0.013
σ0.009-0.014=-0.005
min0.718-0.704=0.014
max0.740-0.738=0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.719-7.719=-0.000
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean4.208-3.504=0.705
σ0.094-0.086=0.007
min3.999-3.368=0.631
max4.700-3.850=0.849
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean4.201-3.660=0.541
σ0.070-0.332=-0.262
min4.069-3.364=0.705
max4.463-4.666=-0.203
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean0.731-0.739=-0.008
σ0.021-0.029=-0.009
min0.701-0.587=0.114
max0.862-0.880=-0.017
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean0.689-0.696=-0.007
σ0.019-0.029=-0.010
min0.587-0.516=0.071
max0.795-0.785=0.010

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.427-296.284=0.143
σ0.197-0.257=-0.061
min296.281-296.071=0.209
max296.971-296.967=0.004
mean1906.000-1905.000=1.000
σ0.000
min1906.000-1905.000=1.000
max1906.000-1905.000=1.000
mean0.574-0.564=0.010
σ0.047-0.043=0.004
min0.507-0.502=0.006
max0.658-0.610=0.048

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.695-284.676=0.018
σ0.031-0.040=-0.009
min284.662-284.639=0.023
max284.730-284.735=-0.006
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean0.391-0.404=-0.013
σ0.008-0.002=0.006
min0.385-0.402=-0.017
max0.405-0.408=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.079-1295.075=0.004
σ0.110-0.102=0.008
min1294.960-1294.961=-0.001
max1295.211-1295.198=0.013
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean1.916-1.926=-0.010
σ0.088-0.094=-0.006
min1.822-1.818=0.003
max2.029-2.034=-0.005
iters=5
new-facts=6402
prior-facts=1
mean1539.190-1539.187=0.003
σ6.837-6.857=-0.020
min1535.944-1535.917=0.027
max1551.417-1551.450=-0.033
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean2.263-2.267=-0.005
σ0.295-0.261=0.033
min2.035-2.060=-0.025
max2.703-2.683=0.019
iters=5
new-facts=6402
prior-facts=6402
mean1856.984-1856.991=-0.007
σ0.050-0.054=-0.004
min1856.946-1856.938=0.007
max1857.060-1857.068=-0.008
mean1776.000-1775.800=0.200
σ129.037-128.280=0.757
min1645.000-1646.000=-1.000
max1906.000-1905.000=1.000
mean3.063-3.003=0.060
σ0.354-0.301=0.053
min2.869-2.683=0.187
max3.693-3.486=0.208

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.195-1.158=0.036
σ0.295-0.304=-0.008
min0.938-0.925=0.013
max1.690-1.644=0.046

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.784=0.003
σ581.212-581.213=-0.001
min157.179-157.174=0.005
max1319.605-1319.603=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean0.539-0.542=-0.003
σ0.555-0.564=-0.009
min0.259-0.259=-0.000
max1.372-1.388=-0.016
policies=20
mean1572.088-1572.086=0.002
σ0.345-0.355=-0.010
min1571.858-1571.850=0.009
max1572.601-1572.614=-0.013
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean2.616-2.624=-0.008
σ0.017-0.013=0.005
min2.594-2.606=-0.012
max2.630-2.634=-0.004
policies=200
mean15729.079-15729.025=0.054
σ0.130-0.074=0.055
min15728.989-15728.930=0.059
max15729.266-15729.106=0.160
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean26.409-26.612=-0.203
σ0.008-0.176=-0.168
min26.402-26.474=-0.072
max26.418-26.855=-0.438