Compare commits

Home / Compare c71c7317 .. e32a1ad4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.972-53.974=-0.001
σ0.369-0.367=0.002
min53.830-53.833=-0.003
max55.022-55.018=0.003
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.139-0.149=-0.009
σ0.006-0.011=-0.005
min0.131-0.137=-0.005
max0.147-0.167=-0.019
cache=y
dps=1
iters=10
policies=100
mean43.342-43.342=0.000
σ0.007-0.007=-0.000
min43.331-43.331=-0.000
max43.356-43.357=-0.001
mean415.000-418.000=-3.000
σ0.000
min415.000-418.000=-3.000
max415.000-418.000=-3.000
mean0.123-0.122=0.001
σ0.004-0.004=0.000
min0.117-0.119=-0.001
max0.128-0.127=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.897-1016.897=0.000
σ1.148-1.182=-0.034
min1016.321-1016.331=-0.011
max1021.697-1021.851=-0.154
mean1061.450-1064.100=-2.650
σ317.596-318.055=-0.459
min602.000-604.000=-2.000
max1627.000-1635.000=-8.000
mean1.578-1.583=-0.005
σ0.099-0.088=0.010
min1.485-1.503=-0.018
max1.830-1.854=-0.024

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.865-0.866=-0.001
σ0.002-0.002=-0.000
min0.864
max0.868
mean1627.000-1635.000=-8.000
σ0.000
min1627.000-1635.000=-8.000
max1627.000-1635.000=-8.000
mean0.349-0.289=0.061
σ0.032-0.079=-0.047
min0.326-0.242=0.084
max0.404-0.429=-0.024
name=error_case.art
mean2.336-2.336=-0.000
σ0.004-0.003=0.001
min2.333
max2.341-2.339=0.002
mean1627.000-1635.000=-8.000
σ0.000
min1627.000-1635.000=-8.000
max1627.000-1635.000=-8.000
mean0.930-0.613=0.318
σ0.156-0.043=0.112
min0.837-0.584=0.253
max1.205-0.689=0.516
name=heavy_item.art
mean1.521-1.521=0.001
σ0.002-0.000=0.002
min1.521
max1.524-1.521=0.004
mean1627.000-1635.000=-8.000
σ0.000
min1627.000-1635.000=-8.000
max1627.000-1635.000=-8.000
mean0.539-0.395=0.143
σ0.038-0.027=0.012
min0.500-0.362=0.138
max0.601-0.431=0.170
name=nested_use.art
mean2.358-2.357=0.001
σ0.002-0.000=0.002
min2.357
max2.361-2.357=0.004
mean1627.000-1635.000=-8.000
σ0.000
min1627.000-1635.000=-8.000
max1627.000-1635.000=-8.000
mean0.850-0.595=0.255
σ0.042-0.024=0.017
min0.818-0.573=0.246
max0.922-0.633=0.289

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean961.167-961.185=-0.018
σ0.009-0.039=-0.030
min961.156-961.155=0.001
max961.178-961.252=-0.074
mean1627.000-1635.000=-8.000
σ0.000
min1627.000-1635.000=-8.000
max1627.000-1635.000=-8.000
mean0.830-0.787=0.043
σ0.017-0.041=-0.025
min0.802-0.737=0.065
max0.844-0.843=0.002
name=cdr_enhanced_4k_loc.art
mean882.545-882.518=0.027
σ0.040-0.007=0.033
min882.519-882.510=0.009
max882.613-882.524=0.089
mean1627.000-1635.000=-8.000
σ0.000
min1627.000-1635.000=-8.000
max1627.000-1635.000=-8.000
mean0.735-0.731=0.004
σ0.005-0.005=-0.000
min0.730-0.724=0.006
max0.742-0.736=0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.685-7.685=-0.000
σ0.002-0.002=-0.000
min7.684
max7.688-7.692=-0.004
mean1627.000-1635.000=-8.000
σ0.000
min1627.000-1635.000=-8.000
max1627.000-1635.000=-8.000
mean4.142-4.198=-0.056
σ0.100-0.111=-0.011
min3.442-4.062=-0.620
max4.348-4.863=-0.515
name=record_render_large_syntax_err.art
mean7.634-7.634=0.000
σ0.002-0.002=-0.000
min7.633
max7.638-7.640=-0.001
mean1627.000-1635.000=-8.000
σ0.000
min1627.000-1635.000=-8.000
max1627.000-1635.000=-8.000
mean4.157-3.463=0.693
σ0.084-0.089=-0.005
min4.002-2.923=1.078
max4.394-3.676=0.718
name=record_render_success.art
mean2.281-2.281=-0.000
σ0.002-0.002=-0.000
min2.280
max2.284
mean1627.000-1635.000=-8.000
σ0.000
min1627.000-1635.000=-8.000
max1627.000-1635.000=-8.000
mean0.713-0.533=0.180
σ0.063-0.018=0.045
min0.516-0.450=0.066
max0.818-0.620=0.198
name=record_render_syntax_err.art
mean2.156-2.157=-0.000
σ0.002-0.002=-0.000
min2.156
max2.160-2.161=-0.002
mean1627.000-1635.000=-8.000
σ0.000
min1627.000-1635.000=-8.000
max1627.000-1635.000=-8.000
mean0.694-0.565=0.129
σ0.020-0.093=-0.073
min0.661-0.481=0.181
max0.820-0.812=0.008

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.028-302.100=-0.072
σ0.204-0.226=-0.022
min301.851-301.944=-0.093
max302.574-302.715=-0.142
mean2050.000-2036.000=14.000
σ0.000
min2050.000-2036.000=14.000
max2050.000-2036.000=14.000
mean0.594-0.599=-0.005
σ0.016-0.007=0.009
min0.550-0.582=-0.031
max0.606-0.605=0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.512-303.528=-0.016
σ0.050-0.046=0.004
min303.435-303.456=-0.021
max303.564-303.577=-0.012
mean1627.000-1635.000=-8.000
σ0.000
min1627.000-1635.000=-8.000
max1627.000-1635.000=-8.000
mean0.390-0.395=-0.005
σ0.001-0.008=-0.006
min0.389-0.391=-0.003
max0.392-0.409=-0.016
iters=5
new-facts=1
prior-facts=6402
mean1326.058-1326.062=-0.004
σ0.108-0.114=-0.006
min1325.922-1325.923=-0.001
max1326.193-1326.206=-0.012
mean1627.000-1635.000=-8.000
σ0.000
min1627.000-1635.000=-8.000
max1627.000-1635.000=-8.000
mean1.933-1.899=0.035
σ0.097-0.074=0.023
min1.830-1.816=0.014
max2.047-1.989=0.058
iters=5
new-facts=6402
prior-facts=1
mean1564.101-1564.097=0.004
σ6.892-6.901=-0.009
min1560.788-1560.771=0.017
max1576.424-1576.436=-0.012
mean1627.000-1635.000=-8.000
σ0.000
min1627.000-1635.000=-8.000
max1627.000-1635.000=-8.000
mean2.247-2.237=0.009
σ0.181-0.177=0.004
min2.062-2.054=0.008
max2.487-2.509=-0.022
iters=5
new-facts=6402
prior-facts=6402
mean1894.006-1894.015=-0.009
σ0.078-0.086=-0.008
min1893.870-1893.870=0.000
max1894.063-1894.096=-0.033
mean1792.000-1772.200=19.800
σ185.104-167.934=17.170
min1627.000-1635.000=-8.000
max2050.000-2036.000=14.000
mean3.073-3.007=0.066
σ0.128-0.198=-0.070
min2.887-2.877=0.010
max3.221-3.340=-0.119

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.188-1.207=-0.019
σ0.380-0.286=0.094
min0.909-0.912=-0.003
max1.824-1.523=0.300

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.683-444.685=-0.002
σ575.126-575.126=0.000
min157.119-157.120=-0.001
max1307.372-1307.373=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1627.000-1635.000=-8.000
σ0.000
min1627.000-1635.000=-8.000
max1627.000-1635.000=-8.000
mean0.547-0.534=0.013
σ0.564-0.542=0.022
min0.262-0.260=0.002
max1.394-1.347=0.046
policies=20
mean1571.518-1571.527=-0.010
σ0.359-0.344=0.015
min1571.280-1571.299=-0.019
max1572.052-1572.040=0.012
mean920.000
σ0.000
min920.000
max920.000
mean1627.000-1635.000=-8.000
σ0.000
min1627.000-1635.000=-8.000
max1627.000-1635.000=-8.000
mean2.633-2.613=0.019
σ0.041-0.023=0.018
min2.606-2.580=0.026
max2.693-2.631=0.062
policies=200
mean15723.191-15723.316=-0.125
σ0.095-0.011=0.084
min15723.122-15723.306=-0.184
max15723.331-15723.330=0.001
mean9200.000
σ0.000
min9200.000
max9200.000
mean1627.000-1635.000=-8.000
σ0.000
min1627.000-1635.000=-8.000
max1627.000-1635.000=-8.000
mean26.411-26.459=-0.048
σ0.092-0.011=0.081
min26.310-26.449=-0.139
max26.530-26.469=0.060