Compare commits

Home / Compare ff802fa6 .. 1268cee9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.964-53.969=-0.005
σ0.370-0.371=-0.001
min53.825-53.836=-0.011
max55.016-55.025=-0.009
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.138-0.152=-0.014
σ0.003-0.012=-0.009
min0.136-0.137=-0.001
max0.145-0.172=-0.027
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.001
σ0.006-0.005=0.000
min43.318-43.316=0.002
max43.336-43.334=0.003
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.121-0.121=0.000
σ0.003-0.002=0.001
min0.119-0.119=0.001
max0.128-0.125=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.518-1006.516=0.001
σ1.164-1.169=-0.005
min1005.951-1005.948=0.003
max1011.391-1011.412=-0.021
mean1045.050-1055.150=-10.100
σ312.723-315.496=-2.774
min596.000-568.000=28.000
max1641.000-1616.000=25.000
mean1.555-1.537=0.017
σ0.077-0.046=0.031
min1.484-1.479=0.005
max1.794-1.651=0.143

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.000
σ0.003-0.003=0.000
min0.882
max0.887-0.887=0.000
mean1641.000-1616.000=25.000
σ0.000
min1641.000-1616.000=25.000
max1641.000-1616.000=25.000
mean0.434-0.443=-0.009
σ0.173-0.191=-0.017
min0.346-0.332=0.015
max0.743-0.783=-0.039
name=error_case.art
mean2.340-2.339=0.001
σ0.004-0.003=0.001
min2.337
max2.345-2.342=0.002
mean1641.000-1616.000=25.000
σ0.000
min1641.000-1616.000=25.000
max1641.000-1616.000=25.000
mean0.896-0.943=-0.047
σ0.146-0.174=-0.028
min0.794-0.826=-0.032
max1.151-1.248=-0.097
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1641.000-1616.000=25.000
σ0.000
min1641.000-1616.000=25.000
max1641.000-1616.000=25.000
mean0.537-0.536=0.001
σ0.041-0.051=-0.010
min0.509-0.486=0.023
max0.606-0.618=-0.012
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1641.000-1616.000=25.000
σ0.000
min1641.000-1616.000=25.000
max1641.000-1616.000=25.000
mean0.854-0.863=-0.010
σ0.043-0.037=0.006
min0.808-0.819=-0.011
max0.924-0.904=0.020

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.837-964.839=-0.002
σ0.020-0.032=-0.013
min964.818-964.812=0.006
max964.869-964.893=-0.023
mean1641.000-1616.000=25.000
σ0.000
min1641.000-1616.000=25.000
max1641.000-1616.000=25.000
mean0.820-0.838=-0.019
σ0.052-0.019=0.033
min0.732-0.818=-0.085
max0.864-0.858=0.007
name=cdr_enhanced_4k_loc.art
mean885.514-885.511=0.002
σ0.006-0.007=-0.000
min885.504
max885.522-885.520=0.002
mean1641.000-1616.000=25.000
σ0.000
min1641.000-1616.000=25.000
max1641.000-1616.000=25.000
mean0.741-0.699=0.042
σ0.016-0.035=-0.020
min0.725-0.666=0.059
max0.758-0.740=0.018

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.720=0.000
mean1641.000-1616.000=25.000
σ0.000
min1641.000-1616.000=25.000
max1641.000-1616.000=25.000
mean4.264-4.206=0.058
σ0.090-0.073=0.018
min4.127-4.067=0.059
max4.574-4.502=0.072
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1641.000-1616.000=25.000
σ0.000
min1641.000-1616.000=25.000
max1641.000-1616.000=25.000
mean4.245-4.201=0.044
σ0.068-0.066=0.002
min4.113-4.059=0.054
max4.480-4.457=0.023
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1641.000-1616.000=25.000
σ0.000
min1641.000-1616.000=25.000
max1641.000-1616.000=25.000
mean0.737-0.746=-0.010
σ0.018-0.019=-0.001
min0.706-0.710=-0.004
max0.860-0.864=-0.004
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1641.000-1616.000=25.000
σ0.000
min1641.000-1616.000=25.000
max1641.000-1616.000=25.000
mean0.703-0.706=-0.004
σ0.016-0.015=0.001
min0.671-0.678=-0.007
max0.792-0.782=0.010

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.248-296.349=-0.101
σ0.216-0.225=-0.010
min296.125-296.163=-0.038
max296.847-296.946=-0.099
mean2022.000-2031.000=-9.000
σ0.000
min2022.000-2031.000=-9.000
max2022.000-2031.000=-9.000
mean0.567-0.557=0.010
σ0.023-0.036=-0.013
min0.519-0.503=0.016
max0.582-0.596=-0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.033-285.029=0.004
σ0.027-0.038=-0.011
min285.005-284.976=0.029
max285.067-285.066=0.000
mean1641.000-1616.000=25.000
σ0.000
min1641.000-1616.000=25.000
max1641.000-1616.000=25.000
mean0.396-0.395=0.001
σ0.006-0.009=-0.003
min0.388-0.388=0.001
max0.404-0.409=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.376-1295.426=-0.050
σ0.080-0.118=-0.038
min1295.295-1295.296=-0.001
max1295.500-1295.585=-0.085
mean1641.000-1616.000=25.000
σ0.000
min1641.000-1616.000=25.000
max1641.000-1616.000=25.000
mean1.930-1.887=0.042
σ0.195-0.094=0.101
min1.788-1.800=-0.012
max2.222-2.027=0.195
iters=5
new-facts=6402
prior-facts=1
mean1539.575-1539.517=0.057
σ6.791-6.828=-0.037
min1536.412-1536.208=0.205
max1551.721-1551.726=-0.006
mean1641.000-1616.000=25.000
σ0.000
min1641.000-1616.000=25.000
max1641.000-1616.000=25.000
mean2.288-2.276=0.012
σ0.170-0.233=-0.062
min2.133-2.053=0.080
max2.566-2.624=-0.058
iters=5
new-facts=6402
prior-facts=6402
mean1857.327-1857.326=0.001
σ0.053-0.054=-0.002
min1857.265-1857.256=0.010
max1857.395-1857.399=-0.004
mean1771.600-1765.000=6.600
σ167.864-180.837=-12.973
min1641.000-1616.000=25.000
max2022.000-2031.000=-9.000
mean2.890-2.880=0.009
σ0.051-0.064=-0.013
min2.838-2.824=0.013
max2.948-2.959=-0.011

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.152-1.246=-0.094
σ0.267-0.364=-0.097
min0.962-0.939=0.022
max1.624-1.864=-0.240

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.195-448.193=0.002
σ581.341-581.341=0.000
min157.521-157.519=0.002
max1320.207-1320.205=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1641.000-1616.000=25.000
σ0.000
min1641.000-1616.000=25.000
max1641.000-1616.000=25.000
mean0.534-0.538=-0.004
σ0.544-0.552=-0.008
min0.261-0.260=0.001
max1.350-1.366=-0.016
policies=20
mean1575.575-1575.556=0.019
σ0.364-0.365=-0.000
min1575.328-1575.310=0.018
max1576.116-1576.098=0.018
mean920.000
σ0.000
min920.000
max920.000
mean1641.000-1616.000=25.000
σ0.000
min1641.000-1616.000=25.000
max1641.000-1616.000=25.000
mean2.640-2.645=-0.005
σ0.015-0.018=-0.002
min2.630-2.629=0.002
max2.663-2.662=0.001
policies=200
mean15763.694-15763.682=0.011
σ0.085-0.194=-0.109
min15763.576-15763.528=0.048
max15763.778-15763.964=-0.185
mean9200.000
σ0.000
min9200.000
max9200.000
mean1641.000-1616.000=25.000
σ0.000
min1641.000-1616.000=25.000
max1641.000-1616.000=25.000
mean26.641-26.607=0.034
σ0.129-0.058=0.072
min26.541-26.572=-0.031
max26.830-26.693=0.137