Compare commits

Home / Compare d6931451 .. 466251e2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.016-54.014=0.003
σ0.369-0.370=-0.001
min53.874-53.874=-0.001
max55.065-55.065=-0.000
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.141-0.138=0.003
σ0.004-0.004=-0.000
min0.137-0.131=0.005
max0.148-0.146=0.002
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.001
σ0.008-0.007=0.001
min43.312-43.318=-0.006
max43.338-43.341=-0.004
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.122-0.129=-0.007
σ0.004-0.010=-0.006
min0.118-0.119=-0.001
max0.130-0.148=-0.018

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.310-1006.308=0.002
σ1.175-1.177=-0.001
min1005.757-1005.764=-0.008
max1011.236-1011.234=0.002
mean1046.750-1044.950=1.800
σ313.149-313.333=-0.184
min596.000-594.000=2.000
max1643.000
mean1.542-1.552=-0.010
σ0.079-0.071=0.008
min1.463-1.462=0.001
max1.778-1.733=0.045

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.402-0.438=-0.036
σ0.129-0.125=0.004
min0.321-0.349=-0.028
max0.632-0.653=-0.022
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.881-0.909=-0.028
σ0.089-0.166=-0.077
min0.820-0.803=0.016
max1.035-1.203=-0.168
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.540-0.538=0.002
σ0.046-0.054=-0.009
min0.502-0.492=0.010
max0.618-0.630=-0.012
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.828-0.829=-0.001
σ0.042-0.037=0.005
min0.787-0.785=0.002
max0.894-0.888=0.006

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113-964.114=-0.001
σ0.032-0.016=0.015
min964.086-964.097=-0.011
max964.165-964.138=0.027
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.843-0.837=0.006
σ0.019-0.017=0.001
min0.812-0.809=0.003
max0.857-0.852=0.005
name=cdr_enhanced_4k_loc.art
mean884.711-884.713=-0.002
σ0.004-0.002=0.002
min884.705-884.710=-0.006
max884.715-884.715=-0.001
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.706-0.678=0.028
σ0.041-0.039=0.002
min0.659-0.633=0.026
max0.738-0.737=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.714=0.000
σ0.002-0.002=0.000
min7.714
max7.721-7.718=0.004
mean1643.000
σ0.000
min1643.000
max1643.000
mean4.243-4.181=0.063
σ0.094-0.070=0.024
min4.092-4.057=0.035
max4.576-4.483=0.094
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666-7.667=-0.001
mean1643.000
σ0.000
min1643.000
max1643.000
mean4.224-4.170=0.054
σ0.079-0.102=-0.023
min4.096-4.014=0.081
max4.511-4.556=-0.045
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.730-0.732=-0.002
σ0.018-0.033=-0.015
min0.698-0.672=0.026
max0.851-0.930=-0.079
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.694-0.682=0.011
σ0.017-0.033=-0.016
min0.665-0.491=0.174
max0.789-0.785=0.004

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.237-296.303=-0.066
σ0.198-0.195=0.003
min296.000-296.143=-0.142
max296.745-296.826=-0.081
mean1973.000-1898.000=75.000
σ0.000
min1973.000-1898.000=75.000
max1973.000-1898.000=75.000
mean0.588-0.585=0.003
σ0.051-0.034=0.017
min0.511-0.537=-0.026
max0.697-0.648=0.049

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.700-284.696=0.003
σ0.029-0.037=-0.008
min284.666-284.647=0.019
max284.736-284.733=0.003
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.397-0.393=0.004
σ0.008-0.009=-0.001
min0.387-0.387=0.000
max0.403-0.408=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.057-1295.069=-0.012
σ0.080-0.097=-0.017
min1294.951-1294.964=-0.013
max1295.152-1295.178=-0.026
mean1643.000
σ0.000
min1643.000
max1643.000
mean1.965-1.899=0.066
σ0.216-0.076=0.139
min1.805-1.814=-0.009
max2.322-1.982=0.340
iters=5
new-facts=6402
prior-facts=1
mean1539.186-1539.206=-0.020
σ6.846-6.828=0.018
min1535.949-1535.952=-0.004
max1551.429-1551.417=0.012
mean1643.000
σ0.000
min1643.000
max1643.000
mean2.308-2.157=0.151
σ0.265-0.156=0.108
min2.011-2.048=-0.037
max2.651-2.429=0.221
iters=5
new-facts=6402
prior-facts=6402
mean1856.998-1856.987=0.011
σ0.065-0.053=0.012
min1856.922-1856.941=-0.019
max1857.061-1857.065=-0.004
mean1799.400-1768.800=30.600
σ166.117-124.642=41.475
min1643.000
max1973.000-1898.000=75.000
mean2.978-3.117=-0.139
σ0.182-0.349=-0.167
min2.831-2.866=-0.035
max3.204-3.733=-0.529

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.256-1.117=0.139
σ0.324-0.190=0.134
min1.050-0.948=0.102
max1.808-1.358=0.450

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.783-447.785=-0.001
σ581.212-581.211=0.001
min157.176-157.176=-0.000
max1319.602-1319.601=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.540-0.542=-0.002
σ0.559-0.570=-0.011
min0.258-0.256=0.002
max1.379-1.397=-0.018
policies=20
mean1572.078-1572.101=-0.023
σ0.359-0.352=0.007
min1571.834-1571.862=-0.028
max1572.611-1572.624=-0.013
mean920.000
σ0.000
min920.000
max920.000
mean1643.000
σ0.000
min1643.000
max1643.000
mean2.622-2.620=0.001
σ0.014-0.021=-0.007
min2.605-2.593=0.012
max2.635-2.643=-0.008
policies=200
mean15729.025-15729.089=-0.065
σ0.163-0.074=0.088
min15728.892-15729.035=-0.143
max15729.253-15729.198=0.055
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000
σ0.000
min1643.000
max1643.000
mean26.540-26.590=-0.051
σ0.047-0.146=-0.099
min26.482-26.477=0.005
max26.588-26.801=-0.214