Compare commits

Home / Compare 1268cee9 .. b97be8c0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.963-53.964=-0.001
σ0.371-0.370=0.002
min53.819-53.825=-0.006
max55.020-55.016=0.004
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.140-0.138=0.001
σ0.004-0.003=0.001
min0.135-0.136=-0.001
max0.147-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=0.000
σ0.007-0.006=0.001
min43.311-43.318=-0.006
max43.335-43.336=-0.001
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.119-0.121=-0.002
σ0.004-0.003=0.002
min0.115-0.119=-0.005
max0.126-0.128=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.521-1006.518=0.003
σ1.155-1.164=-0.010
min1005.951-1005.951=-0.001
max1011.343-1011.391=-0.048
mean1057.650-1045.050=12.600
σ316.924-312.723=4.201
min548.000-596.000=-48.000
max1516.000-1641.000=-125.000
mean1.554-1.555=-0.001
σ0.086-0.077=0.009
min1.468-1.484=-0.015
max1.828-1.794=0.034

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1516.000-1641.000=-125.000
σ0.000
min1516.000-1641.000=-125.000
max1516.000-1641.000=-125.000
mean0.414-0.434=-0.020
σ0.137-0.173=-0.037
min0.335-0.346=-0.012
max0.655-0.743=-0.088
name=error_case.art
mean2.339-2.340=-0.001
σ0.003-0.004=-0.001
min2.337
max2.342-2.345=-0.002
mean1516.000-1641.000=-125.000
σ0.000
min1516.000-1641.000=-125.000
max1516.000-1641.000=-125.000
mean0.890-0.896=-0.007
σ0.094-0.146=-0.052
min0.827-0.794=0.033
max1.053-1.151=-0.098
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1516.000-1641.000=-125.000
σ0.000
min1516.000-1641.000=-125.000
max1516.000-1641.000=-125.000
mean0.533-0.537=-0.004
σ0.055-0.041=0.014
min0.480-0.509=-0.029
max0.622-0.606=0.017
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1516.000-1641.000=-125.000
σ0.000
min1516.000-1641.000=-125.000
max1516.000-1641.000=-125.000
mean0.842-0.854=-0.012
σ0.045-0.043=0.002
min0.794-0.808=-0.014
max0.915-0.924=-0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.830-964.837=-0.006
σ0.038-0.020=0.018
min964.807-964.818=-0.011
max964.897-964.869=0.027
mean1516.000-1641.000=-125.000
σ0.000
min1516.000-1641.000=-125.000
max1516.000-1641.000=-125.000
mean0.802-0.820=-0.018
σ0.014-0.052=-0.038
min0.789-0.732=0.057
max0.826-0.864=-0.039
name=cdr_enhanced_4k_loc.art
mean885.511-885.514=-0.003
σ0.006-0.006=-0.001
min885.504
max885.518-885.522=-0.004
mean1516.000-1641.000=-125.000
σ0.000
min1516.000-1641.000=-125.000
max1516.000-1641.000=-125.000
mean0.717-0.741=-0.025
σ0.039-0.016=0.023
min0.652-0.725=-0.073
max0.743-0.758=-0.015

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.721=-0.000
mean1516.000-1641.000=-125.000
σ0.000
min1516.000-1641.000=-125.000
max1516.000-1641.000=-125.000
mean4.216-4.264=-0.048
σ0.084-0.090=-0.006
min4.077-4.127=-0.050
max4.564-4.574=-0.010
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1516.000-1641.000=-125.000
σ0.000
min1516.000-1641.000=-125.000
max1516.000-1641.000=-125.000
mean4.206-4.245=-0.039
σ0.066-0.068=-0.002
min4.077-4.113=-0.036
max4.395-4.480=-0.085
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1516.000-1641.000=-125.000
σ0.000
min1516.000-1641.000=-125.000
max1516.000-1641.000=-125.000
mean0.740-0.737=0.003
σ0.020-0.018=0.002
min0.695-0.706=-0.011
max0.861-0.860=0.001
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1516.000-1641.000=-125.000
σ0.000
min1516.000-1641.000=-125.000
max1516.000-1641.000=-125.000
mean0.695-0.703=-0.007
σ0.017-0.016=0.000
min0.652-0.671=-0.018
max0.762-0.792=-0.030

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.255-296.248=0.007
σ0.223-0.216=0.007
min296.062-296.125=-0.064
max296.815-296.847=-0.032
mean2026.000-2022.000=4.000
σ0.000
min2026.000-2022.000=4.000
max2026.000-2022.000=4.000
mean0.552-0.567=-0.015
σ0.027-0.023=0.004
min0.508-0.519=-0.011
max0.579-0.582=-0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.027-285.033=-0.006
σ0.038-0.027=0.011
min284.975-285.005=-0.030
max285.064-285.067=-0.002
mean1516.000-1641.000=-125.000
σ0.000
min1516.000-1641.000=-125.000
max1516.000-1641.000=-125.000
mean0.394-0.396=-0.002
σ0.005-0.006=-0.000
min0.387-0.388=-0.001
max0.398-0.404=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1295.464-1295.376=0.087
σ0.033-0.080=-0.047
min1295.422-1295.295=0.127
max1295.511-1295.500=0.011
mean1516.000-1641.000=-125.000
σ0.000
min1516.000-1641.000=-125.000
max1516.000-1641.000=-125.000
mean2.146-1.930=0.217
σ0.250-0.195=0.055
min1.996-1.788=0.208
max2.578-2.222=0.356
iters=5
new-facts=6402
prior-facts=1
mean1539.535-1539.575=-0.039
σ6.823-6.791=0.032
min1536.310-1536.412=-0.103
max1551.737-1551.721=0.016
mean1516.000-1641.000=-125.000
σ0.000
min1516.000-1641.000=-125.000
max1516.000-1641.000=-125.000
mean2.263-2.288=-0.025
σ0.141-0.170=-0.029
min2.102-2.133=-0.031
max2.409-2.566=-0.157
iters=5
new-facts=6402
prior-facts=6402
mean1857.324-1857.327=-0.003
σ0.064-0.053=0.011
min1857.246-1857.265=-0.019
max1857.396-1857.395=0.001
mean1742.800-1771.600=-28.800
σ205.550-167.864=37.686
min1516.000-1641.000=-125.000
max2026.000-2022.000=4.000
mean3.130-2.890=0.240
σ0.268-0.051=0.217
min2.876-2.838=0.038
max3.538-2.948=0.590

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.587-1.152=0.434
σ0.311-0.267=0.044
min1.206-0.962=0.244
max1.864-1.624=0.240

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.196-448.195=0.001
σ581.340-581.341=-0.001
min157.525-157.521=0.004
max1320.206-1320.207=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1516.000-1641.000=-125.000
σ0.000
min1516.000-1641.000=-125.000
max1516.000-1641.000=-125.000
mean0.560-0.534=0.026
σ0.593-0.544=0.048
min0.261-0.261=-0.000
max1.449-1.350=0.098
policies=20
mean1575.575-1575.575=0.000
σ0.361-0.364=-0.003
min1575.331-1575.328=0.003
max1576.112-1576.116=-0.004
mean920.000
σ0.000
min920.000
max920.000
mean1516.000-1641.000=-125.000
σ0.000
min1516.000-1641.000=-125.000
max1516.000-1641.000=-125.000
mean2.638-2.640=-0.002
σ0.010-0.015=-0.006
min2.626-2.630=-0.005
max2.649-2.663=-0.014
policies=200
mean15763.675-15763.694=-0.019
σ0.074-0.085=-0.011
min15763.585-15763.576=0.009
max15763.751-15763.778=-0.027
mean9200.000
σ0.000
min9200.000
max9200.000
mean1516.000-1641.000=-125.000
σ0.000
min1516.000-1641.000=-125.000
max1516.000-1641.000=-125.000
mean26.644-26.641=0.003
σ0.142-0.129=0.013
min26.548-26.541=0.007
max26.851-26.830=0.021