Compare commits

Home / Compare 98bf656a .. c4d5b694

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.964-53.966=-0.002
σ0.369-0.369=0.001
min53.815-53.821=-0.006
max55.015-55.015=-0.000
mean420.000-415.000=5.000
σ0.000
min420.000-415.000=5.000
max420.000-415.000=5.000
mean0.137-0.148=-0.010
σ0.006-0.011=-0.005
min0.130-0.138=-0.008
max0.147-0.168=-0.021
cache=y
dps=1
iters=10
policies=100
mean43.323-43.324=-0.001
σ0.007-0.007=-0.000
min43.310-43.315=-0.005
max43.333-43.338=-0.005
mean420.000-415.000=5.000
σ0.000
min420.000-415.000=5.000
max420.000-415.000=5.000
mean0.122-0.125=-0.003
σ0.004-0.004=-0.000
min0.118-0.121=-0.002
max0.129-0.132=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.513-1006.521=-0.008
σ1.190-1.174=0.016
min1005.975-1005.967=0.008
max1011.501-1011.438=0.063
mean1056.300-1043.650=12.650
σ312.765-310.007=2.758
min557.000-571.000=-14.000
max1521.000-1631.000=-110.000
mean1.565-1.567=-0.003
σ0.052-0.071=-0.019
min1.506-1.494=0.012
max1.673-1.802=-0.129

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1521.000-1631.000=-110.000
σ0.000
min1521.000-1631.000=-110.000
max1521.000-1631.000=-110.000
mean0.420-0.411=0.009
σ0.135-0.126=0.008
min0.331-0.341=-0.010
max0.657-0.635=0.022
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1521.000-1631.000=-110.000
σ0.000
min1521.000-1631.000=-110.000
max1521.000-1631.000=-110.000
mean0.875-0.883=-0.008
σ0.089-0.085=0.005
min0.820-0.832=-0.012
max1.033-1.033=-0.001
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1521.000-1631.000=-110.000
σ0.000
min1521.000-1631.000=-110.000
max1521.000-1631.000=-110.000
mean0.560-0.533=0.027
σ0.058-0.051=0.007
min0.505-0.496=0.009
max0.637-0.622=0.015
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1521.000-1631.000=-110.000
σ0.000
min1521.000-1631.000=-110.000
max1521.000-1631.000=-110.000
mean0.859-0.835=0.024
σ0.042-0.050=-0.008
min0.826-0.798=0.028
max0.930-0.921=0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.829-964.838=-0.009
σ0.036-0.034=0.002
min964.807-964.809=-0.002
max964.891-964.894=-0.003
mean1521.000-1631.000=-110.000
σ0.000
min1521.000-1631.000=-110.000
max1521.000-1631.000=-110.000
mean0.814-0.844=-0.030
σ0.054-0.018=0.037
min0.729-0.819=-0.090
max0.866-0.860=0.006
name=cdr_enhanced_4k_loc.art
mean885.510-885.512=-0.002
σ0.005-0.006=-0.001
min885.504
max885.516-885.521=-0.005
mean1521.000-1631.000=-110.000
σ0.000
min1521.000-1631.000=-110.000
max1521.000-1631.000=-110.000
mean0.675-0.699=-0.024
σ0.050-0.034=0.015
min0.613-0.669=-0.056
max0.739-0.739=-0.000

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.002
mean1521.000-1631.000=-110.000
σ0.000
min1521.000-1631.000=-110.000
max1521.000-1631.000=-110.000
mean4.260-4.226=0.035
σ0.087-0.105=-0.018
min4.116-4.047=0.069
max4.598-4.711=-0.113
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.668
mean1521.000-1631.000=-110.000
σ0.000
min1521.000-1631.000=-110.000
max1521.000-1631.000=-110.000
mean4.250-4.179=0.072
σ0.082-0.079=0.003
min4.050-4.046=0.003
max4.479-4.469=0.010
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1521.000-1631.000=-110.000
σ0.000
min1521.000-1631.000=-110.000
max1521.000-1631.000=-110.000
mean0.743-0.734=0.008
σ0.028-0.017=0.011
min0.708-0.708=-0.000
max0.930-0.844=0.086
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1521.000-1631.000=-110.000
σ0.000
min1521.000-1631.000=-110.000
max1521.000-1631.000=-110.000
mean0.700-0.586=0.114
σ0.015-0.095=-0.080
min0.669-0.479=0.190
max0.769-0.757=0.012

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.511-296.450=0.061
σ0.255-0.237=0.017
min296.306-296.227=0.079
max297.201-297.064=0.137
mean1916.000-2024.000=-108.000
σ0.000
min1916.000-2024.000=-108.000
max1916.000-2024.000=-108.000
mean0.573-0.551=0.022
σ0.040-0.038=0.003
min0.523-0.508=0.015
max0.666-0.603=0.063

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.036-285.029=0.007
σ0.029-0.036=-0.007
min285.004-284.984=0.019
max285.072-285.069=0.003
mean1521.000-1631.000=-110.000
σ0.000
min1521.000-1631.000=-110.000
max1521.000-1631.000=-110.000
mean0.395-0.395=0.001
σ0.012-0.008=0.003
min0.387-0.386=0.002
max0.415-0.403=0.012
iters=5
new-facts=1
prior-facts=6402
mean1295.425-1295.429=-0.004
σ0.059-0.062=-0.003
min1295.361-1295.363=-0.002
max1295.482-1295.493=-0.011
mean1521.000-1631.000=-110.000
σ0.000
min1521.000-1631.000=-110.000
max1521.000-1631.000=-110.000
mean2.051-2.035=0.016
σ0.073-0.047=0.026
min1.985-1.998=-0.013
max2.139-2.108=0.031
iters=5
new-facts=6402
prior-facts=1
mean1539.604-1539.555=0.049
σ6.794-6.813=-0.020
min1536.411-1536.323=0.088
max1551.754-1551.740=0.014
mean1521.000-1631.000=-110.000
σ0.000
min1521.000-1631.000=-110.000
max1521.000-1631.000=-110.000
mean2.408-2.321=0.087
σ0.196-0.181=0.015
min2.153-2.108=0.045
max2.693-2.513=0.180
iters=5
new-facts=6402
prior-facts=6402
mean1857.309-1857.319=-0.010
σ0.076-0.079=-0.003
min1857.194-1857.197=-0.003
max1857.385-1857.400=-0.015
mean1760.400-1769.800=-9.400
σ171.940-172.545=-0.605
min1521.000-1631.000=-110.000
max1916.000-2024.000=-108.000
mean3.237-2.955=0.282
σ0.271-0.071=0.201
min2.871-2.855=0.015
max3.572-3.046=0.526

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.526-1.239=0.288
σ0.348-0.358=-0.010
min1.070-0.944=0.126
max1.847-1.849=-0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.196-448.196=0.000
σ581.340-581.340=-0.000
min157.524-157.524=0.001
max1320.207-1320.206=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1521.000-1631.000=-110.000
σ0.000
min1521.000-1631.000=-110.000
max1521.000-1631.000=-110.000
mean0.569-0.562=0.007
σ0.600-0.597=0.003
min0.268-0.262=0.006
max1.469-1.458=0.011
policies=20
mean1575.574-1575.582=-0.007
σ0.364-0.372=-0.008
min1575.328-1575.333=-0.006
max1576.115-1576.135=-0.019
mean920.000
σ0.000
min920.000
max920.000
mean1521.000-1631.000=-110.000
σ0.000
min1521.000-1631.000=-110.000
max1521.000-1631.000=-110.000
mean2.644-2.657=-0.013
σ0.014-0.008=0.006
min2.627-2.647=-0.019
max2.656-2.665=-0.009
policies=200
mean15763.745-15763.743=0.003
σ0.122-0.062=0.060
min15763.649-15763.698=-0.049
max15763.918-15763.835=0.083
mean9200.000
σ0.000
min9200.000
max9200.000
mean1521.000-1631.000=-110.000
σ0.000
min1521.000-1631.000=-110.000
max1521.000-1631.000=-110.000
mean26.616-26.756=-0.140
σ0.034-0.064=-0.030
min26.587-26.702=-0.115
max26.657-26.839=-0.183