Compare commits

Home / Compare bde172c1 .. 7bd1402c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.056=-0.002
σ0.370-0.368=0.003
min53.904-53.914=-0.010
max55.107-55.101=0.006
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.140-0.140=-0.000
σ0.003-0.004=-0.001
min0.138-0.137=0.001
max0.147-0.147=0.000
cache=y
dps=1
iters=10
policies=100
mean43.394-43.392=0.002
σ0.009-0.006=0.003
min43.382-43.383=-0.001
max43.411-43.404=0.007
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.121-0.118=0.003
σ0.008-0.005=0.003
min0.114-0.113=0.001
max0.140-0.130=0.010

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.006-1007.001=0.005
σ1.198-1.193=0.006
min1006.434-1006.461=-0.027
max1012.030-1012.005=0.025
mean1050.950-1052.200=-1.250
σ307.406-319.623=-12.217
min577.000-590.000=-13.000
max1643.000-1619.000=24.000
mean1.538-1.535=0.003
σ0.063-0.098=-0.035
min1.455-1.404=0.051
max1.668-1.856=-0.188

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1643.000-1619.000=24.000
σ0.000
min1643.000-1619.000=24.000
max1643.000-1619.000=24.000
mean0.413-0.424=-0.011
σ0.128-0.138=-0.010
min0.333-0.336=-0.003
max0.642-0.670=-0.029
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1643.000-1619.000=24.000
σ0.000
min1643.000-1619.000=24.000
max1643.000-1619.000=24.000
mean0.886-0.933=-0.047
σ0.091-0.207=-0.115
min0.834-0.820=0.014
max1.049-1.300=-0.252
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1643.000-1619.000=24.000
σ0.000
min1643.000-1619.000=24.000
max1643.000-1619.000=24.000
mean0.531-0.535=-0.004
σ0.055-0.044=0.012
min0.486-0.489=-0.002
max0.623-0.604=0.019
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1643.000-1619.000=24.000
σ0.000
min1643.000-1619.000=24.000
max1643.000-1619.000=24.000
mean0.841-0.851=-0.010
σ0.041-0.032=0.008
min0.816-0.831=-0.015
max0.912-0.908=0.004

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=-0.000
σ0.033-0.034=-0.000
min964.812-964.811=0.001
max964.895-964.895=0.000
mean1643.000-1619.000=24.000
σ0.000
min1643.000-1619.000=24.000
max1643.000-1619.000=24.000
mean0.814-0.798=0.016
σ0.037-0.029=0.008
min0.764-0.767=-0.002
max0.851-0.836=0.016
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.007-0.007=-0.000
min885.504
max885.522-885.522=-0.000
mean1643.000-1619.000=24.000
σ0.000
min1643.000-1619.000=24.000
max1643.000-1619.000=24.000
mean0.719-0.741=-0.022
σ0.032-0.009=0.023
min0.665-0.729=-0.064
max0.742-0.752=-0.011

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.719
mean1643.000-1619.000=24.000
σ0.000
min1643.000-1619.000=24.000
max1643.000-1619.000=24.000
mean4.239-4.139=0.100
σ0.084-0.267=-0.184
min4.108-3.480=0.629
max4.518-4.526=-0.008
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1643.000-1619.000=24.000
σ0.000
min1643.000-1619.000=24.000
max1643.000-1619.000=24.000
mean4.225-3.840=0.386
σ0.091-0.385=-0.294
min4.099-3.401=0.698
max4.792-4.740=0.051
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1643.000-1619.000=24.000
σ0.000
min1643.000-1619.000=24.000
max1643.000-1619.000=24.000
mean0.738-0.743=-0.005
σ0.028-0.018=0.010
min0.698-0.713=-0.015
max0.925-0.862=0.064
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1643.000-1619.000=24.000
σ0.000
min1643.000-1619.000=24.000
max1643.000-1619.000=24.000
mean0.690-0.704=-0.014
σ0.020-0.017=0.003
min0.585-0.662=-0.077
max0.788-0.790=-0.003

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.892-297.178=-0.286
σ0.194-0.224=-0.030
min296.756-297.007=-0.251
max297.408-297.780=-0.372
mean1921.000-2030.000=-109.000
σ0.000
min1921.000-2030.000=-109.000
max1921.000-2030.000=-109.000
mean0.572-0.549=0.023
σ0.050-0.034=0.016
min0.503-0.503=-0.000
max0.673-0.601=0.072

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.820-286.815=0.004
σ0.040-0.042=-0.002
min286.773-286.763=0.010
max286.865-286.860=0.006
mean1643.000-1619.000=24.000
σ0.000
min1643.000-1619.000=24.000
max1643.000-1619.000=24.000
mean0.399-0.402=-0.003
σ0.010-0.011=-0.002
min0.388-0.389=-0.001
max0.411-0.421=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1297.242-1297.284=-0.042
σ0.060-0.085=-0.024
min1297.167-1297.191=-0.023
max1297.301-1297.406=-0.104
mean1643.000-1619.000=24.000
σ0.000
min1643.000-1619.000=24.000
max1643.000-1619.000=24.000
mean2.074-2.235=-0.160
σ0.072-0.076=-0.004
min1.993-2.131=-0.138
max2.156-2.335=-0.179
iters=5
new-facts=6402
prior-facts=1
mean1541.339-1541.324=0.015
σ6.847-6.839=0.008
min1538.069-1538.089=-0.020
max1553.583-1553.555=0.028
mean1643.000-1619.000=24.000
σ0.000
min1643.000-1619.000=24.000
max1643.000-1619.000=24.000
mean2.294-2.187=0.107
σ0.169-0.140=0.029
min2.107-2.032=0.075
max2.486-2.379=0.107
iters=5
new-facts=6402
prior-facts=6402
mean1859.118-1859.119=-0.001
σ0.074-0.060=0.014
min1859.014-1859.033=-0.018
max1859.195-1859.186=0.009
mean1775.600-1770.000=5.600
σ139.735-177.881=-38.146
min1643.000-1619.000=24.000
max1921.000-2030.000=-109.000
mean3.092-2.922=0.170
σ0.188-0.070=0.118
min2.851-2.869=-0.018
max3.281-3.041=0.240

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.220-1.248=-0.028
σ0.328-0.362=-0.034
min0.938-0.940=-0.002
max1.768-1.860=-0.092

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.819-448.820=-0.001
σ581.371-581.372=-0.001
min158.132-158.132=-0.000
max1320.876-1320.878=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1619.000=24.000
σ0.000
min1643.000-1619.000=24.000
max1643.000-1619.000=24.000
mean0.548-0.559=-0.011
σ0.570-0.583=-0.013
min0.248-0.261=-0.012
max1.403-1.433=-0.030
policies=20
mean1581.609-1581.616=-0.007
σ0.355-0.373=-0.018
min1581.371-1581.368=0.003
max1582.138-1582.171=-0.034
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1619.000=24.000
σ0.000
min1643.000-1619.000=24.000
max1643.000-1619.000=24.000
mean2.631-2.653=-0.022
σ0.012-0.047=-0.035
min2.618-2.607=0.011
max2.647-2.717=-0.070
policies=200
mean15824.144-15824.237=-0.092
σ0.084-0.140=-0.056
min15824.034-15824.122=-0.088
max15824.230-15824.414=-0.184
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1619.000=24.000
σ0.000
min1643.000-1619.000=24.000
max1643.000-1619.000=24.000
mean26.570-26.555=0.015
σ0.059-0.053=0.006
min26.530-26.521=0.009
max26.658-26.632=0.025