Compare commits

Home / Compare 9429987a .. 04a7fe14

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.966-53.965=0.001
σ0.369-0.370=-0.002
min53.818-53.823=-0.004
max55.014-55.019=-0.005
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.138-0.141=-0.003
σ0.005-0.004=0.001
min0.131-0.137=-0.006
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.321-43.323=-0.001
σ0.007-0.007=0.000
min43.314-43.310=0.003
max43.338-43.337=0.001
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.121-0.122=-0.002
σ0.004-0.003=0.001
min0.114-0.120=-0.005
max0.128-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.517-1006.515=0.003
σ1.156-1.179=-0.023
min1005.948-1005.969=-0.021
max1011.353-1011.448=-0.096
mean1038.050-1058.600=-20.550
σ310.154-316.638=-6.484
min548.000
max1505.000-1516.000=-11.000
mean1.513-1.560=-0.047
σ0.058-0.084=-0.026
min1.435-1.481=-0.046
max1.628-1.820=-0.192

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1505.000-1516.000=-11.000
σ0.000
min1505.000-1516.000=-11.000
max1505.000-1516.000=-11.000
mean0.423-0.416=0.007
σ0.145-0.141=0.004
min0.343-0.331=0.012
max0.681-0.664=0.017
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1505.000-1516.000=-11.000
σ0.000
min1505.000-1516.000=-11.000
max1505.000-1516.000=-11.000
mean0.889-0.870=0.019
σ0.111-0.095=0.016
min0.821-0.810=0.011
max1.084-1.037=0.047
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1505.000-1516.000=-11.000
σ0.000
min1505.000-1516.000=-11.000
max1505.000-1516.000=-11.000
mean0.533-0.529=0.004
σ0.054-0.061=-0.007
min0.496-0.475=0.021
max0.621-0.631=-0.011
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1505.000-1516.000=-11.000
σ0.000
min1505.000-1516.000=-11.000
max1505.000-1516.000=-11.000
mean0.848-0.836=0.012
σ0.039-0.044=-0.005
min0.819-0.799=0.020
max0.916-0.912=0.004

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.826-964.831=-0.004
σ0.034-0.038=-0.004
min964.802-964.806=-0.004
max964.886-964.896=-0.010
mean1505.000-1516.000=-11.000
σ0.000
min1505.000-1516.000=-11.000
max1505.000-1516.000=-11.000
mean0.770-0.825=-0.056
σ0.099-0.020=0.078
min0.655-0.805=-0.150
max0.862-0.852=0.010
name=cdr_enhanced_4k_loc.art
mean885.510-885.510=-0.000
σ0.006-0.007=-0.001
min885.504
max885.516-885.520=-0.004
mean1505.000-1516.000=-11.000
σ0.000
min1505.000-1516.000=-11.000
max1505.000-1516.000=-11.000
mean0.684-0.695=-0.011
σ0.083-0.042=0.040
min0.538-0.654=-0.116
max0.736-0.748=-0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719
mean1505.000-1516.000=-11.000
σ0.000
min1505.000-1516.000=-11.000
max1505.000-1516.000=-11.000
mean4.228-4.264=-0.037
σ0.093-0.130=-0.037
min4.046-4.086=-0.040
max4.614-5.204=-0.590
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.671=-0.003
mean1505.000-1516.000=-11.000
σ0.000
min1505.000-1516.000=-11.000
max1505.000-1516.000=-11.000
mean4.228-4.222=0.007
σ0.081-0.104=-0.023
min4.119-4.093=0.026
max4.517-4.966=-0.449
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1505.000-1516.000=-11.000
σ0.000
min1505.000-1516.000=-11.000
max1505.000-1516.000=-11.000
mean0.741-0.697=0.045
σ0.016-0.087=-0.071
min0.708-0.513=0.195
max0.823-0.850=-0.027
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1505.000-1516.000=-11.000
σ0.000
min1505.000-1516.000=-11.000
max1505.000-1516.000=-11.000
mean0.699-0.504=0.195
σ0.015-0.011=0.004
min0.669-0.480=0.189
max0.781-0.556=0.225

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.210-296.306=-0.097
σ0.227-0.189=0.038
min296.047-296.171=-0.124
max296.830-296.832=-0.001
mean1909.000-2026.000=-117.000
σ0.000
min1909.000-2026.000=-117.000
max1909.000-2026.000=-117.000
mean0.579-0.551=0.028
σ0.044-0.040=0.004
min0.514-0.495=0.019
max0.682-0.589=0.093

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.035-285.032=0.003
σ0.035-0.034=0.002
min284.989-284.988=0.000
max285.069-285.068=0.001
mean1505.000-1516.000=-11.000
σ0.000
min1505.000-1516.000=-11.000
max1505.000-1516.000=-11.000
mean0.395-0.402=-0.007
σ0.008-0.014=-0.007
min0.387-0.386=0.001
max0.405-0.424=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1295.411-1295.376=0.035
σ0.115-0.092=0.022
min1295.296-1295.296=-0.001
max1295.579-1295.524=0.055
mean1505.000-1516.000=-11.000
σ0.000
min1505.000-1516.000=-11.000
max1505.000-1516.000=-11.000
mean1.895-1.941=-0.046
σ0.078-0.214=-0.136
min1.805-1.788=0.017
max1.995-2.284=-0.289
iters=5
new-facts=6402
prior-facts=1
mean1539.522-1539.580=-0.058
σ6.853-6.789=0.064
min1536.233-1536.421=-0.188
max1551.775-1551.723=0.053
mean1505.000-1516.000=-11.000
σ0.000
min1505.000-1516.000=-11.000
max1505.000-1516.000=-11.000
mean2.268-2.295=-0.027
σ0.202-0.248=-0.046
min2.084-2.110=-0.026
max2.493-2.711=-0.218
iters=5
new-facts=6402
prior-facts=6402
mean1857.315-1857.328=-0.012
σ0.064-0.051=0.013
min1857.236-1857.280=-0.044
max1857.402-1857.397=0.006
mean1748.000-1734.400=13.600
σ171.613-212.133=-40.520
min1508.000-1516.000=-8.000
max1909.000-2026.000=-117.000
mean3.069-2.834=0.236
σ0.249-0.102=0.147
min2.870-2.711=0.159
max3.492-2.941=0.551

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.665-1.548=0.117
σ0.260-0.208=0.052
min1.265-1.217=0.048
max1.869-1.753=0.116

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.191-448.189=0.003
σ581.331-581.332=-0.000
min157.523-157.522=0.002
max1320.188-1320.186=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1505.000-1516.000=-11.000
σ0.000
min1505.000-1516.000=-11.000
max1505.000-1516.000=-11.000
mean0.549-0.548=0.001
σ0.573-0.569=0.004
min0.260-0.262=-0.002
max1.409-1.401=0.008
policies=20
mean1575.569-1575.549=0.020
σ0.354-0.361=-0.007
min1575.331-1575.304=0.027
max1576.095-1576.085=0.011
mean920.000
σ0.000
min920.000
max920.000
mean1505.000-1516.000=-11.000
σ0.000
min1505.000-1516.000=-11.000
max1505.000-1516.000=-11.000
mean2.622-2.640=-0.017
σ0.022-0.018=0.004
min2.606-2.620=-0.014
max2.653-2.659=-0.006
policies=200
mean15763.756-15763.699=0.057
σ0.098-0.165=-0.067
min15763.676-15763.557=0.118
max15763.897-15763.917=-0.020
mean9200.000
σ0.000
min9200.000
max9200.000
mean1505.000-1516.000=-11.000
σ0.000
min1505.000-1516.000=-11.000
max1505.000-1516.000=-11.000
mean26.464-26.550=-0.086
σ0.034-0.034=-0.000
min26.418-26.507=-0.089
max26.491-26.590=-0.098