Compare commits

Home / Compare d7e1679a .. da0d8f02

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.704-53.705=-0.000
σ0.369-0.369=0.001
min53.563-53.563=0.000
max54.754-54.753=0.001
mean419.000-417.000=2.000
σ0.000
min419.000-417.000=2.000
max419.000-417.000=2.000
mean0.137-0.139=-0.002
σ0.004-0.004=0.000
min0.131-0.135=-0.004
max0.144-0.147=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.060-43.058=0.002
σ0.006-0.007=-0.002
min43.053-43.046=0.007
max43.071-43.074=-0.003
mean419.000-417.000=2.000
σ0.000
min419.000-417.000=2.000
max419.000-417.000=2.000
mean0.122-0.123=-0.001
σ0.003-0.004=-0.000
min0.119-0.120=-0.001
max0.128-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.107-1005.108=-0.000
σ0.885-0.880=0.005
min1004.641-1004.631=0.010
max1008.777-1008.751=0.026
mean1059.200-1052.400=6.800
σ320.654-315.348=5.306
min558.000-601.000=-43.000
max1635.000-1655.000=-20.000
mean1.629-1.630=-0.000
σ0.096-0.077=0.019
min1.524-1.551=-0.027
max1.873-1.855=0.018

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.000
σ0.002-0.003=-0.000
min0.881
max0.886-0.887=-0.001
mean1635.000-1655.000=-20.000
σ0.000
min1635.000-1655.000=-20.000
max1635.000-1655.000=-20.000
mean0.435-0.441=-0.006
σ0.125-0.176=-0.051
min0.341-0.352=-0.011
max0.630-0.755=-0.124
name=error_case.art
mean2.333-2.334=-0.000
σ0.003-0.002=0.000
min2.332
max2.337
mean1635.000-1655.000=-20.000
σ0.000
min1635.000-1655.000=-20.000
max1635.000-1655.000=-20.000
mean0.889-0.922=-0.033
σ0.105-0.171=-0.066
min0.815-0.832=-0.017
max1.072-1.227=-0.154
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1635.000-1655.000=-20.000
σ0.000
min1635.000-1655.000=-20.000
max1635.000-1655.000=-20.000
mean0.533-0.536=-0.003
σ0.045-0.050=-0.006
min0.497-0.500=-0.003
max0.609-0.624=-0.014
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1635.000-1655.000=-20.000
σ0.000
min1635.000-1655.000=-20.000
max1635.000-1655.000=-20.000
mean0.844-0.843=0.001
σ0.040-0.042=-0.002
min0.812-0.815=-0.003
max0.911-0.916=-0.006

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.556-963.552=0.004
σ0.030-0.023=0.007
min963.524-963.531=-0.006
max963.605-963.582=0.023
mean1635.000-1655.000=-20.000
σ0.000
min1635.000-1655.000=-20.000
max1635.000-1655.000=-20.000
mean0.845-0.827=0.019
σ0.013-0.037=-0.025
min0.825-0.767=0.058
max0.859-0.859=-0.000
name=cdr_enhanced_4k_loc.art
mean884.856-884.855=0.001
σ0.007-0.005=0.002
min884.847
max884.866-884.859=0.006
mean1635.000-1655.000=-20.000
σ0.000
min1635.000-1655.000=-20.000
max1635.000-1655.000=-20.000
mean0.725-0.715=0.010
σ0.039-0.033=0.006
min0.655-0.668=-0.013
max0.747-0.745=0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=0.000
min7.705
max7.711-7.711=0.000
mean1635.000-1655.000=-20.000
σ0.000
min1635.000-1655.000=-20.000
max1635.000-1655.000=-20.000
mean4.235-4.251=-0.016
σ0.088-0.083=0.005
min4.102-4.113=-0.011
max4.662-4.550=0.112
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1635.000-1655.000=-20.000
σ0.000
min1635.000-1655.000=-20.000
max1635.000-1655.000=-20.000
mean4.250-4.244=0.006
σ0.091-0.095=-0.004
min4.083-3.944=0.139
max4.527-4.526=0.001
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1635.000-1655.000=-20.000
σ0.000
min1635.000-1655.000=-20.000
max1635.000-1655.000=-20.000
mean0.747-0.749=-0.003
σ0.017-0.026=-0.009
min0.715-0.706=0.010
max0.858-0.898=-0.039
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1635.000-1655.000=-20.000
σ0.000
min1635.000-1655.000=-20.000
max1635.000-1655.000=-20.000
mean0.548-0.705=-0.157
σ0.082-0.014=0.067
min0.490-0.676=-0.186
max0.811-0.775=0.037

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.309-294.354=-0.046
σ0.209-0.166=0.043
min294.146-294.239=-0.092
max294.844-294.809=0.035
mean1921.000-1906.000=15.000
σ0.000
min1921.000-1906.000=15.000
max1921.000-1906.000=15.000
mean0.609-0.588=0.021
σ0.034-0.018=0.017
min0.585-0.554=0.030
max0.699-0.605=0.094

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.496-281.496=-0.000
σ0.034-0.036=-0.002
min281.454-281.448=0.006
max281.536-281.534=0.002
mean1635.000-1655.000=-20.000
σ0.000
min1635.000-1655.000=-20.000
max1635.000-1655.000=-20.000
mean0.382-0.385=-0.003
σ0.006-0.005=0.001
min0.376-0.378=-0.002
max0.391-0.390=0.002
iters=5
new-facts=1
prior-facts=6402
mean1291.485-1291.476=0.009
σ0.122-0.098=0.024
min1291.362-1291.363=-0.001
max1291.662-1291.581=0.081
mean1635.000-1655.000=-20.000
σ0.000
min1635.000-1655.000=-20.000
max1635.000-1655.000=-20.000
mean1.952-1.926=0.027
σ0.112-0.142=-0.030
min1.846-1.810=0.035
max2.074-2.151=-0.077
iters=5
new-facts=6402
prior-facts=1
mean1534.318-1534.322=-0.004
σ3.967-4.006=-0.039
min1532.325-1532.279=0.046
max1541.406-1541.477=-0.071
mean1635.000-1655.000=-20.000
σ0.000
min1635.000-1655.000=-20.000
max1635.000-1655.000=-20.000
mean2.188-2.303=-0.115
σ0.114-0.169=-0.055
min2.010-2.028=-0.018
max2.316-2.439=-0.123
iters=5
new-facts=6402
prior-facts=6402
mean1853.358-1853.367=-0.009
σ0.055-0.049=0.006
min1853.302-1853.307=-0.005
max1853.436-1853.434=0.003
mean1775.000-1789.400=-14.400
σ143.157-121.292=21.865
min1635.000-1655.000=-20.000
max1921.000-1906.000=15.000
mean3.030-2.972=0.058
σ0.259-0.091=0.168
min2.828-2.870=-0.042
max3.483-3.120=0.363

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.307-1.326=-0.018
σ0.226-0.205=0.021
min1.100-1.085=0.016
max1.644-1.646=-0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.426-442.428=-0.001
σ577.065-577.064=0.001
min153.890-153.894=-0.004
max1308.024-1308.024=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1635.000-1655.000=-20.000
σ0.000
min1635.000-1655.000=-20.000
max1635.000-1655.000=-20.000
mean0.518-0.549=-0.031
σ0.514-0.580=-0.066
min0.259-0.257=0.003
max1.289-1.418=-0.129
policies=20
mean1539.205-1539.206=-0.001
σ0.314-0.317=-0.002
min1538.992-1538.987=0.005
max1539.672-1539.676=-0.004
mean920.000
σ0.000
min920.000
max920.000
mean1635.000-1655.000=-20.000
σ0.000
min1635.000-1655.000=-20.000
max1635.000-1655.000=-20.000
mean2.569-2.570=-0.000
σ0.018-0.016=0.002
min2.550-2.555=-0.006
max2.593-2.591=0.001
policies=200
mean15400.415-15400.421=-0.006
σ0.135-0.129=0.006
min15400.270-15400.239=0.031
max15400.562-15400.544=0.018
mean9200.000
σ0.000
min9200.000
max9200.000
mean1635.000-1655.000=-20.000
σ0.000
min1635.000-1655.000=-20.000
max1635.000-1655.000=-20.000
mean26.044-26.141=-0.097
σ0.120-0.230=-0.109
min25.915-26.013=-0.098
max26.191-26.485=-0.294