Compare commits

Home / Compare b44966ed .. a2a3ef01

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.032-54.032=-0.000
σ0.366-0.369=-0.003
min53.888-53.891=-0.003
max55.073-55.081=-0.008
mean416.000
σ0.000
min416.000
max416.000
mean0.139-0.140=-0.001
σ0.005-0.004=0.001
min0.132-0.137=-0.004
max0.147-0.148=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.385-43.384=0.001
σ0.006-0.007=-0.001
min43.374-43.377=-0.003
max43.394-43.400=-0.006
mean416.000
σ0.000
min416.000
max416.000
mean0.120-0.123=-0.002
σ0.003-0.003=-0.001
min0.116-0.119=-0.004
max0.123-0.128=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.330-1006.327=0.003
σ0.892-0.889=0.003
min1005.844-1005.857=-0.013
max1010.036-1010.011=0.025
mean1047.750-1048.700=-0.950
σ310.193-308.002=2.191
min564.000-573.000=-9.000
max1638.000-1649.000=-11.000
mean1.569-1.538=0.031
σ0.095-0.078=0.017
min1.491-1.445=0.046
max1.838-1.755=0.083

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.003-0.002=0.001
min0.881
max0.888-0.886=0.002
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean0.407-0.424=-0.017
σ0.116-0.146=-0.030
min0.341-0.342=-0.001
max0.613-0.684=-0.071
name=error_case.art
mean2.334-2.334=0.000
σ0.003-0.002=0.000
min2.332
max2.337
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean0.871-0.881=-0.011
σ0.090-0.087=0.003
min0.820-0.822=-0.002
max1.030-1.034=-0.004
name=heavy_item.art
mean1.521-1.521=-0.001
σ0.001-0.002=-0.001
min1.520
max1.523-1.524=-0.001
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean0.538-0.547=-0.009
σ0.051-0.046=0.005
min0.508-0.505=0.003
max0.629-0.625=0.003
name=nested_use.art
mean2.356-2.356=0.000
σ0.002-0.002=0.000
min2.355
max2.358
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean0.842-0.839=0.002
σ0.035-0.044=-0.009
min0.819-0.796=0.022
max0.903-0.913=-0.010

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.551-963.552=-0.000
σ0.024-0.025=-0.000
min963.523
max963.582-963.582=-0.000
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean0.811-0.811=-0.000
σ0.030-0.023=0.007
min0.775-0.796=-0.021
max0.856-0.851=0.004
name=cdr_enhanced_4k_loc.art
mean884.857-884.856=0.001
σ0.004-0.004=-0.001
min884.851-884.848=0.002
max884.861-884.860=0.001
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean0.730-0.681=0.050
σ0.016-0.046=-0.030
min0.714-0.606=0.108
max0.752-0.731=0.022

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.712-7.709=0.003
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean4.261-3.578=0.683
σ0.095-0.086=0.009
min4.127-3.413=0.714
max4.745-3.924=0.821
name=record_render_large_syntax_err.art
mean7.655-7.655=-0.000
σ0.002-0.002=-0.000
min7.654
max7.658-7.659=-0.001
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean4.295-3.531=0.763
σ0.095-0.058=0.037
min4.108-3.395=0.713
max4.609-3.653=0.955
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean0.751-0.745=0.006
σ0.021-0.016=0.004
min0.717-0.716=0.001
max0.851-0.855=-0.004
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean0.656-0.710=-0.054
σ0.092-0.014=0.078
min0.495-0.686=-0.191
max0.784-0.801=-0.017

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.522-295.740=-0.218
σ0.250-0.203=0.047
min295.330-295.555=-0.225
max296.196-296.286=-0.090
mean1896.000-1906.000=-10.000
σ0.000
min1896.000-1906.000=-10.000
max1896.000-1906.000=-10.000
mean0.578-0.583=-0.005
σ0.058-0.036=0.022
min0.499-0.541=-0.042
max0.709-0.671=0.038

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.250-285.247=0.003
σ0.042-0.036=0.006
min285.192-285.195=-0.003
max285.295-285.281=0.014
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean0.402-0.390=0.011
σ0.012-0.014=-0.001
min0.388-0.383=0.005
max0.414-0.414=0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.197-1295.201=-0.004
σ0.115-0.114=0.001
min1295.067-1295.081=-0.014
max1295.333-1295.352=-0.020
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean1.902-1.893=0.009
σ0.072-0.094=-0.021
min1.820-1.784=0.036
max1.978-2.012=-0.034
iters=5
new-facts=6402
prior-facts=1
mean1538.083-1538.078=0.004
σ4.040-4.018=0.022
min1536.074-1536.034=0.041
max1545.300-1545.256=0.044
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean2.242-2.288=-0.046
σ0.174-0.224=-0.049
min2.043-2.022=0.021
max2.418-2.528=-0.110
iters=5
new-facts=6402
prior-facts=6402
mean1857.113-1857.112=0.001
σ0.055-0.055=0.000
min1857.054-1857.056=-0.002
max1857.184-1857.187=-0.003
mean1766.400-1775.800=-9.400
σ124.172-127.433=-3.261
min1638.000-1649.000=-11.000
max1896.000-1906.000=-10.000
mean3.036-3.061=-0.025
σ0.177-0.350=-0.173
min2.860-2.794=0.066
max3.314-3.659=-0.345

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.400-1.354=0.046
σ0.220-0.181=0.038
min1.266-1.114=0.151
max1.787-1.604=0.183

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.610-443.607=0.003
σ577.064-577.066=-0.002
min155.077-155.072=0.005
max1309.206-1309.206=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean0.535-0.524=0.011
σ0.551-0.515=0.036
min0.250-0.263=-0.013
max1.362-1.297=0.065
policies=20
mean1551.048-1551.016=0.032
σ0.342-0.325=0.017
min1550.811-1550.794=0.017
max1551.555-1551.499=0.056
mean920.000
σ0.000
min920.000
max920.000
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean2.606-2.585=0.021
σ0.035-0.011=0.024
min2.576-2.578=-0.002
max2.655-2.602=0.053
policies=200
mean15518.425-15518.412=0.013
σ0.045-0.129=-0.084
min15518.390-15518.242=0.148
max15518.490-15518.512=-0.022
mean9200.000
σ0.000
min9200.000
max9200.000
mean1638.000-1649.000=-11.000
σ0.000
min1638.000-1649.000=-11.000
max1638.000-1649.000=-11.000
mean26.220-26.098=0.122
σ0.104-0.118=-0.014
min26.116-26.017=0.099
max26.359-26.274=0.085