Compare commits

Home / Compare 6d580e45 .. 5800121c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.016-54.014=0.002
σ0.369-0.371=-0.002
min53.874-53.877=-0.003
max55.065-55.069=-0.004
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.141-0.139=0.002
σ0.004-0.004=-0.000
min0.137-0.136=0.001
max0.148-0.146=0.002
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=0.001
σ0.008-0.007=0.001
min43.312-43.312=-0.001
max43.338-43.335=0.002
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.122-0.120=0.002
σ0.004-0.005=-0.001
min0.118-0.113=0.005
max0.130-0.127=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.310-1006.309=0.001
σ1.175-1.167=0.008
min1005.757-1005.766=-0.009
max1011.236-1011.194=0.042
mean1046.750-1048.550=-1.800
σ313.149-313.783=-0.633
min596.000-597.000=-1.000
max1643.000-1644.000=-1.000
mean1.542-1.566=-0.023
σ0.079-0.101=-0.022
min1.463-1.470=-0.007
max1.778-1.821=-0.044

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.402
σ0.129
min0.321
max0.632
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.881
σ0.089
min0.820
max1.035
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.540
σ0.046
min0.502
max0.618
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.828
σ0.042
min0.787
max0.894

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113
σ0.032
min964.086
max964.165
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.843
σ0.019
min0.812
max0.857
name=cdr_enhanced_4k_loc.art
mean884.711
σ0.004
min884.705
max884.715
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.706
σ0.041
min0.659
max0.738

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715
σ0.002
min7.714
max7.721
mean1643.000
σ0.000
min1643.000
max1643.000
mean4.243
σ0.094
min4.092
max4.576
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1643.000
σ0.000
min1643.000
max1643.000
mean4.224
σ0.079
min4.096
max4.511
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.730
σ0.018
min0.698
max0.851
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1643.000
σ0.000
min1643.000
max1643.000
mean0.694
σ0.017
min0.665
max0.789

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.237-296.165=0.072
σ0.198-0.232=-0.033
min296.000-295.956=0.044
max296.745-296.794=-0.049
mean1973.000-1948.000=25.000
σ0.000
min1973.000-1948.000=25.000
max1973.000-1948.000=25.000
mean0.588-0.547=0.041
σ0.051-0.031=0.019
min0.511-0.509=0.002
max0.697-0.580=0.116

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.700-284.694=0.006
σ0.029-0.039=-0.009
min284.666-284.643=0.022
max284.736-284.742=-0.006
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean0.397-0.401=-0.004
σ0.008-0.008=0.000
min0.387-0.387=-0.000
max0.403-0.406=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.057-1295.057=-0.000
σ0.080-0.084=-0.004
min1294.951-1294.952=-0.001
max1295.152-1295.169=-0.017
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean1.965-1.907=0.058
σ0.216-0.058=0.158
min1.805-1.813=-0.008
max2.322-1.964=0.358
iters=5
new-facts=6402
prior-facts=1
mean1539.186-1539.194=-0.008
σ6.846-6.884=-0.038
min1535.949-1535.885=0.064
max1551.429-1551.502=-0.073
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean2.308-2.287=0.020
σ0.265-0.240=0.024
min2.011-2.025=-0.014
max2.651-2.630=0.020
iters=5
new-facts=6402
prior-facts=6402
mean1856.998-1856.993=0.005
σ0.065-0.066=-0.001
min1856.922-1856.914=0.007
max1857.061-1857.087=-0.025
mean1799.400-1763.200=36.200
σ166.117-126.496=39.621
min1643.000-1644.000=-1.000
max1973.000-1948.000=25.000
mean2.978-2.927=0.051
σ0.182-0.127=0.055
min2.831-2.783=0.048
max3.204-3.076=0.129

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.256-1.203=0.054
σ0.324-0.302=0.022
min1.050-0.941=0.109
max1.808-1.706=0.102

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.783-447.805=-0.022
σ581.212-581.236=-0.023
min157.176-157.187=-0.011
max1319.602-1319.659=-0.057
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean0.540-0.525=0.015
σ0.559-0.526=0.033
min0.258-0.259=-0.002
max1.379-1.315=0.064
policies=20
mean1572.078-1572.125=-0.047
σ0.359-0.325=0.033
min1571.834-1571.947=-0.112
max1572.611-1572.613=-0.002
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean2.622-2.628=-0.007
σ0.014-0.011=0.003
min2.605-2.612=-0.007
max2.635-2.638=-0.003
policies=200
mean15729.025-15728.869=0.155
σ0.163-0.150=0.013
min15728.892-15728.752=0.140
max15729.253-15729.082=0.171
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1644.000=-1.000
σ0.000
min1643.000-1644.000=-1.000
max1643.000-1644.000=-1.000
mean26.540-26.671=-0.131
σ0.047-0.221=-0.174
min26.482-26.488=-0.007
max26.588-26.960=-0.373