Compare commits

Home / Compare 1107d713 .. ec20e036

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.014=-0.000
σ0.370-0.368=0.002
min53.871-53.872=-0.001
max55.066-55.061=0.005
mean417.000-420.700=-3.700
σ0.000-0.483=-0.483
min417.000-420.000=-3.000
max417.000-421.000=-4.000
mean0.137-0.140=-0.004
σ0.006-0.004=0.001
min0.129-0.137=-0.007
max0.144-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.322-43.321=0.000
σ0.008-0.006=0.003
min43.309-43.312=-0.004
max43.334-43.330=0.005
mean417.000-421.000=-4.000
σ0.000
min417.000-421.000=-4.000
max417.000-421.000=-4.000
mean0.118-0.121=-0.003
σ0.010-0.005=0.005
min0.093-0.115=-0.022
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.305-1006.300=0.005
σ1.178-1.198=-0.020
min1005.772-1005.751=0.021
max1011.228-1011.329=-0.101
mean1057.250-1051.550=5.700
σ316.171-314.068=2.103
min569.000-600.000=-31.000
max1621.000-1648.000=-27.000
mean1.555-1.545=0.011
σ0.082-0.058=0.024
min1.464-1.482=-0.017
max1.784-1.669=0.116

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean0.399-0.404=-0.005
σ0.132-0.141=-0.009
min0.309-0.324=-0.014
max0.630-0.654=-0.024
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean0.868-0.865=0.003
σ0.091-0.092=-0.002
min0.815-0.800=0.014
max1.029-1.024=0.005
name=heavy_item.art
mean1.523-1.523=0.000
σ0.002-0.002=-0.000
min1.522
max1.526
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean0.540-0.535=0.005
σ0.050-0.049=0.001
min0.498-0.493=0.006
max0.626-0.620=0.006
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean0.842-0.824=0.017
σ0.031-0.037=-0.006
min0.816-0.797=0.019
max0.892-0.884=0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.115=-0.000
σ0.035-0.021=0.014
min964.085-964.095=-0.010
max964.171-964.147=0.024
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean0.828-0.830=-0.001
σ0.051-0.037=0.014
min0.745-0.771=-0.026
max0.868-0.859=0.009
name=cdr_enhanced_4k_loc.art
mean884.711-884.711=0.000
σ0.007-0.007=-0.000
min884.703
max884.721-884.720=0.001
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean0.633-0.668=-0.035
σ0.073-0.057=0.016
min0.535-0.612=-0.077
max0.697-0.739=-0.042

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.714-7.715=-0.000
σ0.002-0.002=0.000
min7.714
max7.718
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean3.516-4.233=-0.717
σ0.094-0.088=0.006
min3.359-4.076=-0.717
max3.861-4.580=-0.719
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=0.000
min7.662
max7.667-7.666=0.001
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean3.476-4.198=-0.723
σ0.075-0.092=-0.017
min3.343-4.047=-0.704
max3.798-4.580=-0.781
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean0.528-0.732=-0.204
σ0.013-0.018=-0.005
min0.504-0.697=-0.193
max0.609-0.827=-0.218
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean0.503-0.694=-0.191
σ0.011-0.014=-0.003
min0.479-0.660=-0.181
max0.552-0.758=-0.207

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.210-296.154=0.056
σ0.251-0.246=0.005
min295.981-295.988=-0.007
max296.878-296.827=0.051
mean1908.000-1964.000=-56.000
σ0.000
min1908.000-1964.000=-56.000
max1908.000-1964.000=-56.000
mean0.569-0.573=-0.004
σ0.055-0.043=0.011
min0.510-0.528=-0.019
max0.659-0.682=-0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.692-284.687=0.005
σ0.037-0.044=-0.007
min284.645-284.646=-0.001
max284.734-284.741=-0.007
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean0.397-0.405=-0.008
σ0.014-0.004=0.010
min0.382-0.402=-0.020
max0.412-0.411=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.081-1295.076=0.005
σ0.108-0.104=0.004
min1294.961-1294.956=0.005
max1295.212-1295.197=0.015
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean1.903-1.934=-0.031
σ0.091-0.114=-0.023
min1.805-1.800=0.005
max1.995-2.043=-0.048
iters=5
new-facts=6402
prior-facts=1
mean1539.184-1539.240=-0.056
σ6.840-6.841=-0.001
min1535.940-1536.000=-0.061
max1551.416-1551.474=-0.058
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean2.229-2.410=-0.181
σ0.189-0.263=-0.074
min2.046-2.048=-0.002
max2.506-2.682=-0.176
iters=5
new-facts=6402
prior-facts=6402
mean1856.980-1856.986=-0.006
σ0.061-0.058=0.003
min1856.898-1856.932=-0.034
max1857.062-1857.066=-0.004
mean1771.400-1800.400=-29.000
σ135.786-158.495=-22.710
min1621.000-1648.000=-27.000
max1908.000-1964.000=-56.000
mean3.030-2.907=0.122
σ0.274-0.087=0.187
min2.849-2.835=0.015
max3.513-3.030=0.483

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.243-1.160=0.083
σ0.346-0.261=0.084
min0.939-0.945=-0.006
max1.834-1.564=0.271

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.787=-0.002
σ581.213-581.213=0.000
min157.177-157.179=-0.002
max1319.604-1319.606=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean0.559-0.515=0.043
σ0.593-0.507=0.085
min0.260-0.260=-0.000
max1.448-1.276=0.171
policies=20
mean1572.088-1572.105=-0.017
σ0.362-0.356=0.007
min1571.845-1571.863=-0.018
max1572.627-1572.634=-0.007
mean920.000
σ0.000
min920.000
max920.000
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean2.635-2.628=0.007
σ0.048-0.010=0.038
min2.600-2.619=-0.019
max2.706-2.641=0.065
policies=200
mean15729.066-15729.072=-0.006
σ0.126-0.108=0.017
min15728.956-15728.995=-0.039
max15729.245-15729.229=0.016
mean9200.000
σ0.000
min9200.000
max9200.000
mean1621.000-1648.000=-27.000
σ0.000
min1621.000-1648.000=-27.000
max1621.000-1648.000=-27.000
mean26.538-26.559=-0.021
σ0.058-0.055=0.003
min26.468-26.499=-0.032
max26.595-26.628=-0.032