Compare commits

Home / Compare 54173784 .. 4c524fc4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.013-54.016=-0.003
σ0.367-0.369=-0.002
min53.874-53.874=0.001
max55.057-55.065=-0.008
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.137-0.141=-0.004
σ0.003-0.004=-0.001
min0.134-0.137=-0.002
max0.144-0.148=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=0.000
σ0.007-0.008=-0.001
min43.315-43.312=0.003
max43.334-43.338=-0.003
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.120-0.122=-0.002
σ0.004-0.004=0.000
min0.115-0.118=-0.003
max0.128-0.130=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.305-1006.310=-0.005
σ1.194-1.175=0.018
min1005.770-1005.757=0.013
max1011.304-1011.236=0.068
mean1035.800-1046.750=-10.950
σ310.381-313.149=-2.768
min545.000-596.000=-51.000
max1503.000-1643.000=-140.000
mean1.556-1.542=0.013
σ0.084-0.079=0.005
min1.461-1.463=-0.001
max1.772-1.778=-0.006

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1503.000-1643.000=-140.000
σ0.000
min1503.000-1643.000=-140.000
max1503.000-1643.000=-140.000
mean0.411-0.402=0.009
σ0.117-0.129=-0.013
min0.342-0.321=0.021
max0.617-0.632=-0.015
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1503.000-1643.000=-140.000
σ0.000
min1503.000-1643.000=-140.000
max1503.000-1643.000=-140.000
mean0.884-0.881=0.003
σ0.091-0.089=0.002
min0.821-0.820=0.001
max1.041-1.035=0.006
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1503.000-1643.000=-140.000
σ0.000
min1503.000-1643.000=-140.000
max1503.000-1643.000=-140.000
mean0.539-0.540=-0.002
σ0.056-0.046=0.010
min0.493-0.502=-0.009
max0.635-0.618=0.017
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1503.000-1643.000=-140.000
σ0.000
min1503.000-1643.000=-140.000
max1503.000-1643.000=-140.000
mean0.848-0.828=0.020
σ0.036-0.042=-0.006
min0.816-0.787=0.030
max0.908-0.894=0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.102-964.113=-0.011
σ0.034-0.032=0.003
min964.077-964.086=-0.008
max964.163-964.165=-0.003
mean1503.000-1643.000=-140.000
σ0.000
min1503.000-1643.000=-140.000
max1503.000-1643.000=-140.000
mean0.823-0.843=-0.020
σ0.026-0.019=0.007
min0.789-0.812=-0.023
max0.851-0.857=-0.006
name=cdr_enhanced_4k_loc.art
mean884.710-884.711=-0.001
σ0.006-0.004=0.002
min884.703-884.705=-0.001
max884.717-884.715=0.002
mean1503.000-1643.000=-140.000
σ0.000
min1503.000-1643.000=-140.000
max1503.000-1643.000=-140.000
mean0.700-0.706=-0.005
σ0.048-0.041=0.007
min0.633-0.659=-0.026
max0.745-0.738=0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.720-7.721=-0.001
mean1503.000-1643.000=-140.000
σ0.000
min1503.000-1643.000=-140.000
max1503.000-1643.000=-140.000
mean3.679-4.243=-0.564
σ0.323-0.094=0.229
min3.361-4.092=-0.731
max4.531-4.576=-0.045
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1503.000-1643.000=-140.000
σ0.000
min1503.000-1643.000=-140.000
max1503.000-1643.000=-140.000
mean4.241-4.224=0.016
σ0.094-0.079=0.015
min4.091-4.096=-0.005
max4.521-4.511=0.011
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1503.000-1643.000=-140.000
σ0.000
min1503.000-1643.000=-140.000
max1503.000-1643.000=-140.000
mean0.726-0.730=-0.004
σ0.015-0.018=-0.003
min0.697-0.698=-0.001
max0.823-0.851=-0.028
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1503.000-1643.000=-140.000
σ0.000
min1503.000-1643.000=-140.000
max1503.000-1643.000=-140.000
mean0.694-0.694=-0.000
σ0.014-0.017=-0.002
min0.667-0.665=0.002
max0.777-0.789=-0.012

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.267-296.237=0.030
σ0.157-0.198=-0.041
min296.116-296.000=0.116
max296.657-296.745=-0.088
mean1955.000-1973.000=-18.000
σ0.000
min1955.000-1973.000=-18.000
max1955.000-1973.000=-18.000
mean0.574-0.588=-0.014
σ0.037-0.051=-0.014
min0.525-0.511=0.015
max0.646-0.697=-0.050

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.694-284.700=-0.005
σ0.045-0.029=0.016
min284.630-284.666=-0.036
max284.741-284.736=0.005
mean1503.000-1643.000=-140.000
σ0.000
min1503.000-1643.000=-140.000
max1503.000-1643.000=-140.000
mean0.387-0.397=-0.010
σ0.018-0.008=0.010
min0.358-0.387=-0.029
max0.403-0.403=0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.107-1295.057=0.050
σ0.098-0.080=0.017
min1294.997-1294.951=0.046
max1295.244-1295.152=0.092
mean1503.000-1643.000=-140.000
σ0.000
min1503.000-1643.000=-140.000
max1503.000-1643.000=-140.000
mean2.113-1.965=0.149
σ0.088-0.216=-0.128
min2.009-1.805=0.204
max2.199-2.322=-0.123
iters=5
new-facts=6402
prior-facts=1
mean1539.257-1539.186=0.071
σ6.794-6.846=-0.052
min1536.111-1535.949=0.162
max1551.409-1551.429=-0.020
mean1503.000-1643.000=-140.000
σ0.000
min1503.000-1643.000=-140.000
max1503.000-1643.000=-140.000
mean2.448-2.308=0.141
σ0.172-0.265=-0.092
min2.264-2.011=0.253
max2.661-2.651=0.011
iters=5
new-facts=6402
prior-facts=6402
mean1856.986-1856.998=-0.012
σ0.065-0.065=-0.000
min1856.912-1856.922=-0.010
max1857.062-1857.061=0.001
mean1758.000-1799.400=-41.400
σ203.463-166.117=37.346
min1503.000-1643.000=-140.000
max1955.000-1973.000=-18.000
mean2.967-2.978=-0.011
σ0.169-0.182=-0.013
min2.777-2.831=-0.054
max3.205-3.204=0.000

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.653-1.256=0.397
σ0.239-0.324=-0.085
min1.267-1.050=0.218
max1.876-1.808=0.067

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.783-447.783=0.000
σ581.212-581.212=-0.000
min157.176-157.176=0.000
max1319.602-1319.602=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1503.000-1643.000=-140.000
σ0.000
min1503.000-1643.000=-140.000
max1503.000-1643.000=-140.000
mean0.557-0.540=0.017
σ0.591-0.559=0.032
min0.260-0.258=0.003
max1.444-1.379=0.065
policies=20
mean1572.081-1572.078=0.003
σ0.355-0.359=-0.004
min1571.834-1571.834=0.000
max1572.607-1572.611=-0.004
mean920.000
σ0.000
min920.000
max920.000
mean1503.000-1643.000=-140.000
σ0.000
min1503.000-1643.000=-140.000
max1503.000-1643.000=-140.000
mean2.625-2.622=0.003
σ0.026-0.014=0.012
min2.608-2.605=0.003
max2.663-2.635=0.029
policies=200
mean15729.019-15729.025=-0.006
σ0.164-0.163=0.001
min15728.867-15728.892=-0.025
max15729.233-15729.253=-0.019
mean9200.000
σ0.000
min9200.000
max9200.000
mean1503.000-1643.000=-140.000
σ0.000
min1503.000-1643.000=-140.000
max1503.000-1643.000=-140.000
mean26.563-26.540=0.023
σ0.075-0.047=0.028
min26.475-26.482=-0.007
max26.634-26.588=0.046