Compare commits

Home / Compare f94f23f7 .. 289c1fc5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.014=0.001
σ0.369-0.370=-0.001
min53.867-53.871=-0.004
max55.064-55.068=-0.004
mean417.000
σ0.000
min417.000
max417.000
mean0.139-0.139=0.000
σ0.003-0.005=-0.003
min0.136-0.132=0.004
max0.145-0.147=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.001
σ0.007-0.008=-0.001
min43.313-43.308=0.005
max43.335-43.333=0.002
mean417.000
σ0.000
min417.000
max417.000
mean0.124-0.120=0.004
σ0.004-0.004=-0.001
min0.120-0.115=0.005
max0.129-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.305-1006.307=-0.003
σ1.198-1.173=0.026
min1005.771-1005.778=-0.007
max1011.336-1011.207=0.129
mean1047.550-1056.700=-9.150
σ305.266-303.448=1.818
min587.000-600.000=-13.000
max1638.000-1454.000=184.000
mean1.558-1.569=-0.011
σ0.070-0.101=-0.031
min1.492-1.473=0.019
max1.746-1.804=-0.058

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1638.000-1454.000=184.000
σ0.000
min1638.000-1454.000=184.000
max1638.000-1454.000=184.000
mean0.396-0.417=-0.020
σ0.103-0.134=-0.032
min0.337-0.347=-0.009
max0.578-0.656=-0.079
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1638.000-1454.000=184.000
σ0.000
min1638.000-1454.000=184.000
max1638.000-1454.000=184.000
mean0.893-0.892=0.001
σ0.086-0.103=-0.017
min0.837-0.818=0.018
max1.045-1.071=-0.026
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1638.000-1454.000=184.000
σ0.000
min1638.000-1454.000=184.000
max1638.000-1454.000=184.000
mean0.545-0.542=0.004
σ0.047-0.052=-0.006
min0.504-0.502=0.002
max0.621-0.632=-0.011
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1638.000-1454.000=184.000
σ0.000
min1638.000-1454.000=184.000
max1638.000-1454.000=184.000
mean0.849-0.847=0.002
σ0.036-0.045=-0.009
min0.825-0.810=0.015
max0.912-0.922=-0.010

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.102=0.012
σ0.032-0.036=-0.004
min964.087-964.077=0.010
max964.167-964.165=0.002
mean1638.000-1454.000=184.000
σ0.000
min1638.000-1454.000=184.000
max1638.000-1454.000=184.000
mean0.838-0.834=0.004
σ0.027-0.025=0.003
min0.791-0.815=-0.024
max0.858-0.868=-0.010
name=cdr_enhanced_4k_loc.art
mean884.711-884.709=0.002
σ0.007-0.006=0.001
min884.705-884.703=0.001
max884.721-884.718=0.002
mean1638.000-1454.000=184.000
σ0.000
min1638.000-1454.000=184.000
max1638.000-1454.000=184.000
mean0.706-0.724=-0.018
σ0.042-0.019=0.023
min0.663-0.704=-0.040
max0.759-0.744=0.015

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.722-7.719=0.002
mean1638.000-1454.000=184.000
σ0.000
min1638.000-1454.000=184.000
max1638.000-1454.000=184.000
mean4.246-4.209=0.037
σ0.090-0.076=0.014
min4.117-4.085=0.032
max4.611-4.518=0.093
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1638.000-1454.000=184.000
σ0.000
min1638.000-1454.000=184.000
max1638.000-1454.000=184.000
mean4.244-4.167=0.077
σ0.077-0.074=0.003
min4.132-4.046=0.086
max4.525-4.434=0.092
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1638.000-1454.000=184.000
σ0.000
min1638.000-1454.000=184.000
max1638.000-1454.000=184.000
mean0.743-0.731=0.012
σ0.027-0.017=0.009
min0.533-0.693=-0.160
max0.824-0.849=-0.025
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1638.000-1454.000=184.000
σ0.000
min1638.000-1454.000=184.000
max1638.000-1454.000=184.000
mean0.698-0.694=0.004
σ0.014-0.014=0.000
min0.670-0.664=0.006
max0.784-0.775=0.010

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.273-296.209=0.064
σ0.220-0.246=-0.026
min296.125-296.001=0.124
max296.875-296.851=0.025
mean1907.000-1906.000=1.000
σ0.000
min1907.000-1906.000=1.000
max1907.000-1906.000=1.000
mean0.597-0.566=0.031
σ0.024-0.038=-0.014
min0.563-0.509=0.054
max0.654-0.618=0.036

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.697-284.695=0.003
σ0.035-0.035=-0.000
min284.656-284.655=0.000
max284.738-284.736=0.001
mean1638.000-1454.000=184.000
σ0.000
min1638.000-1454.000=184.000
max1638.000-1454.000=184.000
mean0.396-0.397=-0.000
σ0.011-0.009=0.001
min0.384-0.385=-0.000
max0.405-0.405=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.080-1295.074=0.005
σ0.109-0.065=0.044
min1294.961-1294.999=-0.038
max1295.214-1295.152=0.062
mean1638.000-1454.000=184.000
σ0.000
min1638.000-1454.000=184.000
max1638.000-1454.000=184.000
mean1.909-2.015=-0.106
σ0.083-0.040=0.042
min1.816-1.975=-0.159
max2.002-2.080=-0.078
iters=5
new-facts=6402
prior-facts=1
mean1539.190-1539.212=-0.022
σ6.865-6.818=0.047
min1535.936-1536.035=-0.099
max1551.466-1551.405=0.060
mean1638.000-1454.000=184.000
σ0.000
min1638.000-1454.000=184.000
max1638.000-1454.000=184.000
mean2.274-2.304=-0.029
σ0.247-0.275=-0.028
min2.027-2.109=-0.082
max2.542-2.752=-0.210
iters=5
new-facts=6402
prior-facts=6402
mean1856.991-1856.980=0.011
σ0.056-0.070=-0.014
min1856.925-1856.903=0.022
max1857.067-1857.066=0.001
mean1775.200-1744.200=31.000
σ131.336-175.332=-43.995
min1638.000-1496.000=142.000
max1907.000-1906.000=1.000
mean3.093-3.096=-0.002
σ0.423-0.199=0.224
min2.763-2.844=-0.081
max3.826-3.337=0.489

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.241-1.648=-0.407
σ0.326-0.159=0.166
min0.931-1.454=-0.523
max1.717-1.895=-0.178

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.786=0.001
σ581.212-581.212=0.000
min157.178-157.177=0.001
max1319.605-1319.604=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1638.000-1454.000=184.000
σ0.000
min1638.000-1454.000=184.000
max1638.000-1454.000=184.000
mean0.540-0.525=0.015
σ0.556-0.533=0.024
min0.259-0.258=0.001
max1.374-1.324=0.050
policies=20
mean1572.088-1572.101=-0.013
σ0.342-0.358=-0.016
min1571.867-1571.861=0.006
max1572.598-1572.633=-0.035
mean920.000
σ0.000
min920.000
max920.000
mean1638.000-1454.000=184.000
σ0.000
min1638.000-1454.000=184.000
max1638.000-1454.000=184.000
mean2.627-2.635=-0.008
σ0.022-0.021=0.000
min2.611-2.607=0.003
max2.658-2.659=-0.001
policies=200
mean15728.995-15729.048=-0.053
σ0.189-0.129=0.060
min15728.834-15728.942=-0.108
max15729.260-15729.229=0.031
mean9200.000
σ0.000
min9200.000
max9200.000
mean1638.000-1454.000=184.000
σ0.000
min1638.000-1454.000=184.000
max1638.000-1454.000=184.000
mean26.452-26.505=-0.053
σ0.011-0.153=-0.142
min26.440-26.379=0.060
max26.465-26.720=-0.255