Compare commits

Home / Compare d1357267 .. 1ee78ee1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.014=0.001
σ0.370-0.369=0.001
min53.872-53.867=0.005
max55.067-55.062=0.004
mean415.000-414.700=0.300
σ0.000-0.483=-0.483
min415.000-414.000=1.000
max415.000
mean0.141-0.140=0.001
σ0.004-0.004=0.001
min0.136-0.136=0.000
max0.146-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.321-43.323=-0.001
σ0.006-0.006=0.000
min43.313-43.313=0.000
max43.335-43.332=0.003
mean415.000
σ0.000
min415.000
max415.000
mean0.122-0.117=0.005
σ0.004-0.003=0.001
min0.119-0.114=0.005
max0.128-0.121=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.306-1006.305=0.001
σ1.223-1.170=0.052
min1005.777-1005.769=0.007
max1011.440-1011.208=0.233
mean1047.700-1054.200=-6.500
σ305.196-303.029=2.167
min593.000-595.000=-2.000
max1640.000-1451.000=189.000
mean1.572-1.556=0.017
σ0.111-0.080=0.031
min1.504-1.484=0.020
max1.986-1.747=0.240

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1640.000-1451.000=189.000
σ0.000
min1640.000-1451.000=189.000
max1640.000-1451.000=189.000
mean0.411-0.413=-0.002
σ0.144-0.125=0.019
min0.325-0.340=-0.015
max0.666-0.635=0.031
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1640.000-1451.000=189.000
σ0.000
min1640.000-1451.000=189.000
max1640.000-1451.000=189.000
mean0.893-0.907=-0.014
σ0.094-0.113=-0.018
min0.823-0.839=-0.016
max1.057-1.105=-0.048
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1640.000-1451.000=189.000
σ0.000
min1640.000-1451.000=189.000
max1640.000-1451.000=189.000
mean0.543-0.541=0.002
σ0.057-0.062=-0.005
min0.500-0.484=0.016
max0.640-0.647=-0.007
name=nested_use.art
mean2.360-2.360=0.000
σ0.002-0.002=-0.000
min2.359
max2.363
mean1640.000-1451.000=189.000
σ0.000
min1640.000-1451.000=189.000
max1640.000-1451.000=189.000
mean0.849-0.837=0.011
σ0.049-0.030=0.019
min0.797-0.814=-0.018
max0.923-0.889=0.035

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.097=0.018
σ0.033-0.025=0.008
min964.087-964.077=0.010
max964.170-964.138=0.032
mean1640.000-1451.000=189.000
σ0.000
min1640.000-1451.000=189.000
max1640.000-1451.000=189.000
mean0.818-0.829=-0.012
σ0.059-0.023=0.036
min0.728-0.798=-0.070
max0.862-0.853=0.009
name=cdr_enhanced_4k_loc.art
mean884.712-884.710=0.002
σ0.008-0.006=0.002
min884.705-884.703=0.001
max884.723-884.716=0.006
mean1640.000-1451.000=189.000
σ0.000
min1640.000-1451.000=189.000
max1640.000-1451.000=189.000
mean0.710-0.724=-0.014
σ0.035-0.037=-0.003
min0.653-0.659=-0.006
max0.738-0.750=-0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.719=-0.001
mean1640.000-1451.000=189.000
σ0.000
min1640.000-1451.000=189.000
max1640.000-1451.000=189.000
mean4.213-4.247=-0.035
σ0.086-0.094=-0.008
min4.058-4.088=-0.030
max4.737-4.587=0.150
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.666
mean1640.000-1451.000=189.000
σ0.000
min1640.000-1451.000=189.000
max1640.000-1451.000=189.000
mean4.194-4.228=-0.033
σ0.075-0.073=0.002
min4.067-4.072=-0.005
max4.449-4.464=-0.015
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1640.000-1451.000=189.000
σ0.000
min1640.000-1451.000=189.000
max1640.000-1451.000=189.000
mean0.731-0.729=0.001
σ0.018-0.019=-0.001
min0.704-0.697=0.007
max0.852-0.859=-0.007
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1640.000-1451.000=189.000
σ0.000
min1640.000-1451.000=189.000
max1640.000-1451.000=189.000
mean0.700-0.694=0.006
σ0.015-0.025=-0.010
min0.672-0.497=0.175
max0.788-0.779=0.008

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.180-296.304=-0.125
σ0.217-0.230=-0.012
min296.051-296.136=-0.085
max296.778-296.936=-0.158
mean1901.000-1908.000=-7.000
σ0.000
min1901.000-1908.000=-7.000
max1901.000-1908.000=-7.000
mean0.588-0.576=0.012
σ0.042-0.048=-0.006
min0.513-0.514=-0.001
max0.673-0.677=-0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.689-284.697=-0.007
σ0.035-0.035=0.000
min284.641-284.652=-0.011
max284.728-284.739=-0.011
mean1640.000-1451.000=189.000
σ0.000
min1640.000-1451.000=189.000
max1640.000-1451.000=189.000
mean0.396-0.397=-0.001
σ0.011-0.010=0.001
min0.383-0.386=-0.003
max0.404-0.405=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.077-1295.089=-0.012
σ0.110-0.064=0.045
min1294.960-1295.011=-0.050
max1295.215-1295.170=0.045
mean1640.000-1451.000=189.000
σ0.000
min1640.000-1451.000=189.000
max1640.000-1451.000=189.000
mean1.918-2.067=-0.149
σ0.100-0.053=0.047
min1.812-2.005=-0.193
max2.039-2.140=-0.102
iters=5
new-facts=6402
prior-facts=1
mean1539.187-1539.174=0.014
σ6.848-6.859=-0.010
min1535.941-1535.937=0.004
max1551.435-1551.439=-0.005
mean1640.000-1451.000=189.000
σ0.000
min1640.000-1451.000=189.000
max1640.000-1451.000=189.000
mean2.252-2.206=0.046
σ0.255-0.170=0.085
min2.045-1.969=0.076
max2.621-2.377=0.244
iters=5
new-facts=6402
prior-facts=6402
mean1856.988-1856.980=0.007
σ0.051-0.080=-0.029
min1856.944-1856.865=0.079
max1857.068-1857.067=0.001
mean1769.600-1746.800=22.800
σ128.910-175.252=-46.342
min1640.000-1498.000=142.000
max1901.000-1908.000=-7.000
mean3.056-3.126=-0.070
σ0.276-0.253=0.024
min2.837-2.856=-0.020
max3.538-3.497=0.041

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.191-1.757=-0.567
σ0.285-0.091=0.195
min0.934-1.609=-0.675
max1.659-1.851=-0.192

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.784-447.786=-0.001
σ581.212-581.213=-0.001
min157.177-157.176=0.001
max1319.603-1319.605=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1640.000-1451.000=189.000
σ0.000
min1640.000-1451.000=189.000
max1640.000-1451.000=189.000
mean0.536-0.550=-0.014
σ0.560-0.579=-0.020
min0.253-0.259=-0.007
max1.375-1.418=-0.043
policies=20
mean1572.083-1572.099=-0.016
σ0.356-0.355=0.002
min1571.844-1571.857=-0.013
max1572.613-1572.626=-0.013
mean920.000
σ0.000
min920.000
max920.000
mean1640.000-1451.000=189.000
σ0.000
min1640.000-1451.000=189.000
max1640.000-1451.000=189.000
mean2.629-2.623=0.006
σ0.025-0.015=0.010
min2.601-2.607=-0.006
max2.661-2.640=0.021
policies=200
mean15728.982-15729.041=-0.059
σ0.141-0.020=0.121
min15728.829-15729.015=-0.186
max15729.169-15729.063=0.106
mean9200.000
σ0.000
min9200.000
max9200.000
mean1640.000-1451.000=189.000
σ0.000
min1640.000-1451.000=189.000
max1640.000-1451.000=189.000
mean26.537-26.519=0.017
σ0.027-0.049=-0.021
min26.497-26.461=0.037
max26.559-26.564=-0.004