Compare commits

Home / Compare d237172e .. 0f130d18

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.055=0.000
σ0.368-0.369=-0.001
min53.910-53.906=0.004
max55.101-55.105=-0.004
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.140-0.139=0.001
σ0.004-0.004=-0.000
min0.136-0.135=0.002
max0.147-0.148=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.396=-0.002
σ0.007-0.006=0.001
min43.382-43.386=-0.003
max43.403-43.406=-0.003
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.122-0.126=-0.004
σ0.004-0.012=-0.009
min0.118-0.115=0.003
max0.128-0.149=-0.021

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.981-1006.984=-0.003
σ0.861-0.851=0.009
min1006.482-1006.478=0.003
max1010.535-1010.485=0.050
mean1051.600-1041.800=9.800
σ310.935-307.156=3.779
min555.000-552.000=3.000
max1649.000-1658.000=-9.000
mean1.547-1.522=0.024
σ0.071-0.092=-0.022
min1.482-1.448=0.034
max1.761-1.778=-0.018

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1649.000-1658.000=-9.000
σ0.000
min1649.000-1658.000=-9.000
max1649.000-1658.000=-9.000
mean0.421-0.414=0.007
σ0.142-0.129=0.013
min0.344-0.328=0.016
max0.674-0.642=0.033
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1649.000-1658.000=-9.000
σ0.000
min1649.000-1658.000=-9.000
max1649.000-1658.000=-9.000
mean0.875-0.882=-0.007
σ0.084-0.089=-0.005
min0.815-0.813=0.002
max1.022-1.036=-0.014
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1649.000-1658.000=-9.000
σ0.000
min1649.000-1658.000=-9.000
max1649.000-1658.000=-9.000
mean0.533-0.536=-0.003
σ0.052-0.054=-0.003
min0.477-0.490=-0.014
max0.617-0.629=-0.012
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1649.000-1658.000=-9.000
σ0.000
min1649.000-1658.000=-9.000
max1649.000-1658.000=-9.000
mean0.843-0.847=-0.004
σ0.039-0.039=-0.000
min0.815-0.823=-0.008
max0.909-0.916=-0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.836-964.830=0.006
σ0.031-0.024=0.007
min964.811-964.802=0.009
max964.889-964.860=0.030
mean1649.000-1658.000=-9.000
σ0.000
min1649.000-1658.000=-9.000
max1649.000-1658.000=-9.000
mean0.804-0.829=-0.025
σ0.018-0.019=-0.000
min0.777-0.811=-0.033
max0.826-0.852=-0.026
name=cdr_enhanced_4k_loc.art
mean885.512-885.513=-0.001
σ0.004-0.006=-0.002
min885.508-885.504=0.003
max885.517-885.518=-0.001
mean1649.000-1658.000=-9.000
σ0.000
min1649.000-1658.000=-9.000
max1649.000-1658.000=-9.000
mean0.693-0.705=-0.012
σ0.063-0.038=0.025
min0.588-0.662=-0.073
max0.748-0.743=0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.722=-0.001
mean1649.000-1658.000=-9.000
σ0.000
min1649.000-1658.000=-9.000
max1649.000-1658.000=-9.000
mean4.197-4.127=0.070
σ0.075-0.286=-0.210
min4.029-3.433=0.596
max4.505-4.681=-0.176
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1649.000-1658.000=-9.000
σ0.000
min1649.000-1658.000=-9.000
max1649.000-1658.000=-9.000
mean4.198-3.522=0.677
σ0.073-0.111=-0.039
min4.059-3.346=0.713
max4.421-4.293=0.129
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1649.000-1658.000=-9.000
σ0.000
min1649.000-1658.000=-9.000
max1649.000-1658.000=-9.000
mean0.738-0.744=-0.006
σ0.019-0.017=0.002
min0.703-0.706=-0.003
max0.870-0.849=0.021
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1649.000-1658.000=-9.000
σ0.000
min1649.000-1658.000=-9.000
max1649.000-1658.000=-9.000
mean0.696-0.704=-0.007
σ0.014-0.015=-0.001
min0.671-0.672=-0.001
max0.781-0.777=0.004

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.480-295.504=-0.024
σ0.259-0.205=0.054
min295.322-295.290=0.032
max296.201-296.011=0.190
mean2019.000-1890.000=129.000
σ0.000
min2019.000-1890.000=129.000
max2019.000-1890.000=129.000
mean0.532-0.581=-0.050
σ0.039-0.038=0.000
min0.495-0.520=-0.024
max0.598-0.651=-0.053

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-285.413=-0.000
σ0.043-0.033=0.010
min285.354-285.370=-0.016
max285.455-285.447=0.008
mean1649.000-1658.000=-9.000
σ0.000
min1649.000-1658.000=-9.000
max1649.000-1658.000=-9.000
mean0.388-0.386=0.002
σ0.008-0.007=0.001
min0.380-0.379=0.000
max0.399-0.395=0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.806-1295.799=0.007
σ0.112-0.114=-0.002
min1295.677-1295.682=-0.005
max1295.947-1295.946=0.001
mean1649.000-1658.000=-9.000
σ0.000
min1649.000-1658.000=-9.000
max1649.000-1658.000=-9.000
mean1.876-1.898=-0.022
σ0.086-0.084=0.002
min1.805-1.805=-0.000
max2.018-1.985=0.033
iters=5
new-facts=6402
prior-facts=1
mean1539.916-1539.919=-0.003
σ6.867-6.878=-0.011
min1536.654-1536.674=-0.020
max1552.197-1552.219=-0.022
mean1649.000-1658.000=-9.000
σ0.000
min1649.000-1658.000=-9.000
max1649.000-1658.000=-9.000
mean2.210-2.248=-0.038
σ0.180-0.246=-0.066
min2.037-2.054=-0.017
max2.429-2.562=-0.133
iters=5
new-facts=6402
prior-facts=6402
mean1857.708-1857.708=-0.000
σ0.055-0.059=-0.004
min1857.649-1857.644=0.004
max1857.776-1857.792=-0.015
mean1776.000-1778.400=-2.400
σ162.779-114.703=48.076
min1649.000-1658.000=-9.000
max2019.000-1890.000=129.000
mean3.028-3.044=-0.016
σ0.332-0.256=0.076
min2.828-2.837=-0.009
max3.613-3.476=0.137

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.315-1.411=-0.096
σ0.320-0.275=0.045
min1.104-1.103=0.001
max1.872-1.827=0.045

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.738=0.003
σ580.934-580.934=0.001
min155.272-155.268=0.004
max1317.142-1317.138=0.004
mean96.250
σ8.500
min92.000
max109.000
mean1649.000-1658.000=-9.000
σ0.000
min1649.000-1658.000=-9.000
max1649.000-1658.000=-9.000
mean0.526-0.521=0.005
σ0.529-0.528=0.001
min0.256-0.254=0.002
max1.320-1.313=0.006
policies=20
mean1552.986-1552.974=0.012
σ0.323-0.328=-0.006
min1552.761-1552.750=0.011
max1553.465-1553.462=0.003
mean920.000
σ0.000
min920.000
max920.000
mean1649.000-1658.000=-9.000
σ0.000
min1649.000-1658.000=-9.000
max1649.000-1658.000=-9.000
mean2.586-2.585=0.001
σ0.018-0.006=0.013
min2.568-2.582=-0.014
max2.604-2.593=0.011
policies=200
mean15537.947-15538.054=-0.108
σ0.070-0.091=-0.021
min15537.875-15537.965=-0.089
max15538.014-15538.182=-0.168
mean9200.000
σ0.000
min9200.000
max9200.000
mean1649.000-1658.000=-9.000
σ0.000
min1649.000-1658.000=-9.000
max1649.000-1658.000=-9.000
mean26.096-26.117=-0.021
σ0.184-0.132=0.053
min25.939-25.995=-0.056
max26.363-26.243=0.120