Compare commits

Home / Compare 0c957669 .. 1483c8ef

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.032-54.033=-0.001
σ0.370-0.370=-0.000
min53.885-53.886=-0.001
max55.083-55.084=-0.002
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.142-0.140=0.003
σ0.010-0.005=0.005
min0.136-0.135=0.002
max0.168-0.149=0.019
cache=y
dps=1
iters=10
policies=100
mean43.383-43.384=-0.000
σ0.007-0.007=-0.000
min43.374-43.372=0.002
max43.395-43.396=-0.001
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.123-0.122=0.001
σ0.004-0.004=0.001
min0.119-0.119=-0.000
max0.130-0.129=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.327-1006.339=-0.012
σ0.907-0.860=0.048
min1005.867-1005.823=0.044
max1010.076-1009.876=0.200
mean1060.100-1053.100=7.000
σ327.066-310.201=16.865
min543.000-556.000=-13.000
max1567.000-1647.000=-80.000
mean1.557-1.538=0.019
σ0.086-0.093=-0.007
min1.464-1.408=0.056
max1.795-1.834=-0.039

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.882
σ0.002
min0.881
max0.886
mean1567.000-1647.000=-80.000
σ0.000
min1567.000-1647.000=-80.000
max1567.000-1647.000=-80.000
mean0.412-0.419=-0.007
σ0.144-0.121=0.023
min0.327-0.352=-0.025
max0.668-0.634=0.034
name=error_case.art
mean2.334
σ0.003
min2.332
max2.337
mean1567.000-1647.000=-80.000
σ0.000
min1567.000-1647.000=-80.000
max1567.000-1647.000=-80.000
mean0.887-0.885=0.002
σ0.096-0.080=0.016
min0.832-0.828=0.004
max1.057-1.020=0.037
name=heavy_item.art
mean1.521
σ0.001
min1.520
max1.523
mean1567.000-1647.000=-80.000
σ0.000
min1567.000-1647.000=-80.000
max1567.000-1647.000=-80.000
mean0.539-0.543=-0.004
σ0.048-0.045=0.003
min0.496-0.507=-0.011
max0.618-0.621=-0.003
name=nested_use.art
mean2.356
σ0.002
min2.355
max2.358
mean1567.000-1647.000=-80.000
σ0.000
min1567.000-1647.000=-80.000
max1567.000-1647.000=-80.000
mean0.836-0.829=0.007
σ0.041-0.036=0.004
min0.795-0.802=-0.007
max0.900-0.892=0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.549-963.551=-0.003
σ0.040-0.025=0.015
min963.523
max963.621-963.583=0.038
mean1567.000-1647.000=-80.000
σ0.000
min1567.000-1647.000=-80.000
max1567.000-1647.000=-80.000
mean0.842-0.832=0.010
σ0.020-0.016=0.004
min0.817-0.818=-0.001
max0.864-0.851=0.013
name=cdr_enhanced_4k_loc.art
mean884.854-884.857=-0.002
σ0.005-0.008=-0.002
min884.847
max884.861-884.867=-0.007
mean1567.000-1647.000=-80.000
σ0.000
min1567.000-1647.000=-80.000
max1567.000-1647.000=-80.000
mean0.739-0.733=0.007
σ0.004-0.011=-0.007
min0.733-0.716=0.017
max0.742-0.742=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=-0.000
min7.705
max7.712-7.713=-0.001
mean1567.000-1647.000=-80.000
σ0.000
min1567.000-1647.000=-80.000
max1567.000-1647.000=-80.000
mean4.260-3.537=0.723
σ0.087-0.096=-0.009
min4.102-3.396=0.706
max4.562-4.068=0.494
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1567.000-1647.000=-80.000
σ0.000
min1567.000-1647.000=-80.000
max1567.000-1647.000=-80.000
mean4.235-3.798=0.436
σ0.059-0.362=-0.303
min4.105-3.359=0.746
max4.401-4.446=-0.044
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1567.000-1647.000=-80.000
σ0.000
min1567.000-1647.000=-80.000
max1567.000-1647.000=-80.000
mean0.600-0.753=-0.152
σ0.098-0.026=0.073
min0.517-0.551=-0.034
max0.869-0.860=0.008
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1567.000-1647.000=-80.000
σ0.000
min1567.000-1647.000=-80.000
max1567.000-1647.000=-80.000
mean0.511-0.717=-0.207
σ0.013-0.014=-0.001
min0.491-0.688=-0.197
max0.601-0.785=-0.185

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.468-295.532=-0.064
σ0.216-0.220=-0.004
min295.362-295.405=-0.043
max296.075-296.141=-0.065
mean2065.000-2027.000=38.000
σ0.000
min2065.000-2027.000=38.000
max2065.000-2027.000=38.000
mean0.540-0.563=-0.023
σ0.036-0.040=-0.004
min0.497-0.502=-0.004
max0.593-0.602=-0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.247-285.253=-0.006
σ0.043-0.040=0.003
min285.190-285.201=-0.011
max285.296-285.295=0.001
mean1567.000-1647.000=-80.000
σ0.000
min1567.000-1647.000=-80.000
max1567.000-1647.000=-80.000
mean0.399-0.391=0.009
σ0.010-0.009=0.000
min0.390-0.383=0.007
max0.410-0.403=0.008
iters=5
new-facts=1
prior-facts=6402
mean1295.195-1295.207=-0.013
σ0.109-0.115=-0.006
min1295.077-1295.082=-0.005
max1295.328-1295.378=-0.050
mean1567.000-1647.000=-80.000
σ0.000
min1567.000-1647.000=-80.000
max1567.000-1647.000=-80.000
mean1.926-1.883=0.043
σ0.116-0.096=0.020
min1.820-1.813=0.007
max2.060-2.047=0.012
iters=5
new-facts=6402
prior-facts=1
mean1539.445-1539.366=0.079
σ6.839-6.852=-0.014
min1536.140-1536.079=0.061
max1551.674-1551.618=0.056
mean1567.000-1647.000=-80.000
σ0.000
min1567.000-1647.000=-80.000
max1567.000-1647.000=-80.000
mean2.457-2.290=0.167
σ0.278-0.120=0.158
min1.997-2.122=-0.124
max2.644-2.425=0.219
iters=5
new-facts=6402
prior-facts=6402
mean1857.113-1857.108=0.004
σ0.060-0.057=0.003
min1857.044-1857.049=-0.005
max1857.189-1857.180=0.008
mean1776.800-1787.800=-11.000
σ211.207-164.638=46.568
min1567.000-1647.000=-80.000
max2065.000-2027.000=38.000
mean2.886-3.052=-0.166
σ0.083-0.249=-0.167
min2.770-2.825=-0.055
max2.991-3.453=-0.462

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.630-1.364=0.266
σ0.251-0.314=-0.063
min1.317-1.116=0.201
max1.913-1.884=0.028

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.291-445.289=0.002
σ580.424-580.422=0.001
min155.077-155.077=-0.000
max1315.926-1315.922=0.004
mean96.250
σ8.500
min92.000
max109.000
mean1567.000-1647.000=-80.000
σ0.000
min1567.000-1647.000=-80.000
max1567.000-1647.000=-80.000
mean0.541-0.560=-0.018
σ0.557-0.603=-0.046
min0.247-0.255=-0.008
max1.376-1.463=-0.087
policies=20
mean1551.037-1551.036=0.001
σ0.321-0.330=-0.009
min1550.822-1550.810=0.012
max1551.515-1551.526=-0.011
mean920.000
σ0.000
min920.000
max920.000
mean1567.000-1647.000=-80.000
σ0.000
min1567.000-1647.000=-80.000
max1567.000-1647.000=-80.000
mean2.597-2.579=0.018
σ0.031-0.015=0.016
min2.561-2.565=-0.004
max2.631-2.596=0.035
policies=200
mean15518.560-15518.583=-0.023
σ0.108-0.067=0.040
min15518.488-15518.509=-0.021
max15518.721-15518.665=0.055
mean9200.000
σ0.000
min9200.000
max9200.000
mean1567.000-1647.000=-80.000
σ0.000
min1567.000-1647.000=-80.000
max1567.000-1647.000=-80.000
mean26.152-26.188=-0.036
σ0.030-0.123=-0.093
min26.124-26.116=0.008
max26.187-26.372=-0.184