Compare commits

Home / Compare 671788d8 .. 2cac975d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.030-54.057=-0.027
σ0.368-0.368=0.000
min53.885-53.917=-0.032
max55.077-55.104=-0.027
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.136-0.139=-0.003
σ0.004-0.005=-0.001
min0.131-0.132=-0.001
max0.142-0.146=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.382-43.396=-0.014
σ0.007-0.008=-0.001
min43.373-43.388=-0.015
max43.392-43.414=-0.022
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.122-0.123=-0.001
σ0.005-0.004=0.001
min0.115-0.120=-0.004
max0.128-0.130=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.332-1006.960=-0.628
σ0.876-0.878=-0.001
min1005.834-1006.463=-0.630
max1009.964-1010.595=-0.631
mean1051.400-1049.300=2.100
σ308.087-313.189=-5.102
min575.000-563.000=12.000
max1651.000-1648.000=3.000
mean1.542-1.536=0.005
σ0.061-0.059=0.001
min1.474-1.470=0.004
max1.653-1.671=-0.018

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.003=-0.000
min0.881-0.882=-0.000
max0.886-0.887=-0.001
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean0.412-0.411=0.001
σ0.135-0.124=0.011
min0.335-0.337=-0.002
max0.651-0.630=0.021
name=error_case.art
mean2.333-2.339=-0.005
σ0.003
min2.332-2.337=-0.005
max2.337-2.342=-0.005
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean0.881-0.879=0.002
σ0.085-0.099=-0.013
min0.825-0.810=0.015
max1.030-1.049=-0.019
name=heavy_item.art
mean1.522-1.524=-0.002
σ0.002-0.002=-0.000
min1.520-1.522=-0.002
max1.524-1.526=-0.002
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean0.536-0.525=0.011
σ0.048-0.053=-0.004
min0.502-0.487=0.016
max0.615-0.617=-0.002
name=nested_use.art
mean2.356-2.361=-0.006
σ0.002-0.002=0.001
min2.355-2.360=-0.005
max2.360-2.364=-0.004
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean0.831-0.845=-0.014
σ0.040-0.045=-0.005
min0.806-0.805=0.001
max0.901-0.918=-0.017

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-964.838=-1.286
σ0.025-0.035=-0.010
min963.523-964.810=-1.287
max963.586-964.897=-1.311
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean0.810-0.835=-0.025
σ0.025-0.034=-0.009
min0.782-0.781=0.000
max0.848-0.863=-0.015
name=cdr_enhanced_4k_loc.art
mean884.856-885.512=-0.657
σ0.006-0.007=-0.001
min884.847-885.505=-0.658
max884.863-885.522=-0.659
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean0.691-0.737=-0.046
σ0.066-0.010=0.057
min0.611-0.726=-0.115
max0.740-0.749=-0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.716=-0.010
σ0.002-0.002=-0.000
min7.705-7.715=-0.010
max7.709-7.721=-0.012
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean4.200-3.986=0.214
σ0.073-0.349=-0.276
min3.905-3.405=0.500
max4.434-4.491=-0.057
name=record_render_large_syntax_err.art
mean7.655-7.665=-0.010
σ0.002
min7.654-7.664=-0.010
max7.658-7.668=-0.010
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean4.205-3.494=0.712
σ0.078-0.077=0.000
min4.054-3.377=0.676
max4.491-3.702=0.789
name=record_render_success.art
mean2.288-2.291=-0.003
σ0.002
min2.287-2.290=-0.003
max2.291-2.294=-0.003
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean0.744-0.691=0.053
σ0.021-0.093=-0.072
min0.614-0.515=0.099
max0.841-0.850=-0.009
name=record_render_syntax_err.art
mean2.163-2.166=-0.002
σ0.002
min2.163-2.165=-0.002
max2.166-2.169=-0.002
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean0.709-0.505=0.205
σ0.015-0.012=0.002
min0.679-0.482=0.196
max0.786-0.549=0.237

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.841-295.384=0.457
σ0.284-0.297=-0.013
min295.627-295.175=0.451
max296.624-296.188=0.436
mean1920.000-1896.000=24.000
σ0.000
min1920.000-1896.000=24.000
max1920.000-1896.000=24.000
mean0.598-0.579=0.020
σ0.036-0.052=-0.016
min0.526-0.502=0.024
max0.677-0.689=-0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.253-285.389=-0.136
σ0.038-0.032=0.006
min285.208-285.348=-0.139
max285.293-285.434=-0.141
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean0.396-0.388=0.008
σ0.011-0.009=0.002
min0.383-0.381=0.002
max0.407-0.403=0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.186-1295.782=-0.596
σ0.102-0.118=-0.016
min1295.072-1295.661=-0.589
max1295.303-1295.933=-0.630
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean1.916-1.921=-0.005
σ0.126-0.106=0.020
min1.802-1.803=-0.000
max2.081-2.039=0.042
iters=5
new-facts=6402
prior-facts=1
mean1538.093-1539.906=-1.813
σ4.073-6.847=-2.774
min1536.022-1536.627=-0.605
max1545.369-1552.152=-6.783
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean2.410-2.227=0.183
σ0.376-0.275=0.101
min2.057-2.029=0.028
max2.927-2.684=0.243
iters=5
new-facts=6402
prior-facts=6402
mean1857.103-1857.682=-0.579
σ0.058-0.070=-0.012
min1857.043-1857.593=-0.550
max1857.178-1857.770=-0.592
mean1779.000-1767.800=11.200
σ135.283-122.304=12.979
min1651.000-1648.000=3.000
max1920.000-1896.000=24.000
mean2.904-3.017=-0.114
σ0.159-0.177=-0.018
min2.679-2.850=-0.171
max3.106-3.284=-0.178

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.354-1.200=0.154
σ0.270-0.378=-0.109
min1.116-0.939=0.176
max1.818-1.850=-0.032

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.609-445.708=-2.098
σ577.066-580.934=-3.868
min155.076-155.239=-0.163
max1309.208-1317.108=-7.901
mean96.250
σ8.500
min92.000
max109.000
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean0.548-0.546=0.002
σ0.568-0.573=-0.005
min0.263-0.257=0.006
max1.400-1.406=-0.005
policies=20
mean1551.035-1552.658=-1.623
σ0.331-0.331=0.001
min1550.816-1552.428=-1.611
max1551.528-1553.149=-1.621
mean920.000
σ0.000
min920.000
max920.000
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean2.601-2.586=0.015
σ0.008-0.020=-0.012
min2.593-2.561=0.031
max2.610-2.605=0.005
policies=200
mean15518.462-15534.624=-16.163
σ0.080-0.112=-0.031
min15518.342-15534.531=-16.189
max15518.515-15534.787=-16.272
mean9200.000
σ0.000
min9200.000
max9200.000
mean1651.000-1648.000=3.000
σ0.000
min1651.000-1648.000=3.000
max1651.000-1648.000=3.000
mean26.220-26.166=0.054
σ0.087-0.158=-0.071
min26.151-26.053=0.098
max26.348-26.400=-0.052