Compare commits

Home / Compare fc6a73a3 .. 4f1dfb2a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.054=0.003
σ0.368-0.368=0.000
min53.914-53.908=0.006
max55.104-55.100=0.004
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.137-0.138=-0.000
σ0.006-0.010=-0.004
min0.130-0.120=0.010
max0.146-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.396-43.394=0.002
σ0.006-0.007=-0.001
min43.386-43.389=-0.003
max43.406-43.408=-0.002
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.125-0.121=0.003
σ0.005-0.004=0.001
min0.120-0.115=0.005
max0.135-0.128=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.961-1007.003=-0.042
σ0.867-1.198=-0.331
min1006.462-1006.432=0.030
max1010.547-1012.028=-1.480
mean1048.750-1054.050=-5.300
σ318.009-308.046=9.963
min546.000-579.000=-33.000
max1650.000-1646.000=4.000
mean1.538-1.518=0.020
σ0.095-0.060=0.036
min1.384-1.462=-0.078
max1.785-1.711=0.074

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1650.000-1646.000=4.000
σ0.000
min1650.000-1646.000=4.000
max1650.000-1646.000=4.000
mean0.424-0.423=0.002
σ0.142-0.146=-0.004
min0.339-0.346=-0.007
max0.677-0.683=-0.006
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1650.000-1646.000=4.000
σ0.000
min1650.000-1646.000=4.000
max1650.000-1646.000=4.000
mean0.912-0.879=0.034
σ0.097-0.092=0.005
min0.848-0.804=0.044
max1.083-1.034=0.049
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1650.000-1646.000=4.000
σ0.000
min1650.000-1646.000=4.000
max1650.000-1646.000=4.000
mean0.540-0.540=0.000
σ0.050-0.045=0.006
min0.512-0.493=0.019
max0.630-0.611=0.019
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1650.000-1646.000=4.000
σ0.000
min1650.000-1646.000=4.000
max1650.000-1646.000=4.000
mean0.863-0.862=0.001
σ0.036-0.040=-0.004
min0.838-0.827=0.011
max0.925-0.931=-0.006

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.838=0.001
σ0.034-0.034=-0.000
min964.810-964.809=0.000
max964.894-964.895=-0.001
mean1650.000-1646.000=4.000
σ0.000
min1650.000-1646.000=4.000
max1650.000-1646.000=4.000
mean0.807-0.827=-0.020
σ0.051-0.030=0.021
min0.739-0.795=-0.056
max0.854-0.862=-0.009
name=cdr_enhanced_4k_loc.art
mean885.511-885.512=-0.001
σ0.007-0.007=0.000
min885.505-885.504=0.001
max885.522-885.521=0.002
mean1650.000-1646.000=4.000
σ0.000
min1650.000-1646.000=4.000
max1650.000-1646.000=4.000
mean0.690-0.718=-0.028
σ0.045-0.033=0.012
min0.635-0.676=-0.040
max0.735-0.746=-0.011

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.002
mean1650.000-1646.000=4.000
σ0.000
min1650.000-1646.000=4.000
max1650.000-1646.000=4.000
mean4.238-4.245=-0.008
σ0.099-0.089=0.009
min3.803-4.103=-0.300
max4.552-4.629=-0.077
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1650.000-1646.000=4.000
σ0.000
min1650.000-1646.000=4.000
max1650.000-1646.000=4.000
mean4.220-4.249=-0.028
σ0.063-0.074=-0.011
min4.117-4.135=-0.018
max4.468-4.549=-0.081
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1650.000-1646.000=4.000
σ0.000
min1650.000-1646.000=4.000
max1650.000-1646.000=4.000
mean0.751-0.752=-0.001
σ0.018-0.016=0.002
min0.723-0.722=0.001
max0.868-0.853=0.015
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1650.000-1646.000=4.000
σ0.000
min1650.000-1646.000=4.000
max1650.000-1646.000=4.000
mean0.712-0.714=-0.003
σ0.015-0.018=-0.003
min0.686-0.640=0.046
max0.786-0.792=-0.006

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.492-296.939=-1.448
σ0.264-0.246=0.018
min295.244-296.771=-1.527
max296.175-297.619=-1.444
mean2018.000-2030.000=-12.000
σ0.000
min2018.000-2030.000=-12.000
max2018.000-2030.000=-12.000
mean0.550-0.545=0.006
σ0.041-0.037=0.004
min0.502-0.507=-0.005
max0.598-0.584=0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.390-286.823=-1.433
σ0.034-0.040=-0.006
min285.342-286.768=-1.427
max285.424-286.865=-1.441
mean1650.000-1646.000=4.000
σ0.000
min1650.000-1646.000=4.000
max1650.000-1646.000=4.000
mean0.391-0.395=-0.004
σ0.005-0.007=-0.001
min0.383-0.387=-0.004
max0.396-0.401=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.759-1297.253=-1.495
σ0.086-0.106=-0.019
min1295.656-1297.095=-1.440
max1295.870-1297.373=-1.503
mean1650.000-1646.000=4.000
σ0.000
min1650.000-1646.000=4.000
max1650.000-1646.000=4.000
mean1.847-2.216=-0.369
σ0.056-0.109=-0.053
min1.799-2.053=-0.253
max1.921-2.336=-0.415
iters=5
new-facts=6402
prior-facts=1
mean1539.896-1541.377=-1.481
σ6.858-6.793=0.065
min1536.598-1538.225=-1.627
max1552.158-1553.528=-1.370
mean1650.000-1646.000=4.000
σ0.000
min1650.000-1646.000=4.000
max1650.000-1646.000=4.000
mean2.289-2.332=-0.043
σ0.182-0.260=-0.078
min2.135-2.140=-0.005
max2.589-2.777=-0.188
iters=5
new-facts=6402
prior-facts=6402
mean1857.688-1859.118=-1.430
σ0.067-0.065=0.003
min1857.610-1859.024=-1.414
max1857.775-1859.190=-1.415
mean1767.200-1782.800=-15.600
σ156.516-167.096=-10.581
min1650.000-1646.000=4.000
max2018.000-2030.000=-12.000
mean2.913-2.898=0.015
σ0.063-0.100=-0.036
min2.838-2.789=0.049
max2.977-3.035=-0.058

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.224-1.257=-0.034
σ0.328-0.322=0.006
min0.946-0.946=0.001
max1.776-1.790=-0.014

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.708-448.820=-3.112
σ580.934-581.372=-0.439
min155.239-158.130=-2.891
max1317.108-1320.878=-3.770
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1646.000=4.000
σ0.000
min1650.000-1646.000=4.000
max1650.000-1646.000=4.000
mean0.551-0.553=-0.001
σ0.576-0.578=-0.002
min0.259-0.260=-0.002
max1.416-1.420=-0.004
policies=20
mean1552.659-1581.619=-28.961
σ0.327-0.360=-0.033
min1552.431-1581.379=-28.948
max1553.144-1582.155=-29.012
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1646.000=4.000
σ0.000
min1650.000-1646.000=4.000
max1650.000-1646.000=4.000
mean2.591-2.632=-0.040
σ0.001-0.017=-0.016
min2.590-2.613=-0.023
max2.592-2.652=-0.060
policies=200
mean15534.652-15824.145=-289.493
σ0.196-0.118=0.078
min15534.529-15824.046=-289.517
max15534.944-15824.300=-289.356
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1646.000=4.000
σ0.000
min1650.000-1646.000=4.000
max1650.000-1646.000=4.000
mean26.245-26.655=-0.410
σ0.114-0.146=-0.032
min26.144-26.516=-0.372
max26.384-26.817=-0.432