Compare commits

Home / Compare 73a52d85 .. d3823cd3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-53.963=0.093
σ0.368-0.370=-0.002
min53.920-53.828=0.092
max55.104-55.016=0.088
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.140-0.138=0.003
σ0.005-0.006=-0.001
min0.132-0.130=0.003
max0.149-0.145=0.004
cache=y
dps=1
iters=10
policies=100
mean43.394-43.322=0.072
σ0.006-0.007=-0.000
min43.384-43.315=0.068
max43.405-43.336=0.069
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.120-0.122=-0.002
σ0.001-0.004=-0.003
min0.118-0.118=0.000
max0.122-0.129=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1006.512=0.493
σ1.190-1.240=-0.050
min1006.439-1005.980=0.459
max1011.993-1011.707=0.286
mean1046.700-1061.050=-14.350
σ314.138-319.585=-5.447
min572.000-548.000=24.000
max1640.000-1519.000=121.000
mean1.555-1.551=0.005
σ0.078-0.165=-0.088
min1.470-1.361=0.110
max1.757-2.151=-0.394

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1640.000-1519.000=121.000
σ0.000
min1640.000-1519.000=121.000
max1640.000-1519.000=121.000
mean0.408-0.458=-0.050
σ0.126-0.141=-0.015
min0.330-0.360=-0.030
max0.632-0.705=-0.073
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1640.000-1519.000=121.000
σ0.000
min1640.000-1519.000=121.000
max1640.000-1519.000=121.000
mean0.883-0.886=-0.003
σ0.093-0.108=-0.015
min0.812-0.807=0.005
max1.044-1.076=-0.032
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1640.000-1519.000=121.000
σ0.000
min1640.000-1519.000=121.000
max1640.000-1519.000=121.000
mean0.539-0.525=0.014
σ0.045-0.044=0.002
min0.506-0.480=0.026
max0.612-0.592=0.020
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1640.000-1519.000=121.000
σ0.000
min1640.000-1519.000=121.000
max1640.000-1519.000=121.000
mean0.854-0.850=0.004
σ0.041-0.039=0.002
min0.820-0.823=-0.003
max0.926-0.918=0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.837-964.830=0.007
σ0.037-0.039=-0.002
min964.807-964.806=0.002
max964.898-964.898=0.000
mean1640.000-1519.000=121.000
σ0.000
min1640.000-1519.000=121.000
max1640.000-1519.000=121.000
mean0.791-0.795=-0.004
σ0.044-0.089=-0.045
min0.732-0.651=0.082
max0.849-0.863=-0.014
name=cdr_enhanced_4k_loc.art
mean885.514-885.510=0.004
σ0.001-0.008=-0.007
min885.513-885.504=0.009
max885.515-885.523=-0.008
mean1640.000-1519.000=121.000
σ0.000
min1640.000-1519.000=121.000
max1640.000-1519.000=121.000
mean0.701-0.706=-0.004
σ0.046-0.045=0.001
min0.626-0.643=-0.017
max0.736-0.743=-0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716
σ0.002
min7.715
max7.719
mean1640.000-1519.000=121.000
σ0.000
min1640.000-1519.000=121.000
max1640.000-1519.000=121.000
mean4.186-3.795=0.390
σ0.093-0.343=-0.250
min4.011-3.392=0.619
max4.528-4.522=0.006
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1640.000-1519.000=121.000
σ0.000
min1640.000-1519.000=121.000
max1640.000-1519.000=121.000
mean4.166-4.142=0.024
σ0.065-0.247=-0.182
min4.044-3.487=0.557
max4.370-4.522=-0.152
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1640.000-1519.000=121.000
σ0.000
min1640.000-1519.000=121.000
max1640.000-1519.000=121.000
mean0.737-0.757=-0.020
σ0.021-0.025=-0.004
min0.705-0.711=-0.006
max0.842-0.921=-0.079
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1640.000-1519.000=121.000
σ0.000
min1640.000-1519.000=121.000
max1640.000-1519.000=121.000
mean0.700-0.647=0.052
σ0.014-0.091=-0.077
min0.664-0.488=0.177
max0.746-0.773=-0.027

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.995-296.375=0.620
σ0.238-0.234=0.004
min296.822-296.248=0.574
max297.650-297.029=0.621
mean2055.000-2034.000=21.000
σ0.000
min2055.000-2034.000=21.000
max2055.000-2034.000=21.000
mean0.559-0.557=0.002
σ0.030-0.029=0.001
min0.517-0.510=0.006
max0.588-0.584=0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.820-285.028=1.792
σ0.037-0.038=-0.001
min286.773-284.978=1.795
max286.858-285.064=1.794
mean1640.000-1519.000=121.000
σ0.000
min1640.000-1519.000=121.000
max1640.000-1519.000=121.000
mean0.396-0.397=-0.001
σ0.006-0.011=-0.006
min0.390-0.387=0.004
max0.403-0.415=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1297.213-1295.411=1.802
σ0.073-0.105=-0.032
min1297.133-1295.300=1.833
max1297.301-1295.539=1.762
mean1640.000-1519.000=121.000
σ0.000
min1640.000-1519.000=121.000
max1640.000-1519.000=121.000
mean2.051-1.913=0.137
σ0.047-0.127=-0.080
min2.000-1.807=0.193
max2.124-2.072=0.051
iters=5
new-facts=6402
prior-facts=1
mean1541.353-1539.513=1.840
σ6.814-6.854=-0.040
min1538.165-1536.231=1.934
max1553.540-1551.769=1.771
mean1640.000-1519.000=121.000
σ0.000
min1640.000-1519.000=121.000
max1640.000-1519.000=121.000
mean2.301-2.242=0.059
σ0.240-0.209=0.032
min2.140-1.984=0.156
max2.699-2.475=0.224
iters=5
new-facts=6402
prior-facts=6402
mean1859.115-1857.313=1.802
σ0.085-0.069=0.016
min1858.987-1857.231=1.756
max1859.199-1857.399=1.800
mean1795.400-1752.600=42.800
σ179.485-209.139=-29.655
min1640.000-1519.000=121.000
max2055.000-2034.000=21.000
mean2.948-2.968=-0.020
σ0.152-0.278=-0.126
min2.767-2.753=0.013
max3.119-3.445=-0.326

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.181-1.551=-0.371
σ0.285-0.280=0.005
min0.935-1.189=-0.253
max1.584-1.840=-0.256

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.191=0.629
σ581.372-581.331=0.041
min158.132-157.524=0.608
max1320.878-1320.188=0.690
mean96.250
σ8.500
min92.000
max109.000
mean1640.000-1519.000=121.000
σ0.000
min1640.000-1519.000=121.000
max1640.000-1519.000=121.000
mean0.553-0.531=0.022
σ0.582-0.541=0.042
min0.258-0.260=-0.002
max1.426-1.342=0.084
policies=20
mean1581.616-1575.567=6.049
σ0.357-0.348=0.009
min1581.374-1575.330=6.044
max1582.147-1576.084=6.063
mean920.000
σ0.000
min920.000
max920.000
mean1640.000-1519.000=121.000
σ0.000
min1640.000-1519.000=121.000
max1640.000-1519.000=121.000
mean2.629-2.619=0.011
σ0.007-0.014=-0.008
min2.622-2.603=0.019
max2.636-2.636=-0.000
policies=200
mean15824.230-15763.703=60.527
σ0.105-0.028=0.077
min15824.151-15763.665=60.485
max15824.381-15763.730=60.651
mean9200.000
σ0.000
min9200.000
max9200.000
mean1640.000-1519.000=121.000
σ0.000
min1640.000-1519.000=121.000
max1640.000-1519.000=121.000
mean26.644-26.518=0.126
σ0.034-0.058=-0.024
min26.593-26.460=0.133
max26.665-26.570=0.095