Compare commits

Home / Compare 8ba06af8 .. 0fcdacf1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.054=0.001
σ0.367-0.371=-0.003
min53.911-53.908=0.004
max55.099-55.108=-0.009
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.140-0.139=0.002
σ0.005-0.006=-0.002
min0.132-0.130=0.002
max0.148-0.147=0.002
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.000
σ0.005-0.006=-0.001
min43.387-43.386=0.001
max43.402-43.401=0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.122-0.123=-0.000
σ0.004-0.004=0.000
min0.119-0.119=-0.001
max0.129-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.003-1007.006=-0.004
σ1.201-1.189=0.012
min1006.433-1006.434=-0.002
max1012.040-1011.987=0.053
mean1051.400-1055.100=-3.700
σ307.021-314.791=-7.770
min578.000-585.000=-7.000
max1635.000-1618.000=17.000
mean1.545-1.530=0.015
σ0.058-0.053=0.006
min1.491-1.459=0.032
max1.704-1.631=0.073

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1635.000-1618.000=17.000
σ0.000
min1635.000-1618.000=17.000
max1635.000-1618.000=17.000
mean0.415-0.447=-0.033
σ0.125-0.147=-0.022
min0.336-0.362=-0.026
max0.634-0.705=-0.071
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1635.000-1618.000=17.000
σ0.000
min1635.000-1618.000=17.000
max1635.000-1618.000=17.000
mean0.879-0.940=-0.061
σ0.095-0.214=-0.119
min0.802-0.827=-0.025
max1.043-1.322=-0.279
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1635.000-1618.000=17.000
σ0.000
min1635.000-1618.000=17.000
max1635.000-1618.000=17.000
mean0.536-0.554=-0.018
σ0.045-0.057=-0.012
min0.488-0.487=0.001
max0.605-0.615=-0.011
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1635.000-1618.000=17.000
σ0.000
min1635.000-1618.000=17.000
max1635.000-1618.000=17.000
mean0.848-0.868=-0.020
σ0.041-0.039=0.003
min0.819-0.843=-0.025
max0.919-0.936=-0.017

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.840=-0.001
σ0.034-0.035=-0.001
min964.811-964.810=0.001
max964.896-964.898=-0.002
mean1635.000-1618.000=17.000
σ0.000
min1635.000-1618.000=17.000
max1635.000-1618.000=17.000
mean0.791-0.810=-0.018
σ0.036-0.060=-0.024
min0.748-0.727=0.020
max0.829-0.861=-0.031
name=cdr_enhanced_4k_loc.art
mean885.512-885.513=-0.000
σ0.007-0.008=-0.000
min885.505-885.506=-0.000
max885.523-885.525=-0.001
mean1635.000-1618.000=17.000
σ0.000
min1635.000-1618.000=17.000
max1635.000-1618.000=17.000
mean0.694-0.696=-0.002
σ0.048-0.039=0.010
min0.643-0.648=-0.005
max0.755-0.751=0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.720=0.000
mean1635.000-1618.000=17.000
σ0.000
min1635.000-1618.000=17.000
max1635.000-1618.000=17.000
mean4.210-4.281=-0.071
σ0.098-0.080=0.019
min4.076-4.132=-0.057
max4.701-4.671=0.030
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1635.000-1618.000=17.000
σ0.000
min1635.000-1618.000=17.000
max1635.000-1618.000=17.000
mean4.183-4.262=-0.078
σ0.074-0.117=-0.043
min4.053-4.096=-0.044
max4.417-5.012=-0.595
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1635.000-1618.000=17.000
σ0.000
min1635.000-1618.000=17.000
max1635.000-1618.000=17.000
mean0.744-0.750=-0.005
σ0.017-0.017=-0.000
min0.712-0.711=0.001
max0.854-0.863=-0.009
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1635.000-1618.000=17.000
σ0.000
min1635.000-1618.000=17.000
max1635.000-1618.000=17.000
mean0.619-0.703=-0.084
σ0.099-0.015=0.084
min0.493-0.674=-0.181
max0.773-0.780=-0.007

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.955-296.935=0.020
σ0.205-0.246=-0.041
min296.838-296.719=0.119
max297.519-297.559=-0.040
mean2054.000-2032.000=22.000
σ0.000
min2054.000-2032.000=22.000
max2054.000-2032.000=22.000
mean0.545-0.577=-0.032
σ0.030-0.020=0.009
min0.509-0.537=-0.028
max0.578-0.595=-0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.817-286.818=-0.001
σ0.036-0.039=-0.003
min286.770-286.767=0.003
max286.852-286.858=-0.005
mean1635.000-1618.000=17.000
σ0.000
min1635.000-1618.000=17.000
max1635.000-1618.000=17.000
mean0.392-0.396=-0.003
σ0.008-0.005=0.003
min0.386-0.388=-0.002
max0.406-0.400=0.006
iters=5
new-facts=1
prior-facts=6402
mean1297.244-1297.211=0.034
σ0.074-0.121=-0.047
min1297.162-1297.088=0.074
max1297.301-1297.363=-0.062
mean1635.000-1618.000=17.000
σ0.000
min1635.000-1618.000=17.000
max1635.000-1618.000=17.000
mean2.041-1.879=0.163
σ0.037-0.094=-0.057
min1.978-1.804=0.174
max2.070-2.017=0.053
iters=5
new-facts=6402
prior-facts=1
mean1541.301-1541.335=-0.035
σ6.846-6.843=0.004
min1538.029-1538.054=-0.024
max1553.543-1553.573=-0.030
mean1635.000-1618.000=17.000
σ0.000
min1635.000-1618.000=17.000
max1635.000-1618.000=17.000
mean2.167-2.230=-0.064
σ0.131-0.156=-0.025
min2.089-2.119=-0.030
max2.397-2.489=-0.092
iters=5
new-facts=6402
prior-facts=6402
mean1859.121-1859.123=-0.002
σ0.082-0.065=0.017
min1859.001-1859.032=-0.032
max1859.212-1859.199=0.013
mean1793.400-1763.000=30.400
σ181.230-178.827=2.403
min1635.000-1618.000=17.000
max2054.000-2032.000=22.000
mean3.019-2.891=0.128
σ0.050-0.145=-0.095
min2.969-2.777=0.192
max3.080-3.143=-0.063

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.240-1.228=0.011
σ0.306-0.363=-0.057
min0.924-0.932=-0.008
max1.733-1.843=-0.109

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.821=-0.000
σ581.373-581.372=0.000
min158.133-158.131=0.003
max1320.880-1320.880=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1635.000-1618.000=17.000
σ0.000
min1635.000-1618.000=17.000
max1635.000-1618.000=17.000
mean0.541-0.533=0.008
σ0.564-0.538=0.027
min0.243-0.260=-0.017
max1.387-1.339=0.048
policies=20
mean1581.618-1581.621=-0.003
σ0.360-0.340=0.020
min1581.377-1581.390=-0.013
max1582.153-1582.126=0.028
mean920.000
σ0.000
min920.000
max920.000
mean1635.000-1618.000=17.000
σ0.000
min1635.000-1618.000=17.000
max1635.000-1618.000=17.000
mean2.638-2.608=0.030
σ0.026-0.014=0.013
min2.610-2.591=0.020
max2.669-2.623=0.046
policies=200
mean15824.184-15824.268=-0.084
σ0.076-0.067=0.010
min15824.114-15824.218=-0.104
max15824.290-15824.366=-0.076
mean9200.000
σ0.000
min9200.000
max9200.000
mean1635.000-1618.000=17.000
σ0.000
min1635.000-1618.000=17.000
max1635.000-1618.000=17.000
mean26.647-26.573=0.075
σ0.024-0.048=-0.024
min26.625-26.517=0.108
max26.669-26.630=0.040