Compare commits

Home / Compare 795968d1 .. 115e0e33

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.054=0.002
σ0.369-0.371=-0.002
min53.911-53.908=0.004
max55.104-55.108=-0.004
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.141-0.139=0.002
σ0.004-0.006=-0.002
min0.137-0.130=0.007
max0.148-0.147=0.001
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=-0.000
σ0.007-0.006=0.001
min43.383-43.386=-0.002
max43.405-43.401=0.004
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.122-0.123=-0.001
σ0.006-0.004=0.003
min0.114-0.119=-0.005
max0.136-0.128=0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.007-1007.006=0.001
σ1.185-1.189=-0.003
min1006.430-1006.434=-0.004
max1011.973-1011.987=-0.014
mean1051.900-1055.100=-3.200
σ308.769-314.791=-6.022
min576.000-585.000=-9.000
max1649.000-1618.000=31.000
mean1.517-1.530=-0.013
σ0.069-0.053=0.016
min1.402-1.459=-0.057
max1.691-1.631=0.060

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1649.000-1618.000=31.000
σ0.000
min1649.000-1618.000=31.000
max1649.000-1618.000=31.000
mean0.419-0.447=-0.028
σ0.131-0.147=-0.015
min0.328-0.362=-0.035
max0.652-0.705=-0.053
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1649.000-1618.000=31.000
σ0.000
min1649.000-1618.000=31.000
max1649.000-1618.000=31.000
mean0.882-0.940=-0.058
σ0.086-0.214=-0.128
min0.825-0.827=-0.002
max1.035-1.322=-0.288
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1649.000-1618.000=31.000
σ0.000
min1649.000-1618.000=31.000
max1649.000-1618.000=31.000
mean0.533-0.554=-0.021
σ0.053-0.057=-0.003
min0.497-0.487=0.010
max0.626-0.615=0.011
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1649.000-1618.000=31.000
σ0.000
min1649.000-1618.000=31.000
max1649.000-1618.000=31.000
mean0.843-0.868=-0.025
σ0.040-0.039=0.001
min0.811-0.843=-0.033
max0.910-0.936=-0.026

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.837-964.840=-0.003
σ0.034-0.035=-0.000
min964.809-964.810=-0.001
max964.894-964.898=-0.003
mean1649.000-1618.000=31.000
σ0.000
min1649.000-1618.000=31.000
max1649.000-1618.000=31.000
mean0.783-0.810=-0.027
σ0.076-0.060=0.016
min0.664-0.727=-0.064
max0.866-0.861=0.005
name=cdr_enhanced_4k_loc.art
mean885.513-885.513=0.000
σ0.001-0.008=-0.006
min885.512-885.506=0.006
max885.515-885.525=-0.010
mean1649.000-1618.000=31.000
σ0.000
min1649.000-1618.000=31.000
max1649.000-1618.000=31.000
mean0.661-0.696=-0.036
σ0.057-0.039=0.019
min0.579-0.648=-0.069
max0.739-0.751=-0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.720=-0.001
mean1649.000-1618.000=31.000
σ0.000
min1649.000-1618.000=31.000
max1649.000-1618.000=31.000
mean3.525-4.281=-0.756
σ0.104-0.080=0.024
min3.376-4.132=-0.756
max4.015-4.671=-0.656
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1649.000-1618.000=31.000
σ0.000
min1649.000-1618.000=31.000
max1649.000-1618.000=31.000
mean3.478-4.262=-0.784
σ0.068-0.117=-0.049
min3.371-4.096=-0.725
max3.688-5.012=-1.324
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1649.000-1618.000=31.000
σ0.000
min1649.000-1618.000=31.000
max1649.000-1618.000=31.000
mean0.722-0.750=-0.028
σ0.072-0.017=0.054
min0.543-0.711=-0.168
max0.856-0.863=-0.007
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1649.000-1618.000=31.000
σ0.000
min1649.000-1618.000=31.000
max1649.000-1618.000=31.000
mean0.514-0.703=-0.189
σ0.012-0.015=-0.003
min0.490-0.674=-0.184
max0.566-0.780=-0.214

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.964-296.935=0.029
σ0.242-0.246=-0.004
min296.821-296.719=0.102
max297.626-297.559=0.067
mean1921.000-2032.000=-111.000
σ0.000
min1921.000-2032.000=-111.000
max1921.000-2032.000=-111.000
mean0.580-0.577=0.003
σ0.049-0.020=0.028
min0.515-0.537=-0.022
max0.678-0.595=0.083

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.822-286.818=0.004
σ0.040-0.039=0.001
min286.770-286.767=0.003
max286.862-286.858=0.004
mean1649.000-1618.000=31.000
σ0.000
min1649.000-1618.000=31.000
max1649.000-1618.000=31.000
mean0.400-0.396=0.004
σ0.010-0.005=0.004
min0.389-0.388=0.001
max0.411-0.400=0.011
iters=5
new-facts=1
prior-facts=6402
mean1297.212-1297.211=0.001
σ0.109-0.121=-0.012
min1297.094-1297.088=0.006
max1297.344-1297.363=-0.020
mean1649.000-1618.000=31.000
σ0.000
min1649.000-1618.000=31.000
max1649.000-1618.000=31.000
mean1.907-1.879=0.029
σ0.096-0.094=0.002
min1.812-1.804=0.007
max2.009-2.017=-0.007
iters=5
new-facts=6402
prior-facts=1
mean1541.323-1541.335=-0.013
σ6.847-6.843=0.004
min1538.036-1538.054=-0.018
max1553.565-1553.573=-0.007
mean1649.000-1618.000=31.000
σ0.000
min1649.000-1618.000=31.000
max1649.000-1618.000=31.000
mean2.286-2.230=0.055
σ0.195-0.156=0.039
min2.030-2.119=-0.089
max2.515-2.489=0.026
iters=5
new-facts=6402
prior-facts=6402
mean1859.123-1859.123=0.000
σ0.056-0.065=-0.010
min1859.064-1859.032=0.032
max1859.192-1859.199=-0.007
mean1787.000-1763.000=24.000
σ135.026-178.827=-43.801
min1649.000-1618.000=31.000
max1921.000-2032.000=-111.000
mean3.079-2.891=0.188
σ0.242-0.145=0.097
min2.860-2.777=0.083
max3.481-3.143=0.338

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.201-1.228=-0.028
σ0.343-0.363=-0.020
min0.931-0.932=-0.001
max1.724-1.843=-0.119

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.821=0.001
σ581.372-581.372=-0.001
min158.135-158.131=0.004
max1320.880-1320.880=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1649.000-1618.000=31.000
σ0.000
min1649.000-1618.000=31.000
max1649.000-1618.000=31.000
mean0.559-0.533=0.027
σ0.591-0.538=0.053
min0.262-0.260=0.001
max1.445-1.339=0.106
policies=20
mean1581.630-1581.621=0.009
σ0.361-0.340=0.021
min1581.390-1581.390=0.000
max1582.167-1582.126=0.042
mean920.000
σ0.000
min920.000
max920.000
mean1649.000-1618.000=31.000
σ0.000
min1649.000-1618.000=31.000
max1649.000-1618.000=31.000
mean2.637-2.608=0.028
σ0.022-0.014=0.008
min2.610-2.591=0.020
max2.662-2.623=0.039
policies=200
mean15824.259-15824.268=-0.009
σ0.121-0.067=0.055
min15824.128-15824.218=-0.090
max15824.415-15824.366=0.049
mean9200.000
σ0.000
min9200.000
max9200.000
mean1649.000-1618.000=31.000
σ0.000
min1649.000-1618.000=31.000
max1649.000-1618.000=31.000
mean26.573-26.573=0.000
σ0.023-0.048=-0.026
min26.556-26.517=0.038
max26.606-26.630=-0.024