Compare commits

Home / Compare 90b8c015 .. 8d02983a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.045-54.046=-0.001
σ0.370-0.371=-0.001
min53.901-53.893=0.008
max55.096-55.100=-0.004
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.138-0.140=-0.002
σ0.004-0.004=0.000
min0.132-0.136=-0.004
max0.143-0.147=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.384-43.384=0.000
σ0.006-0.006=-0.000
min43.374-43.373=0.001
max43.396-43.396=0.000
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.123-0.124=-0.001
σ0.004-0.004=-0.001
min0.120-0.121=-0.000
max0.129-0.131=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.976-1006.975=0.000
σ0.928-0.876=0.052
min1006.512-1006.482=0.030
max1010.833-1010.603=0.230
mean1051.350-1043.250=8.100
σ311.026-313.019=-1.994
min555.000-544.000=11.000
max1650.000-1626.000=24.000
mean1.569-1.578=-0.009
σ0.129-0.121=0.008
min1.477-1.464=0.013
max2.016-1.908=0.108

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.000
σ0.002-0.003=-0.000
min0.882
max0.887
mean1650.000-1626.000=24.000
σ0.000
min1650.000-1626.000=24.000
max1650.000-1626.000=24.000
mean0.465-0.436=0.029
σ0.175-0.141=0.033
min0.353-0.361=-0.007
max0.771-0.688=0.082
name=error_case.art
mean2.339-2.339=0.001
σ0.003-0.003=0.000
min2.337
max2.344-2.342=0.001
mean1650.000-1626.000=24.000
σ0.000
min1650.000-1626.000=24.000
max1650.000-1626.000=24.000
mean0.926-0.902=0.025
σ0.166-0.100=0.066
min0.833-0.828=0.005
max1.221-1.074=0.148
name=heavy_item.art
mean1.524-1.524=0.000
σ0.002-0.002=0.000
min1.522
max1.526-1.526=0.000
mean1650.000-1626.000=24.000
σ0.000
min1650.000-1626.000=24.000
max1650.000-1626.000=24.000
mean0.539-0.552=-0.012
σ0.042-0.050=-0.008
min0.504-0.513=-0.009
max0.607-0.635=-0.028
name=nested_use.art
mean2.361-2.361=0.001
σ0.002-0.002=-0.000
min2.360
max2.364
mean1650.000-1626.000=24.000
σ0.000
min1650.000-1626.000=24.000
max1650.000-1626.000=24.000
mean0.848-0.871=-0.023
σ0.038-0.051=-0.013
min0.812-0.830=-0.018
max0.910-0.956=-0.045

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.832-964.831=0.001
σ0.027-0.025=0.002
min964.802-964.803=-0.001
max964.869-964.861=0.008
mean1650.000-1626.000=24.000
σ0.000
min1650.000-1626.000=24.000
max1650.000-1626.000=24.000
mean0.848-0.824=0.024
σ0.024-0.064=-0.040
min0.806-0.710=0.096
max0.864-0.857=0.007
name=cdr_enhanced_4k_loc.art
mean885.513-885.513=0.000
σ0.006-0.005=0.000
min885.504
max885.518-885.518=-0.000
mean1650.000-1626.000=24.000
σ0.000
min1650.000-1626.000=24.000
max1650.000-1626.000=24.000
mean0.716-0.701=0.015
σ0.042-0.033=0.009
min0.645-0.648=-0.003
max0.745-0.737=0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.002
mean1650.000-1626.000=24.000
σ0.000
min1650.000-1626.000=24.000
max1650.000-1626.000=24.000
mean3.816-4.275=-0.459
σ0.340-0.094=0.246
min3.454-4.131=-0.678
max4.528-4.783=-0.255
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1650.000-1626.000=24.000
σ0.000
min1650.000-1626.000=24.000
max1650.000-1626.000=24.000
mean4.276-4.245=0.031
σ0.100-0.074=0.026
min4.093-4.120=-0.027
max4.694-4.614=0.080
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1650.000-1626.000=24.000
σ0.000
min1650.000-1626.000=24.000
max1650.000-1626.000=24.000
mean0.758-0.752=0.006
σ0.018-0.017=0.001
min0.729-0.723=0.006
max0.877-0.867=0.011
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1650.000-1626.000=24.000
σ0.000
min1650.000-1626.000=24.000
max1650.000-1626.000=24.000
mean0.713-0.710=0.003
σ0.017-0.014=0.002
min0.682-0.681=0.002
max0.810-0.784=0.026

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.519-295.562=-0.043
σ0.193-0.246=-0.052
min295.358-295.367=-0.009
max296.044-296.238=-0.194
mean1934.000-1924.000=10.000
σ0.000
min1934.000-1924.000=10.000
max1934.000-1924.000=10.000
mean0.601-0.589=0.011
σ0.047-0.034=0.013
min0.513-0.539=-0.026
max0.706-0.673=0.033

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-285.410=0.002
σ0.040-0.038=0.002
min285.360-285.363=-0.003
max285.452-285.449=0.003
mean1650.000-1626.000=24.000
σ0.000
min1650.000-1626.000=24.000
max1650.000-1626.000=24.000
mean0.394-0.394=0.001
σ0.005-0.007=-0.002
min0.391-0.388=0.002
max0.403-0.401=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.794-1295.799=-0.006
σ0.106-0.109=-0.002
min1295.666-1295.677=-0.012
max1295.909-1295.924=-0.015
mean1650.000-1626.000=24.000
σ0.000
min1650.000-1626.000=24.000
max1650.000-1626.000=24.000
mean1.953-1.905=0.048
σ0.057-0.079=-0.022
min1.888-1.818=0.070
max2.020-1.998=0.022
iters=5
new-facts=6402
prior-facts=1
mean1538.646-1538.662=-0.016
σ4.010-4.017=-0.007
min1536.623-1536.638=-0.015
max1545.810-1545.839=-0.029
mean1650.000-1626.000=24.000
σ0.000
min1650.000-1626.000=24.000
max1650.000-1626.000=24.000
mean2.263-2.327=-0.064
σ0.113-0.161=-0.048
min2.104-2.093=0.011
max2.420-2.452=-0.032
iters=5
new-facts=6402
prior-facts=6402
mean1857.715-1857.702=0.012
σ0.065-0.060=0.006
min1857.640-1857.631=0.009
max1857.784-1857.780=0.004
mean1787.800-1770.000=17.800
σ142.310-149.419=-7.109
min1650.000-1626.000=24.000
max1934.000-1924.000=10.000
mean3.206-3.052=0.154
σ0.300-0.144=0.156
min2.898-2.875=0.023
max3.651-3.220=0.431

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.349-1.400=-0.051
σ0.129-0.294=-0.165
min1.260-1.114=0.147
max1.575-1.895=-0.319

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.058-444.059=-0.001
σ577.575-577.575=0.000
min155.270-155.271=-0.001
max1310.421-1310.422=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1626.000=24.000
σ0.000
min1650.000-1626.000=24.000
max1650.000-1626.000=24.000
mean0.546-0.540=0.006
σ0.569-0.555=0.014
min0.260-0.258=0.002
max1.400-1.372=0.027
policies=20
mean1552.971-1552.970=0.001
σ0.342-0.324=0.018
min1552.736-1552.746=-0.010
max1553.479-1553.450=0.028
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1626.000=24.000
σ0.000
min1650.000-1626.000=24.000
max1650.000-1626.000=24.000
mean2.602-2.586=0.016
σ0.030-0.022=0.008
min2.560-2.571=-0.012
max2.630-2.619=0.011
policies=200
mean15538.002-15537.993=0.009
σ0.184-0.049=0.135
min15537.818-15537.924=-0.106
max15538.239-15538.041=0.198
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1626.000=24.000
σ0.000
min1650.000-1626.000=24.000
max1650.000-1626.000=24.000
mean26.161-26.254=-0.093
σ0.087-0.109=-0.022
min26.094-26.163=-0.069
max26.289-26.409=-0.120