Compare commits

Home / Compare 2ae00269 .. 123852de

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.043-54.046=-0.003
σ0.369-0.370=-0.001
min53.903-53.905=-0.003
max55.092-55.098=-0.005
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.139-0.138=0.001
σ0.004-0.006=-0.002
min0.135-0.130=0.006
max0.144-0.148=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.383-43.382=0.000
σ0.005-0.007=-0.001
min43.372-43.374=-0.002
max43.393-43.395=-0.002
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.123-0.123=0.001
σ0.004-0.004=0.000
min0.119-0.116=0.003
max0.131-0.130=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.979=0.000
σ0.877-0.869=0.008
min1006.481-1006.479=0.002
max1010.618-1010.577=0.040
mean1045.700-1049.800=-4.100
σ306.022-319.593=-13.571
min576.000-573.000=3.000
max1661.000-1617.000=44.000
mean1.554-1.552=0.002
σ0.065-0.066=-0.002
min1.483-1.445=0.037
max1.737-1.713=0.023

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1661.000-1617.000=44.000
σ0.000
min1661.000-1617.000=44.000
max1661.000-1617.000=44.000
mean0.436-0.417=0.019
σ0.123-0.141=-0.017
min0.353-0.319=0.035
max0.650-0.665=-0.015
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1661.000-1617.000=44.000
σ0.000
min1661.000-1617.000=44.000
max1661.000-1617.000=44.000
mean0.877-0.883=-0.005
σ0.091-0.091=-0.000
min0.822-0.816=0.006
max1.038-1.038=0.000
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1661.000-1617.000=44.000
σ0.000
min1661.000-1617.000=44.000
max1661.000-1617.000=44.000
mean0.536-0.528=0.008
σ0.056-0.044=0.011
min0.494-0.489=0.005
max0.627-0.603=0.024
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1661.000-1617.000=44.000
σ0.000
min1661.000-1617.000=44.000
max1661.000-1617.000=44.000
mean0.842-0.843=-0.001
σ0.036-0.042=-0.007
min0.814-0.802=0.012
max0.904-0.913=-0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.836-964.830=0.006
σ0.030-0.026=0.004
min964.810-964.802=0.009
max964.888-964.863=0.025
mean1661.000-1617.000=44.000
σ0.000
min1661.000-1617.000=44.000
max1661.000-1617.000=44.000
mean0.822-0.809=0.014
σ0.044-0.032=0.011
min0.752-0.791=-0.039
max0.855-0.866=-0.010
name=cdr_enhanced_4k_loc.art
mean885.512-885.513=-0.001
σ0.005-0.005=-0.000
min885.504
max885.518-885.519=-0.001
mean1661.000-1617.000=44.000
σ0.000
min1661.000-1617.000=44.000
max1661.000-1617.000=44.000
mean0.722-0.699=0.023
σ0.033-0.045=-0.013
min0.665-0.641=0.024
max0.743-0.748=-0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.719
mean1661.000-1617.000=44.000
σ0.000
min1661.000-1617.000=44.000
max1661.000-1617.000=44.000
mean4.212-3.033=1.179
σ0.081-0.336=-0.255
min4.060-2.683=1.377
max4.515-3.676=0.839
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668
mean1661.000-1617.000=44.000
σ0.000
min1661.000-1617.000=44.000
max1661.000-1617.000=44.000
mean4.191-3.492=0.699
σ0.075-0.079=-0.004
min4.034-3.280=0.754
max4.496-3.750=0.746
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1661.000-1617.000=44.000
σ0.000
min1661.000-1617.000=44.000
max1661.000-1617.000=44.000
mean0.742-0.539=0.203
σ0.016-0.034=-0.017
min0.712-0.506=0.206
max0.832-0.720=0.111
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1661.000-1617.000=44.000
σ0.000
min1661.000-1617.000=44.000
max1661.000-1617.000=44.000
mean0.702-0.502=0.200
σ0.017-0.015=0.002
min0.663-0.393=0.270
max0.771-0.543=0.228

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.494-295.443=0.051
σ0.226-0.200=0.027
min295.262-295.317=-0.055
max295.982-295.972=0.010
mean1902.000-1914.000=-12.000
σ0.000
min1902.000-1914.000=-12.000
max1902.000-1914.000=-12.000
mean0.579-0.594=-0.015
σ0.046-0.048=-0.002
min0.513-0.502=0.011
max0.685-0.700=-0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-285.409=0.003
σ0.031-0.035=-0.004
min285.373-285.364=0.009
max285.446-285.446=-0.000
mean1661.000-1617.000=44.000
σ0.000
min1661.000-1617.000=44.000
max1661.000-1617.000=44.000
mean0.393-0.393=-0.000
σ0.011-0.010=0.001
min0.384-0.382=0.002
max0.405-0.404=0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.792-1295.802=-0.010
σ0.101-0.113=-0.012
min1295.680-1295.678=0.001
max1295.897-1295.960=-0.063
mean1661.000-1617.000=44.000
σ0.000
min1661.000-1617.000=44.000
max1661.000-1617.000=44.000
mean1.916-1.957=-0.041
σ0.090-0.129=-0.039
min1.817-1.832=-0.015
max2.004-2.171=-0.167
iters=5
new-facts=6402
prior-facts=1
mean1539.949-1539.996=-0.047
σ6.885-6.853=0.032
min1536.595-1536.638=-0.043
max1552.259-1552.249=0.010
mean1661.000-1617.000=44.000
σ0.000
min1661.000-1617.000=44.000
max1661.000-1617.000=44.000
mean2.401-2.496=-0.095
σ0.193-0.317=-0.124
min2.132-2.048=0.084
max2.598-2.749=-0.151
iters=5
new-facts=6402
prior-facts=6402
mean1857.702-1857.706=-0.004
σ0.055-0.052=0.003
min1857.653-1857.648=0.005
max1857.778-1857.775=0.003
mean1775.200-1770.200=5.000
σ121.321-141.148=-19.827
min1661.000-1617.000=44.000
max1902.000-1914.000=-12.000
mean3.071-3.100=-0.029
σ0.239-0.315=-0.075
min2.873-2.864=0.009
max3.482-3.645=-0.163

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.330-1.370=-0.040
σ0.373-0.180=0.194
min0.935-1.240=-0.305
max1.860-1.667=0.192

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.740=0.001
σ580.934-580.934=0.000
min155.272-155.271=0.001
max1317.142-1317.140=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1661.000-1617.000=44.000
σ0.000
min1661.000-1617.000=44.000
max1661.000-1617.000=44.000
mean0.538-0.532=0.005
σ0.550-0.541=0.009
min0.258-0.260=-0.002
max1.362-1.344=0.018
policies=20
mean1552.991-1552.978=0.012
σ0.332-0.342=-0.010
min1552.768-1552.743=0.024
max1553.484-1553.486=-0.002
mean920.000
σ0.000
min920.000
max920.000
mean1661.000-1617.000=44.000
σ0.000
min1661.000-1617.000=44.000
max1661.000-1617.000=44.000
mean2.598-2.604=-0.005
σ0.017-0.016=0.001
min2.573-2.581=-0.008
max2.613-2.617=-0.004
policies=200
mean15538.049-15537.932=0.118
σ0.111-0.164=-0.053
min15537.960-15537.804=0.156
max15538.212-15538.163=0.049
mean9200.000
σ0.000
min9200.000
max9200.000
mean1661.000-1617.000=44.000
σ0.000
min1661.000-1617.000=44.000
max1661.000-1617.000=44.000
mean26.292-26.226=0.067
σ0.043-0.092=-0.049
min26.252-26.113=0.139
max26.346-26.336=0.011