Compare commits

Home / Compare e6974982 .. f3c99d2b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.055=-0.001
σ0.369-0.369=-0.000
min53.905-53.910=-0.005
max55.102-55.104=-0.001
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.139-0.140=-0.001
σ0.003-0.004=-0.000
min0.137-0.137=-0.001
max0.146-0.146=0.000
cache=y
dps=1
iters=10
policies=100
mean43.397-43.393=0.004
σ0.005-0.006=-0.000
min43.389-43.388=0.001
max43.408-43.406=0.001
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.137-0.120=0.017
σ0.008-0.005=0.003
min0.124-0.114=0.010
max0.148-0.127=0.021

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.000-1007.003=-0.003
σ1.237-1.218=0.019
min1006.464-1006.466=-0.002
max1012.194-1012.115=0.079
mean1051.000-1050.050=0.950
σ307.658-319.967=-12.309
min576.000-586.000=-10.000
max1643.000-1617.000=26.000
mean1.572-1.578=-0.006
σ0.078-0.104=-0.026
min1.500-1.485=0.016
max1.796-1.864=-0.068

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1643.000-1617.000=26.000
σ0.000
min1643.000-1617.000=26.000
max1643.000-1617.000=26.000
mean0.413-0.411=0.003
σ0.140-0.127=0.013
min0.331-0.341=-0.009
max0.661-0.636=0.025
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.002=0.000
min2.337
max2.342
mean1643.000-1617.000=26.000
σ0.000
min1643.000-1617.000=26.000
max1643.000-1617.000=26.000
mean0.888-0.879=0.009
σ0.099-0.102=-0.003
min0.820-0.811=0.009
max1.060-1.057=0.003
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1643.000-1617.000=26.000
σ0.000
min1643.000-1617.000=26.000
max1643.000-1617.000=26.000
mean0.533-0.554=-0.020
σ0.056-0.070=-0.015
min0.487-0.483=0.003
max0.622-0.643=-0.021
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1643.000-1617.000=26.000
σ0.000
min1643.000-1617.000=26.000
max1643.000-1617.000=26.000
mean0.864-0.843=0.021
σ0.033-0.055=-0.022
min0.826-0.807=0.019
max0.915-0.938=-0.023

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.836-964.839=-0.003
σ0.027-0.033=-0.006
min964.816-964.810=0.006
max964.881-964.894=-0.013
mean1643.000-1617.000=26.000
σ0.000
min1643.000-1617.000=26.000
max1643.000-1617.000=26.000
mean0.812-0.851=-0.039
σ0.048-0.007=0.042
min0.738-0.844=-0.106
max0.856-0.862=-0.006
name=cdr_enhanced_4k_loc.art
mean885.514-885.512=0.002
σ0.006-0.006=-0.001
min885.505-885.506=-0.000
max885.522-885.522=-0.000
mean1643.000-1617.000=26.000
σ0.000
min1643.000-1617.000=26.000
max1643.000-1617.000=26.000
mean0.717-0.681=0.037
σ0.028-0.059=-0.031
min0.668-0.601=0.067
max0.737-0.741=-0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.721=-0.000
mean1643.000-1617.000=26.000
σ0.000
min1643.000-1617.000=26.000
max1643.000-1617.000=26.000
mean4.202-4.203=-0.001
σ0.093-0.101=-0.008
min4.060-4.052=0.008
max4.559-4.649=-0.090
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668
mean1643.000-1617.000=26.000
σ0.000
min1643.000-1617.000=26.000
max1643.000-1617.000=26.000
mean4.212-4.184=0.028
σ0.081-0.077=0.004
min4.087-4.061=0.026
max4.525-4.499=0.026
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1643.000-1617.000=26.000
σ0.000
min1643.000-1617.000=26.000
max1643.000-1617.000=26.000
mean0.738-0.732=0.005
σ0.023-0.025=-0.003
min0.704-0.552=0.152
max0.864-0.845=0.019
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1643.000-1617.000=26.000
σ0.000
min1643.000-1617.000=26.000
max1643.000-1617.000=26.000
mean0.698-0.697=0.001
σ0.016-0.013=0.003
min0.664-0.669=-0.006
max0.783-0.761=0.022

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.937-296.867=0.071
σ0.208-0.193=0.015
min296.775-296.686=0.089
max297.501-297.276=0.225
mean1902.000-2029.000=-127.000
σ0.000
min1902.000-2029.000=-127.000
max1902.000-2029.000=-127.000
mean0.573-0.573=0.000
σ0.030-0.030=0.001
min0.507-0.511=-0.004
max0.616-0.600=0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.820-286.821=-0.001
σ0.036-0.037=-0.001
min286.772-286.768=0.004
max286.857-286.859=-0.002
mean1643.000-1617.000=26.000
σ0.000
min1643.000-1617.000=26.000
max1643.000-1617.000=26.000
mean0.401-0.396=0.005
σ0.006-0.008=-0.002
min0.391-0.387=0.004
max0.406-0.403=0.003
iters=5
new-facts=1
prior-facts=6402
mean1297.278-1297.264=0.014
σ0.093-0.085=0.008
min1297.162-1297.143=0.019
max1297.408-1297.366=0.042
mean1643.000-1617.000=26.000
σ0.000
min1643.000-1617.000=26.000
max1643.000-1617.000=26.000
mean2.269-2.157=0.113
σ0.066-0.067=-0.001
min2.203-2.083=0.120
max2.367-2.260=0.107
iters=5
new-facts=6402
prior-facts=1
mean1541.376-1541.360=0.016
σ6.822-6.807=0.016
min1538.184-1538.179=0.005
max1553.578-1553.534=0.044
mean1643.000-1617.000=26.000
σ0.000
min1643.000-1617.000=26.000
max1643.000-1617.000=26.000
mean2.295-2.274=0.021
σ0.152-0.177=-0.025
min2.119-2.111=0.007
max2.465-2.547=-0.082
iters=5
new-facts=6402
prior-facts=6402
mean1859.113-1859.116=-0.003
σ0.069-0.057=0.011
min1859.022-1859.034=-0.012
max1859.197-1859.184=0.013
mean1771.200-1767.800=3.400
σ125.494-177.112=-51.618
min1643.000-1617.000=26.000
max1902.000-2029.000=-127.000
mean3.105-2.920=0.185
σ0.291-0.085=0.206
min2.859-2.833=0.026
max3.600-3.032=0.568

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.168-1.195=-0.027
σ0.314-0.301=0.013
min0.934-0.920=0.014
max1.689-1.550=0.138

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.822=-0.002
σ581.373-581.372=0.000
min158.130-158.134=-0.004
max1320.879-1320.880=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1617.000=26.000
σ0.000
min1643.000-1617.000=26.000
max1643.000-1617.000=26.000
mean0.549-0.578=-0.029
σ0.565-0.621=-0.057
min0.265-0.264=0.000
max1.396-1.509=-0.113
policies=20
mean1581.625-1581.603=0.022
σ0.378-0.363=0.015
min1581.372-1581.361=0.011
max1582.188-1582.144=0.044
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1617.000=26.000
σ0.000
min1643.000-1617.000=26.000
max1643.000-1617.000=26.000
mean2.663-2.643=0.020
σ0.025-0.032=-0.007
min2.638-2.614=0.024
max2.694-2.688=0.006
policies=200
mean15824.261-15824.204=0.057
σ0.116-0.156=-0.041
min15824.153-15824.039=0.114
max15824.411-15824.406=0.005
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1617.000=26.000
σ0.000
min1643.000-1617.000=26.000
max1643.000-1617.000=26.000
mean26.798-26.767=0.031
σ0.057-0.064=-0.007
min26.752-26.704=0.048
max26.870-26.857=0.013