Compare commits

Home / Compare 76e8b403 .. c1e60139

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-53.836=0.221
σ0.367-0.368=-0.001
min53.917-53.689=0.228
max55.102-54.883=0.219
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.139-0.139=0.000
σ0.003-0.004=-0.001
min0.136-0.135=0.001
max0.144-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.395-43.209=0.186
σ0.006-0.005=0.001
min43.385-43.201=0.183
max43.404-43.216=0.188
mean419.000-415.000=4.000
σ0.000
min419.000-415.000=4.000
max419.000-415.000=4.000
mean0.123-0.121=0.001
σ0.004-0.004=0.001
min0.117-0.118=-0.001
max0.130-0.128=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1016.207=-9.228
σ0.866-1.164=-0.298
min1006.505-1015.632=-9.127
max1010.558-1021.080=-10.521
mean1053.650-1048.350=5.300
σ319.689-311.380=8.309
min577.000-556.000=21.000
max1621.000-1512.000=109.000
mean1.542-1.498=0.044
σ0.124-0.061=0.063
min1.454-1.429=0.025
max2.044-1.641=0.404

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1621.000
σ0.000
min1621.000
max1621.000
mean0.409
σ0.098
min0.341
max0.581
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1621.000
σ0.000
min1621.000
max1621.000
mean0.886
σ0.092
min0.807
max1.044
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1621.000
σ0.000
min1621.000
max1621.000
mean0.536
σ0.057
min0.479
max0.625
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1621.000
σ0.000
min1621.000
max1621.000
mean0.841
σ0.043
min0.809
max0.914

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831
σ0.025
min964.803
max964.859
mean1621.000
σ0.000
min1621.000
max1621.000
mean0.814
σ0.051
min0.734
max0.859
name=cdr_enhanced_4k_loc.art
mean885.513
σ0.008
min885.504
max885.523
mean1621.000
σ0.000
min1621.000
max1621.000
mean0.734
σ0.022
min0.695
max0.749

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716
σ0.002
min7.715
max7.720
mean1621.000
σ0.000
min1621.000
max1621.000
mean4.240
σ0.087
min4.105
max4.522
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1621.000
σ0.000
min1621.000
max1621.000
mean4.215
σ0.085
min4.067
max4.495
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1621.000
σ0.000
min1621.000
max1621.000
mean0.742
σ0.016
min0.708
max0.844
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1621.000
σ0.000
min1621.000
max1621.000
mean0.704
σ0.013
min0.680
max0.773

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.515-301.259=-5.744
σ0.247-0.327=-0.080
min295.327-301.015=-5.688
max296.137-302.163=-6.026
mean1941.000-2004.000=-63.000
σ0.000
min1941.000-2004.000=-63.000
max1941.000-2004.000=-63.000
mean0.587-0.535=0.052
σ0.034-0.026=0.008
min0.541-0.506=0.036
max0.657-0.579=0.078

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.404-301.483=-16.079
σ0.039-0.042=-0.003
min285.361-301.417=-16.056
max285.446-301.526=-16.080
mean1621.000-1512.000=109.000
σ0.000
min1621.000-1512.000=109.000
max1621.000-1512.000=109.000
mean0.393-0.393=-0.000
σ0.005-0.007=-0.001
min0.384-0.390=-0.006
max0.397-0.405=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1295.793-1324.064=-28.271
σ0.104-0.113=-0.008
min1295.673-1323.927=-28.254
max1295.932-1324.197=-28.265
mean1621.000-1512.000=109.000
σ0.000
min1621.000-1512.000=109.000
max1621.000-1512.000=109.000
mean1.890-1.883=0.007
σ0.084-0.057=0.027
min1.795-1.825=-0.030
max1.969-1.962=0.008
iters=5
new-facts=6402
prior-facts=1
mean1539.941-1562.103=-22.161
σ6.859-6.889=-0.030
min1536.686-1558.800=-22.114
max1552.209-1574.422=-22.214
mean1621.000-1512.000=109.000
σ0.000
min1621.000-1512.000=109.000
max1621.000-1512.000=109.000
mean2.132-2.348=-0.216
σ0.178-0.274=-0.095
min1.952-2.039=-0.087
max2.421-2.679=-0.258
iters=5
new-facts=6402
prior-facts=6402
mean1857.707-1891.955=-34.248
σ0.061-0.076=-0.015
min1857.645-1891.854=-34.209
max1857.779-1892.018=-34.239
mean1784.400-1721.200=63.200
σ154.343-207.236=-52.893
min1621.000-1512.000=109.000
max1941.000-2004.000=-63.000
mean2.971-3.008=-0.037
σ0.075-0.404=-0.329
min2.882-2.715=0.167
max3.074-3.720=-0.646

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.405-1.486=-0.081
σ0.272-0.372=-0.100
min1.105-0.937=0.168
max1.769-1.766=0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-443.483=2.258
σ580.934-574.233=6.701
min155.270-156.362=-1.092
max1317.142-1304.832=12.310
mean96.250
σ8.500
min92.000
max109.000
mean1621.000-1512.000=109.000
σ0.000
min1621.000-1512.000=109.000
max1621.000-1512.000=109.000
mean0.538-0.528=0.010
σ0.554-0.536=0.017
min0.259-0.260=-0.001
max1.369-1.333=0.036
policies=20
mean1552.991-1563.905=-10.914
σ0.330-0.337=-0.007
min1552.762-1563.683=-10.921
max1553.480-1564.407=-10.927
mean920.000
σ0.000
min920.000
max920.000
mean1621.000-1512.000=109.000
σ0.000
min1621.000-1512.000=109.000
max1621.000-1512.000=109.000
mean2.593-2.619=-0.025
σ0.019-0.024=-0.005
min2.574-2.593=-0.018
max2.615-2.646=-0.031
policies=200
mean15538.048-15647.020=-108.972
σ0.086-0.081=0.005
min15537.935-15646.930=-108.995
max15538.140-15647.121=-108.981
mean9200.000
σ0.000
min9200.000
max9200.000
mean1621.000-1512.000=109.000
σ0.000
min1621.000-1512.000=109.000
max1621.000-1512.000=109.000
mean26.226-26.463=-0.238
σ0.234-0.133=0.101
min26.093-26.310=-0.217
max26.574-26.621=-0.047