Compare commits

Home / Compare 0ffbeaae .. 0aa09be9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.964-53.839=0.126
σ0.370-0.367=0.003
min53.824-53.694=0.130
max55.016-54.882=0.134
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.140-0.139=0.001
σ0.004-0.004=-0.001
min0.136-0.135=0.001
max0.147-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean43.322-43.207=0.115
σ0.006-0.005=0.001
min43.316-43.200=0.116
max43.333-43.217=0.116
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.123-0.120=0.003
σ0.004-0.004=-0.001
min0.120-0.113=0.007
max0.131-0.126=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.513-1016.206=-9.693
σ1.208-1.168=0.040
min1005.979-1015.658=-9.678
max1011.567-1021.098=-9.531
mean1055.200-1052.500=2.700
σ317.847-298.551=19.296
min547.000-579.000=-32.000
max1519.000-1452.000=67.000
mean1.578-1.548=0.030
σ0.100-0.067=0.033
min1.496-1.481=0.015
max1.837-1.723=0.114

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884
σ0.002
min0.882
max0.887
mean1519.000
σ0.000
min1519.000
max1519.000
mean0.437
σ0.192
min0.325
max0.778
name=error_case.art
mean2.340
σ0.003
min2.337
max2.342
mean1519.000
σ0.000
min1519.000
max1519.000
mean0.910
σ0.156
min0.820
max1.187
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1519.000
σ0.000
min1519.000
max1519.000
mean0.533
σ0.051
min0.492
max0.611
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1519.000
σ0.000
min1519.000
max1519.000
mean0.844
σ0.042
min0.799
max0.909

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.826
σ0.034
min964.807
max964.886
mean1519.000
σ0.000
min1519.000
max1519.000
mean0.820
σ0.060
min0.717
max0.859
name=cdr_enhanced_4k_loc.art
mean885.510
σ0.006
min885.504
max885.517
mean1519.000
σ0.000
min1519.000
max1519.000
mean0.699
σ0.056
min0.616
max0.746

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716
σ0.002
min7.715
max7.719
mean1519.000
σ0.000
min1519.000
max1519.000
mean3.528
σ0.081
min3.404
max3.791
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1519.000
σ0.000
min1519.000
max1519.000
mean3.516
σ0.064
min3.414
max3.754
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1519.000
σ0.000
min1519.000
max1519.000
mean0.544
σ0.075
min0.510
max1.277
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1519.000
σ0.000
min1519.000
max1519.000
mean0.494
σ0.051
min0.294
max0.691

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.298-301.123=-4.826
σ0.240-0.227=0.012
min296.048-301.013=-4.965
max296.914-301.767=-4.853
mean1916.000-2017.000=-101.000
σ0.000
min1916.000-2017.000=-101.000
max1916.000-2017.000=-101.000
mean0.591-0.561=0.030
σ0.051-0.029=0.022
min0.510-0.499=0.011
max0.701-0.579=0.122

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.033-301.485=-16.451
σ0.035-0.038=-0.003
min284.985-301.433=-16.448
max285.071-301.531=-16.460
mean1519.000-1452.000=67.000
σ0.000
min1519.000-1452.000=67.000
max1519.000-1452.000=67.000
mean0.397-0.390=0.007
σ0.009-0.001=0.008
min0.388-0.389=-0.001
max0.410-0.391=0.019
iters=5
new-facts=1
prior-facts=6402
mean1295.439-1324.054=-28.615
σ0.057-0.107=-0.051
min1295.367-1323.922=-28.555
max1295.510-1324.191=-28.681
mean1519.000-1452.000=67.000
σ0.000
min1519.000-1452.000=67.000
max1519.000-1452.000=67.000
mean2.131-1.924=0.208
σ0.177-0.080=0.097
min1.949-1.857=0.092
max2.408-2.039=0.369
iters=5
new-facts=6402
prior-facts=1
mean1539.567-1562.071=-22.503
σ6.825-6.893=-0.068
min1536.374-1558.781=-22.407
max1551.774-1574.397=-22.622
mean1519.000-1452.000=67.000
σ0.000
min1519.000-1452.000=67.000
max1519.000-1452.000=67.000
mean2.349-2.264=0.085
σ0.233-0.197=0.036
min2.111-2.085=0.026
max2.692-2.498=0.194
iters=5
new-facts=6402
prior-facts=6402
mean1857.321-1891.948=-34.628
σ0.066-0.065=0.001
min1857.238-1891.860=-34.622
max1857.392-1892.010=-34.618
mean1750.800-1721.000=29.800
σ172.409-227.185=-54.776
min1519.000-1452.000=67.000
max1916.000-2017.000=-101.000
mean3.059-2.941=0.119
σ0.234-0.129=0.105
min2.861-2.843=0.018
max3.391-3.166=0.225

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.632-1.695=-0.063
σ0.269-0.141=0.128
min1.211-1.525=-0.314
max1.908-1.835=0.073

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.189-443.929=4.260
σ581.331-575.135=6.196
min157.522-156.358=1.164
max1320.186-1306.632=13.554
mean96.250
σ8.500
min92.000
max109.000
mean1519.000-1452.000=67.000
σ0.000
min1519.000-1452.000=67.000
max1519.000-1452.000=67.000
mean0.556-0.538=0.018
σ0.567-0.551=0.016
min0.271-0.260=0.011
max1.406-1.364=0.042
policies=20
mean1575.550-1563.885=11.665
σ0.357-0.335=0.022
min1575.306-1563.680=11.626
max1576.079-1564.385=11.694
mean920.000
σ0.000
min920.000
max920.000
mean1519.000-1452.000=67.000
σ0.000
min1519.000-1452.000=67.000
max1519.000-1452.000=67.000
mean2.627-2.613=0.014
σ0.011-0.005=0.007
min2.615-2.609=0.007
max2.642-2.618=0.024
policies=200
mean15763.704-15646.927=116.776
σ0.138-0.169=-0.031
min15763.596-15646.778=116.818
max15763.887-15647.144=116.743
mean9200.000
σ0.000
min9200.000
max9200.000
mean1519.000-1452.000=67.000
σ0.000
min1519.000-1452.000=67.000
max1519.000-1452.000=67.000
mean26.620-26.444=0.177
σ0.053-0.122=-0.069
min26.570-26.286=0.284
max26.691-26.567=0.124