Compare commits

Home / Compare 86b86acc .. b6e7de02

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.032-70.780=-16.749
σ0.369-0.052=0.316
min53.885-70.749=-16.863
max55.080-70.927=-15.846
mean416.000
σ0.000
min416.000
max416.000
mean0.138-0.158=-0.020
σ0.005-0.004=0.000
min0.133-0.152=-0.018
max0.148-0.166=-0.018
cache=y
dps=1
iters=10
policies=100
mean43.384-21.494=21.891
σ0.005-0.002=0.003
min43.376-21.490=21.886
max43.391-21.498=21.893
mean416.000
σ0.000
min416.000
max416.000
mean0.123-0.064=0.059
σ0.004-0.004=0.000
min0.119-0.059=0.060
max0.129-0.069=0.060

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.329-1751.880=-745.551
σ0.896-0.361=0.535
min1005.858-1751.310=-745.451
max1010.054-1752.467=-742.413
mean1049.550-1665.400=-615.850
σ317.712-627.395=-309.682
min546.000-684.000=-138.000
max1650.000-2757.000=-1107.000
mean1.572-2.815=-1.243
σ0.117-0.138=-0.021
min1.363-2.435=-1.072
max1.817-2.991=-1.174

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1650.000
σ0.000
min1650.000
max1650.000
mean0.414
σ0.129
min0.331
max0.641
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1650.000
σ0.000
min1650.000
max1650.000
mean0.878
σ0.067
min0.821
max0.990
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1650.000
σ0.000
min1650.000
max1650.000
mean0.543
σ0.043
min0.502
max0.611
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1650.000
σ0.000
min1650.000
max1650.000
mean0.843
σ0.031
min0.813
max0.890

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.551
σ0.027
min963.527
max963.594
mean1650.000
σ0.000
min1650.000
max1650.000
mean0.774
σ0.039
min0.704
max0.794
name=cdr_enhanced_4k_loc.art
mean884.856
σ0.005
min884.847
max884.860
mean1650.000
σ0.000
min1650.000
max1650.000
mean0.693
σ0.040
min0.654
max0.738

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706
σ0.002
min7.705
max7.709
mean1650.000
σ0.000
min1650.000
max1650.000
mean4.208
σ0.078
min4.075
max4.595
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.660
mean1650.000
σ0.000
min1650.000
max1650.000
mean4.210
σ0.104
min4.087
max4.848
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1650.000
σ0.000
min1650.000
max1650.000
mean0.748
σ0.018
min0.716
max0.841
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1650.000
σ0.000
min1650.000
max1650.000
mean0.714
σ0.026
min0.525
max0.795

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.463
σ0.180
min295.294
max295.938
mean1907.000
σ0.000
min1907.000
max1907.000
mean0.579
σ0.041
min0.499
max0.649

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.248-269.377=15.871
σ0.043-0.004=0.039
min285.187-269.373=15.814
max285.289-269.382=15.908
mean1650.000-2757.000=-1107.000
σ0.000
min1650.000-2757.000=-1107.000
max1650.000-2757.000=-1107.000
mean0.403-0.376=0.027
σ0.009-0.005=0.004
min0.392-0.371=0.021
max0.411-0.384=0.027
iters=5
new-facts=1
prior-facts=6402
mean1295.198-1929.752=-634.554
σ0.112-0.004=0.108
min1295.080-1929.747=-634.668
max1295.338-1929.755=-634.417
mean1650.000-2757.000=-1107.000
σ0.000
min1650.000-2757.000=-1107.000
max1650.000-2757.000=-1107.000
mean1.914-3.083=-1.169
σ0.090-0.104=-0.014
min1.816-2.989=-1.173
max2.015-3.197=-1.182
iters=5
new-facts=6402
prior-facts=1
mean1538.078-4750.378=-3212.300
σ4.047-0.931=3.116
min1536.047-4749.631=-3213.584
max1545.309-4752.005=-3206.696
mean1650.000-2757.000=-1107.000
σ0.000
min1650.000-2757.000=-1107.000
max1650.000-2757.000=-1107.000
mean2.257-8.476=-6.220
σ0.208-0.459=-0.251
min2.022-7.809=-5.786
max2.448-8.925=-6.477
iters=5
new-facts=6402
prior-facts=6402
mean1857.100-4940.987=-3083.887
σ0.056-0.015=0.041
min1857.040-4940.968=-3083.927
max1857.163-4941.000=-3083.837
mean1775.200-3042.800=-1267.600
σ128.712-239.603=-110.892
min1650.000-2757.000=-1107.000
max1907.000-3331.000=-1424.000
mean3.016-8.511=-5.495
σ0.122-0.123=-0.000
min2.877-8.373=-5.496
max3.200-8.683=-5.483

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.436-0.993=0.443
σ0.185-0.142=0.043
min1.118-0.923=0.196
max1.577-1.247=0.330

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.610-462.699=-19.089
σ577.065-574.941=2.124
min155.074-175.223=-20.149
max1309.208-1325.111=-15.903
mean96.250-86.250=10.000
σ8.500
min92.000-82.000=10.000
max109.000-99.000=10.000
mean1650.000-2757.000=-1107.000
σ0.000
min1650.000-2757.000=-1107.000
max1650.000-2757.000=-1107.000
mean0.545-0.562=-0.017
σ0.564-0.568=-0.004
min0.258-0.275=-0.017
max1.391-1.414=-0.023
policies=20
mean1551.045-1752.491=-201.446
σ0.331-0.354=-0.023
min1550.819-1752.265=-201.446
max1551.537-1753.020=-201.482
mean920.000-820.000=100.000
σ0.000
min920.000-820.000=100.000
max920.000-820.000=100.000
mean1650.000-2757.000=-1107.000
σ0.000
min1650.000-2757.000=-1107.000
max1650.000-2757.000=-1107.000
mean2.599-2.730=-0.131
σ0.017-0.015=0.002
min2.575-2.715=-0.140
max2.615-2.748=-0.133
policies=200
mean15518.538-17532.226=-2013.688
σ0.092-0.528=-0.435
min15518.468-17531.864=-2013.396
max15518.664-17533.002=-2014.338
mean9200.000-8200.000=1000.000
σ0.000
min9200.000-8200.000=1000.000
max9200.000-8200.000=1000.000
mean1650.000-2757.000=-1107.000
σ0.000
min1650.000-2757.000=-1107.000
max1650.000-2757.000=-1107.000
mean26.243-27.581=-1.338
σ0.077-0.043=0.034
min26.178-27.535=-1.357
max26.354-27.637=-1.283