Compare commits

Home / Compare 47df6b14 .. d3169b34

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.704
σ0.370
min53.556
max54.757
mean417.000
σ0.000
min417.000
max417.000
mean0.138
σ0.006
min0.129
max0.146
cache=y
dps=1
iters=10
policies=100
mean43.058
σ0.006
min43.047
max43.065
mean417.000
σ0.000
min417.000
max417.000
mean0.120
σ0.005
min0.115
max0.129

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.101
σ0.888
min1004.635
max1008.782
mean1044.600
σ293.905
min575.000
max1462.000
mean1.621
σ0.063
min1.513
max1.745

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1462.000
σ0.000
min1462.000
max1462.000
mean0.410
σ0.122
min0.330
max0.624
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1462.000
σ0.000
min1462.000
max1462.000
mean0.872
σ0.088
min0.819
max1.026
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1462.000
σ0.000
min1462.000
max1462.000
mean0.538
σ0.055
min0.495
max0.634
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1462.000
σ0.000
min1462.000
max1462.000
mean0.872
σ0.069
min0.816
max0.973

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.541
σ0.028
min963.523
max963.590
mean1462.000
σ0.000
min1462.000
max1462.000
mean0.824
σ0.052
min0.738
max0.860
name=cdr_enhanced_4k_loc.art
mean884.853
σ0.006
min884.847
max884.860
mean1462.000
σ0.000
min1462.000
max1462.000
mean0.729
σ0.016
min0.704
max0.742

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706
σ0.002
min7.705
max7.709
mean1462.000
σ0.000
min1462.000
max1462.000
mean4.274
σ0.070
min4.143
max4.536
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1462.000
σ0.000
min1462.000
max1462.000
mean4.260
σ0.081
min4.129
max4.602
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1462.000
σ0.000
min1462.000
max1462.000
mean0.744
σ0.019
min0.712
max0.859
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1462.000
σ0.000
min1462.000
max1462.000
mean0.705
σ0.015
min0.677
max0.798

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.415
σ0.239
min294.241
max295.072
mean1906.000
σ0.000
min1906.000
max1906.000
mean0.574
σ0.040
min0.506
max0.656

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.497
σ0.037
min281.453
max281.537
mean1462.000
σ0.000
min1462.000
max1462.000
mean0.393
σ0.006
min0.387
max0.400
iters=5
new-facts=1
prior-facts=6402
mean1291.475
σ0.104
min1291.348
max1291.591
mean1462.000
σ0.000
min1462.000
max1462.000
mean2.009
σ0.275
min1.818
max2.484
iters=5
new-facts=6402
prior-facts=1
mean1534.328
σ4.005
min1532.278
max1541.483
mean1462.000
σ0.000
min1462.000
max1462.000
mean2.271
σ0.194
min2.044
max2.486
iters=5
new-facts=6402
prior-facts=6402
mean1853.355
σ0.051
min1853.305
max1853.426
mean1759.600
σ171.024
min1505.000
max1906.000
mean2.968
σ0.087
min2.882
max3.108

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.812
σ0.095
min1.691
max1.937

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.428
σ577.065
min153.894
max1308.025
mean96.250
σ8.500
min92.000
max109.000
mean1462.000
σ0.000
min1462.000
max1462.000
mean0.555
σ0.595
min0.257
max1.448
policies=20
mean1539.217
σ0.328
min1538.992
max1539.705
mean920.000
σ0.000
min920.000
max920.000
mean1462.000
σ0.000
min1462.000
max1462.000
mean2.583
σ0.027
min2.567
max2.622
policies=200
mean15400.382
σ0.113
min15400.219
max15400.482
mean9200.000
σ0.000
min9200.000
max9200.000
mean1462.000
σ0.000
min1462.000
max1462.000
mean26.118
σ0.089
min26.018
max26.213