Compare commits

Home / Compare 4f64a31a .. a74b0e58

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-53.654=0.401
σ0.367-0.366=0.001
min53.911-53.516=0.395
max55.100-54.695=0.405
mean415.000-414.900=0.100
σ0.000-0.316=-0.316
min415.000-414.000=1.000
max415.000
mean0.141-0.138=0.003
σ0.005-0.003=0.001
min0.137-0.134=0.003
max0.149-0.143=0.007
cache=y
dps=1
iters=10
policies=100
mean43.395-42.981=0.413
σ0.006-0.006=0.000
min43.389-42.974=0.415
max43.405-42.990=0.415
mean415.000
σ0.000
min415.000
max415.000
mean0.121-0.122=-0.000
σ0.004-0.003=0.000
min0.116-0.116=0.000
max0.127-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1013.970=-6.965
σ1.187-1.167=0.020
min1006.432-1013.428=-6.996
max1011.981-1018.855=-6.874
mean1051.550-1052.550=-1.000
σ307.956-318.028=-10.071
min576.000-586.000=-10.000
max1644.000-1659.000=-15.000
mean1.532-1.633=-0.100
σ0.079-0.095=-0.015
min1.461-1.562=-0.101
max1.785-1.884=-0.100

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.427
σ0.131
min0.358
max0.660
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.886
σ0.090
min0.832
max1.046
name=heavy_item.art
mean1.525
σ0.001
min1.524
max1.527
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.535
σ0.045
min0.499
max0.607
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.365
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.857
σ0.040
min0.817
max0.922

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.837
σ0.033
min964.807
max964.891
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.784
σ0.070
min0.659
max0.822
name=cdr_enhanced_4k_loc.art
mean885.512
σ0.008
min885.504
max885.523
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.721
σ0.008
min0.711
max0.733

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716
σ0.002
min7.715
max7.719
mean1644.000
σ0.000
min1644.000
max1644.000
mean3.538
σ0.086
min3.416
max3.992
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1644.000
σ0.000
min1644.000
max1644.000
mean3.527
σ0.067
min3.399
max3.739
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.750
σ0.015
min0.722
max0.842
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.707
σ0.016
min0.678
max0.789

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.862-299.087=-2.224
σ0.220-0.279=-0.059
min296.647-298.908=-2.260
max297.453-299.862=-2.409
mean1900.000-2044.000=-144.000
σ0.000
min1900.000-2044.000=-144.000
max1900.000-2044.000=-144.000
mean0.568-0.587=-0.020
σ0.044-0.023=0.021
min0.506-0.554=-0.048
max0.639-0.621=0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.825-294.681=-7.856
σ0.039-0.016=0.023
min286.773-294.660=-7.886
max286.865-294.706=-7.840
mean1644.000-1659.000=-15.000
σ0.000
min1644.000-1659.000=-15.000
max1644.000-1659.000=-15.000
mean0.393-0.385=0.008
σ0.006-0.007=-0.001
min0.390-0.380=0.010
max0.403-0.396=0.007
iters=5
new-facts=1
prior-facts=6402
mean1297.248-1316.940=-19.693
σ0.032-0.097=-0.065
min1297.213-1316.891=-19.677
max1297.297-1317.114=-19.817
mean1644.000-1659.000=-15.000
σ0.000
min1644.000-1659.000=-15.000
max1644.000-1659.000=-15.000
mean2.149-1.945=0.204
σ0.251-0.084=0.167
min2.019-1.858=0.161
max2.596-2.034=0.563
iters=5
new-facts=6402
prior-facts=1
mean1541.324-1555.289=-13.965
σ6.848-6.866=-0.018
min1538.093-1551.994=-13.900
max1553.572-1567.566=-13.994
mean1644.000-1659.000=-15.000
σ0.000
min1644.000-1659.000=-15.000
max1644.000-1659.000=-15.000
mean2.278-2.314=-0.035
σ0.219-0.247=-0.028
min2.076-2.108=-0.032
max2.538-2.725=-0.187
iters=5
new-facts=6402
prior-facts=6402
mean1859.109-1884.777=-25.668
σ0.083-0.025=0.058
min1858.985-1884.750=-25.765
max1859.194-1884.818=-25.624
mean1773.200-1800.400=-27.200
σ126.044-166.844=-40.799
min1644.000-1659.000=-15.000
max1900.000-2044.000=-144.000
mean3.115-3.072=0.042
σ0.278-0.256=0.022
min2.811-2.897=-0.086
max3.535-3.516=0.019

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.294-1.162=0.132
σ0.335-0.214=0.121
min0.906-0.919=-0.013
max1.677-1.489=0.188

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-440.568=8.252
σ581.372-573.035=8.337
min158.133-154.045=4.088
max1320.879-1300.121=20.758
mean96.250
σ8.500
min92.000
max109.000
mean1644.000-1659.000=-15.000
σ0.000
min1644.000-1659.000=-15.000
max1644.000-1659.000=-15.000
mean0.552-0.539=0.014
σ0.575-0.541=0.033
min0.260-0.268=-0.007
max1.415-1.351=0.064
policies=20
mean1581.611-1540.718=40.893
σ0.359-0.327=0.032
min1581.376-1540.526=40.850
max1582.146-1541.208=40.938
mean920.000
σ0.000
min920.000
max920.000
mean1644.000-1659.000=-15.000
σ0.000
min1644.000-1659.000=-15.000
max1644.000-1659.000=-15.000
mean2.647-2.615=0.032
σ0.028-0.030=-0.002
min2.615-2.587=0.028
max2.679-2.655=0.024
policies=200
mean15824.171-15414.972=409.200
σ0.119-0.164=-0.045
min15824.079-15414.838=409.240
max15824.345-15415.196=409.149
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000-1659.000=-15.000
σ0.000
min1644.000-1659.000=-15.000
max1644.000-1659.000=-15.000
mean26.587-26.231=0.356
σ0.038-0.114=-0.076
min26.550-26.069=0.481
max26.623-26.312=0.311