Compare commits

Home / Compare f7769b2c .. 23a747fe

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.014=-0.000
σ0.368-0.371=-0.003
min53.866-53.877=-0.010
max55.060-55.069=-0.009
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.138-0.139=-0.001
σ0.004-0.004=-0.000
min0.135-0.136=-0.001
max0.144-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.321-43.322=-0.000
σ0.006-0.007=-0.001
min43.313-43.312=0.001
max43.334-43.335=-0.001
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.122-0.120=0.002
σ0.004-0.005=-0.000
min0.118-0.113=0.004
max0.130-0.127=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1006.309=0.001
σ1.182-1.167=0.015
min1005.765-1005.766=-0.001
max1011.267-1011.194=0.073
mean1051.150-1048.550=2.600
σ303.691-313.783=-10.092
min586.000-597.000=-11.000
max1640.000-1644.000=-4.000
mean1.561-1.566=-0.005
σ0.103-0.101=0.002
min1.471-1.470=0.002
max1.820-1.821=-0.001

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1640.000
σ0.000
min1640.000
max1640.000
mean0.423
σ0.140
min0.330
max0.670
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1640.000
σ0.000
min1640.000
max1640.000
mean0.916
σ0.102
min0.832
max1.090
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1640.000
σ0.000
min1640.000
max1640.000
mean0.551
σ0.056
min0.493
max0.625
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1640.000
σ0.000
min1640.000
max1640.000
mean0.870
σ0.062
min0.827
max0.979

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113
σ0.031
min964.088
max964.164
mean1640.000
σ0.000
min1640.000
max1640.000
mean0.811
σ0.030
min0.783
max0.858
name=cdr_enhanced_4k_loc.art
mean884.711
σ0.007
min884.705
max884.721
mean1640.000
σ0.000
min1640.000
max1640.000
mean0.710
σ0.040
min0.642
max0.739

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715
σ0.002
min7.714
max7.718
mean1640.000
σ0.000
min1640.000
max1640.000
mean4.214
σ0.081
min4.094
max4.663
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.669
mean1640.000
σ0.000
min1640.000
max1640.000
mean4.196
σ0.060
min4.094
max4.476
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1640.000
σ0.000
min1640.000
max1640.000
mean0.753
σ0.044
min0.714
max1.062
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1640.000
σ0.000
min1640.000
max1640.000
mean0.705
σ0.022
min0.671
max0.781

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.277-296.165=0.113
σ0.279-0.232=0.047
min295.980-295.956=0.024
max296.999-296.794=0.205
mean1902.000-1948.000=-46.000
σ0.000
min1902.000-1948.000=-46.000
max1902.000-1948.000=-46.000
mean0.568-0.547=0.021
σ0.043-0.031=0.012
min0.512-0.509=0.002
max0.652-0.580=0.071

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.704-284.694=0.010
σ0.027-0.039=-0.012
min284.677-284.643=0.034
max284.735-284.742=-0.006
mean1640.000-1644.000=-4.000
σ0.000
min1640.000-1644.000=-4.000
max1640.000-1644.000=-4.000
mean0.392-0.401=-0.009
σ0.007-0.008=-0.001
min0.384-0.387=-0.003
max0.403-0.406=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.077-1295.057=0.020
σ0.105-0.084=0.021
min1294.960-1294.952=0.008
max1295.206-1295.169=0.037
mean1640.000-1644.000=-4.000
σ0.000
min1640.000-1644.000=-4.000
max1640.000-1644.000=-4.000
mean1.917-1.907=0.011
σ0.104-0.058=0.046
min1.808-1.813=-0.006
max2.037-1.964=0.074
iters=5
new-facts=6402
prior-facts=1
mean1539.184-1539.194=-0.010
σ6.828-6.884=-0.056
min1535.950-1535.885=0.065
max1551.395-1551.502=-0.108
mean1640.000-1644.000=-4.000
σ0.000
min1640.000-1644.000=-4.000
max1640.000-1644.000=-4.000
mean2.213-2.287=-0.074
σ0.180-0.240=-0.061
min2.058-2.025=0.034
max2.489-2.630=-0.142
iters=5
new-facts=6402
prior-facts=6402
mean1856.989-1856.993=-0.004
σ0.059-0.066=-0.008
min1856.932-1856.914=0.017
max1857.076-1857.087=-0.011
mean1773.200-1763.200=10.000
σ128.550-126.496=2.055
min1640.000-1644.000=-4.000
max1902.000-1948.000=-46.000
mean3.045-2.927=0.118
σ0.272-0.127=0.145
min2.827-2.783=0.044
max3.502-3.076=0.427

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.197-1.203=-0.005
σ0.289-0.302=-0.013
min0.927-0.941=-0.013
max1.672-1.706=-0.034

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.784-447.805=-0.022
σ581.212-581.236=-0.023
min157.176-157.187=-0.011
max1319.602-1319.659=-0.057
mean96.250
σ8.500
min92.000
max109.000
mean1640.000-1644.000=-4.000
σ0.000
min1640.000-1644.000=-4.000
max1640.000-1644.000=-4.000
mean0.535-0.525=0.010
σ0.553-0.526=0.026
min0.257-0.259=-0.002
max1.364-1.315=0.049
policies=20
mean1572.089-1572.125=-0.036
σ0.363-0.325=0.037
min1571.841-1571.947=-0.105
max1572.628-1572.613=0.015
mean920.000
σ0.000
min920.000
max920.000
mean1640.000-1644.000=-4.000
σ0.000
min1640.000-1644.000=-4.000
max1640.000-1644.000=-4.000
mean2.628-2.628=-0.000
σ0.024-0.011=0.013
min2.599-2.612=-0.013
max2.658-2.638=0.020
policies=200
mean15729.009-15728.869=0.139
σ0.167-0.150=0.018
min15728.823-15728.752=0.071
max15729.208-15729.082=0.127
mean9200.000
σ0.000
min9200.000
max9200.000
mean1640.000-1644.000=-4.000
σ0.000
min1640.000-1644.000=-4.000
max1640.000-1644.000=-4.000
mean26.496-26.671=-0.175
σ0.130-0.221=-0.091
min26.402-26.488=-0.086
max26.688-26.960=-0.272