Compare commits

Home / Compare 6df31c1e .. 6f37295a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.704-53.704=-0.000
σ0.368-0.370=-0.002
min53.569-53.565=0.005
max54.750-54.756=-0.006
mean418.700-416.000=2.700
σ0.483-0.000=0.483
min418.000-416.000=2.000
max419.000-416.000=3.000
mean0.138-0.139=-0.001
σ0.005-0.004=0.001
min0.132-0.135=-0.003
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.058-43.060=-0.002
σ0.007-0.008=-0.001
min43.050-43.046=0.004
max43.071-43.071=-0.000
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.122-0.120=0.002
σ0.005-0.004=0.000
min0.118-0.116=0.003
max0.129-0.126=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.100-1005.108=-0.008
σ0.869-0.884=-0.015
min1004.630-1004.633=-0.003
max1008.698-1008.768=-0.070
mean1053.500-1052.850=0.650
σ320.320-315.588=4.732
min554.000-596.000=-42.000
max1630.000-1655.000=-25.000
mean1.631-1.618=0.014
σ0.086-0.062=0.023
min1.553-1.555=-0.003
max1.850-1.777=0.073

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1630.000-1655.000=-25.000
σ0.000
min1630.000-1655.000=-25.000
max1630.000-1655.000=-25.000
mean0.420-0.422=-0.003
σ0.123-0.124=-0.000
min0.333-0.346=-0.013
max0.636-0.639=-0.002
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1630.000-1655.000=-25.000
σ0.000
min1630.000-1655.000=-25.000
max1630.000-1655.000=-25.000
mean0.878-0.896=-0.018
σ0.085-0.087=-0.002
min0.818-0.842=-0.024
max1.028-1.051=-0.023
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1630.000-1655.000=-25.000
σ0.000
min1630.000-1655.000=-25.000
max1630.000-1655.000=-25.000
mean0.550-0.540=0.010
σ0.053-0.050=0.003
min0.505-0.494=0.011
max0.642-0.615=0.027
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1630.000-1655.000=-25.000
σ0.000
min1630.000-1655.000=-25.000
max1630.000-1655.000=-25.000
mean0.832-0.839=-0.007
σ0.039-0.040=-0.002
min0.799-0.802=-0.004
max0.898-0.905=-0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.553-963.557=-0.004
σ0.029-0.026=0.003
min963.524-963.539=-0.015
max963.601-963.604=-0.003
mean1630.000-1655.000=-25.000
σ0.000
min1630.000-1655.000=-25.000
max1630.000-1655.000=-25.000
mean0.798-0.789=0.009
σ0.070-0.046=0.024
min0.700-0.711=-0.011
max0.865-0.835=0.030
name=cdr_enhanced_4k_loc.art
mean884.856-884.856=-0.000
σ0.009-0.006=0.003
min884.847
max884.867-884.861=0.005
mean1630.000-1655.000=-25.000
σ0.000
min1630.000-1655.000=-25.000
max1630.000-1655.000=-25.000
mean0.725-0.724=0.001
σ0.037-0.024=0.013
min0.667-0.687=-0.020
max0.751-0.743=0.008

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=-0.000
min7.705
max7.709-7.711=-0.001
mean1630.000-1655.000=-25.000
σ0.000
min1630.000-1655.000=-25.000
max1630.000-1655.000=-25.000
mean4.272-3.581=0.691
σ0.091-0.194=-0.103
min4.114-3.425=0.689
max4.587-4.492=0.096
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1630.000-1655.000=-25.000
σ0.000
min1630.000-1655.000=-25.000
max1630.000-1655.000=-25.000
mean4.183-3.534=0.648
σ0.252-0.079=0.173
min3.424-3.397=0.028
max4.548-3.794=0.754
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1630.000-1655.000=-25.000
σ0.000
min1630.000-1655.000=-25.000
max1630.000-1655.000=-25.000
mean0.746-0.752=-0.006
σ0.019-0.017=0.002
min0.713-0.721=-0.009
max0.856-0.852=0.004
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1630.000-1655.000=-25.000
σ0.000
min1630.000-1655.000=-25.000
max1630.000-1655.000=-25.000
mean0.708-0.709=-0.002
σ0.016-0.014=0.002
min0.676-0.674=0.002
max0.783-0.772=0.011

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.337-294.148=0.189
σ0.219-0.288=-0.069
min294.089-293.899=0.190
max294.871-294.900=-0.030
mean1922.000-1900.000=22.000
σ0.000
min1922.000-1900.000=22.000
max1922.000-1900.000=22.000
mean0.581-0.582=-0.001
σ0.058-0.031=0.027
min0.497-0.525=-0.028
max0.702-0.635=0.067

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.495-281.492=0.003
σ0.041-0.037=0.004
min281.446-281.442=0.004
max281.537-281.527=0.010
mean1630.000-1655.000=-25.000
σ0.000
min1630.000-1655.000=-25.000
max1630.000-1655.000=-25.000
mean0.385-0.387=-0.001
σ0.006-0.008=-0.003
min0.377-0.377=-0.000
max0.390-0.397=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1291.486-1291.486=-0.001
σ0.111-0.116=-0.005
min1291.363-1291.358=0.005
max1291.622-1291.626=-0.004
mean1630.000-1655.000=-25.000
σ0.000
min1630.000-1655.000=-25.000
max1630.000-1655.000=-25.000
mean1.891-1.884=0.007
σ0.079-0.112=-0.033
min1.814-1.723=0.092
max2.012-1.985=0.027
iters=5
new-facts=6402
prior-facts=1
mean1534.350-1534.313=0.036
σ3.985-4.003=-0.017
min1532.333-1532.296=0.038
max1541.469-1541.464=0.005
mean1630.000-1655.000=-25.000
σ0.000
min1630.000-1655.000=-25.000
max1630.000-1655.000=-25.000
mean2.350-2.261=0.088
σ0.225-0.197=0.028
min2.025-2.021=0.004
max2.587-2.491=0.096
iters=5
new-facts=6402
prior-facts=6402
mean1853.358-1853.353=0.005
σ0.049-0.054=-0.005
min1853.310-1853.306=0.004
max1853.427-1853.432=-0.005
mean1779.000-1784.200=-5.200
σ140.021-119.318=20.704
min1630.000-1655.000=-25.000
max1922.000-1900.000=22.000
mean3.053-2.929=0.124
σ0.268-0.042=0.225
min2.862-2.863=-0.001
max3.518-2.961=0.557

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.422-1.252=0.169
σ0.317-0.335=-0.018
min1.105-0.992=0.113
max1.873-1.832=0.040

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.429-442.429=-0.000
σ577.065-577.064=0.001
min153.893-153.893=0.000
max1308.026-1308.025=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1630.000-1655.000=-25.000
σ0.000
min1630.000-1655.000=-25.000
max1630.000-1655.000=-25.000
mean0.515-0.506=0.009
σ0.517-0.498=0.019
min0.255-0.255=0.001
max1.290-1.253=0.037
policies=20
mean1539.227-1539.224=0.003
σ0.325-0.318=0.007
min1539.006-1539.006=-0.000
max1539.711-1539.697=0.014
mean920.000
σ0.000
min920.000
max920.000
mean1630.000-1655.000=-25.000
σ0.000
min1630.000-1655.000=-25.000
max1630.000-1655.000=-25.000
mean2.584-2.577=0.007
σ0.023-0.013=0.011
min2.555-2.560=-0.005
max2.610-2.590=0.020
policies=200
mean15400.457-15400.387=0.069
σ0.072-0.024=0.048
min15400.397-15400.358=0.039
max15400.557-15400.409=0.148
mean9200.000
σ0.000
min9200.000
max9200.000
mean1630.000-1655.000=-25.000
σ0.000
min1630.000-1655.000=-25.000
max1630.000-1655.000=-25.000
mean26.116-26.022=0.094
σ0.107-0.134=-0.027
min25.997-25.903=0.094
max26.254-26.213=0.041