Compare commits

Home / Compare 582525c6 .. 0388faf2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.703-53.705=-0.003
σ0.368-0.369=-0.001
min53.560-53.568=-0.008
max54.748-54.754=-0.006
mean415.700-415.000=0.700
σ0.483-0.000=0.483
min415.000
max416.000-415.000=1.000
mean0.138-0.139=-0.001
σ0.004-0.004=0.000
min0.131-0.135=-0.004
max0.145-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.060-43.059=0.001
σ0.006-0.006=-0.000
min43.053-43.053=0.000
max43.069-43.070=-0.001
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.123-0.119=0.004
σ0.005-0.004=0.001
min0.118-0.114=0.004
max0.135-0.125=0.010

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.105-1005.106=-0.001
σ0.899-0.884=0.015
min1004.644-1004.636=0.008
max1008.839-1008.759=0.080
mean1051.450-1046.950=4.500
σ310.308-316.952=-6.644
min561.000-572.000=-11.000
max1649.000-1652.000=-3.000
mean1.626-1.635=-0.009
σ0.055-0.086=-0.030
min1.551-1.503=0.047
max1.738-1.876=-0.138

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.882=0.001
σ0.002-0.002=-0.000
min0.881
max0.886
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean0.418-0.413=0.006
σ0.135-0.132=0.004
min0.335-0.335=0.000
max0.659-0.646=0.013
name=error_case.art
mean2.335-2.334=0.000
σ0.002-0.003=-0.001
min2.333-2.332=0.001
max2.337-2.338=-0.001
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean0.878-0.900=-0.022
σ0.103-0.087=0.016
min0.816-0.837=-0.020
max1.054-1.052=0.003
name=heavy_item.art
mean1.521-1.521=0.000
σ0.001-0.001=0.000
min1.520
max1.523
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean0.540-0.552=-0.012
σ0.050-0.056=-0.006
min0.505-0.515=-0.010
max0.627-0.651=-0.024
name=nested_use.art
mean2.356-2.357=-0.000
σ0.003-0.002=0.000
min2.355
max2.360-2.360=0.000
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean0.838-0.853=-0.014
σ0.038-0.042=-0.004
min0.813-0.800=0.013
max0.905-0.915=-0.011

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.554-963.551=0.003
σ0.027-0.020=0.007
min963.531-963.531=0.001
max963.595-963.584=0.011
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean0.843-0.802=0.041
σ0.020-0.010=0.009
min0.820-0.791=0.029
max0.862-0.816=0.045
name=cdr_enhanced_4k_loc.art
mean884.857-884.857=0.000
σ0.004-0.004=0.000
min884.851
max884.861-884.862=-0.001
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean0.728-0.714=0.014
σ0.028-0.035=-0.007
min0.681-0.670=0.011
max0.748-0.742=0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=-0.000
min7.705
max7.710-7.711=-0.001
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean4.250-4.202=0.048
σ0.075-0.094=-0.019
min4.122-4.076=0.046
max4.670-4.688=-0.018
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean4.240-4.200=0.041
σ0.072-0.074=-0.002
min4.068-4.102=-0.034
max4.474-4.482=-0.008
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean0.735-0.619=0.115
σ0.028-0.108=-0.079
min0.684-0.511=0.174
max0.872-0.871=0.001
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean0.707-0.510=0.197
σ0.016-0.016=-0.001
min0.679-0.486=0.194
max0.766-0.610=0.156

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.215-294.392=-0.177
σ0.248-0.234=0.014
min294.091-294.176=-0.085
max294.914-295.021=-0.107
mean1895.000-1908.000=-13.000
σ0.000
min1895.000-1908.000=-13.000
max1895.000-1908.000=-13.000
mean0.564-0.564=-0.000
σ0.047-0.036=0.011
min0.497-0.503=-0.006
max0.642-0.603=0.040

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.494-281.499=-0.005
σ0.041-0.037=0.004
min281.438-281.448=-0.010
max281.536-281.536=-0.001
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean0.397-0.385=0.012
σ0.009-0.007=0.002
min0.386-0.378=0.007
max0.405-0.395=0.011
iters=5
new-facts=1
prior-facts=6402
mean1291.472-1291.484=-0.012
σ0.103-0.109=-0.006
min1291.361-1291.366=-0.005
max1291.604-1291.620=-0.016
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean1.918-1.895=0.023
σ0.099-0.063=0.036
min1.810-1.824=-0.015
max2.029-1.966=0.063
iters=5
new-facts=6402
prior-facts=1
mean1534.349-1534.355=-0.006
σ4.020-3.972=0.048
min1532.319-1532.338=-0.019
max1541.533-1541.449=0.084
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean2.187-2.354=-0.167
σ0.173-0.166=0.007
min2.033-2.165=-0.131
max2.460-2.622=-0.162
iters=5
new-facts=6402
prior-facts=6402
mean1853.357-1853.355=0.002
σ0.058-0.050=0.008
min1853.303-1853.306=-0.003
max1853.441-1853.423=0.018
mean1781.800-1777.600=4.200
σ118.422-125.121=-6.699
min1649.000-1652.000=-3.000
max1895.000-1908.000=-13.000
mean2.988-3.077=-0.089
σ0.089-0.269=-0.180
min2.887-2.877=0.010
max3.117-3.550=-0.433

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.301-1.314=-0.013
σ0.247-0.292=-0.044
min1.092-1.089=0.003
max1.710-1.811=-0.101

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.429-442.427=0.003
σ577.064-577.065=-0.001
min153.896-153.892=0.004
max1308.026-1308.024=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean0.542-0.536=0.006
σ0.555-0.542=0.013
min0.260-0.260=-0.001
max1.373-1.349=0.024
policies=20
mean1539.216-1539.212=0.004
σ0.320-0.328=-0.009
min1538.995-1538.987=0.009
max1539.690-1539.699=-0.009
mean920.000
σ0.000
min920.000
max920.000
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean2.573-2.582=-0.009
σ0.020-0.021=-0.002
min2.545-2.553=-0.007
max2.588-2.603=-0.015
policies=200
mean15400.493-15400.377=0.116
σ0.104-0.060=0.043
min15400.412-15400.301=0.111
max15400.634-15400.438=0.196
mean9200.000
σ0.000
min9200.000
max9200.000
mean1649.000-1652.000=-3.000
σ0.000
min1649.000-1652.000=-3.000
max1649.000-1652.000=-3.000
mean26.054-26.154=-0.100
σ0.045-0.094=-0.049
min25.994-26.087=-0.093
max26.100-26.292=-0.192