Compare commits

Home / Compare 86ad7fe7 .. bf362964

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.016-54.015=0.001
σ0.369-0.370=-0.001
min53.876-53.872=0.004
max55.065-55.067=-0.001
mean416.900-415.000=1.900
σ0.316-0.000=0.316
min416.000-415.000=1.000
max417.000-415.000=2.000
mean0.140-0.141=-0.001
σ0.004-0.004=-0.000
min0.133-0.136=-0.003
max0.146-0.146=0.000
cache=y
dps=1
iters=10
policies=100
mean43.322-43.321=0.000
σ0.006-0.006=-0.000
min43.314-43.313=0.000
max43.337-43.335=0.003
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.120-0.122=-0.003
σ0.003-0.004=-0.001
min0.115-0.119=-0.004
max0.124-0.128=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1006.306=0.003
σ1.162-1.223=-0.060
min1005.741-1005.777=-0.035
max1011.177-1011.440=-0.263
mean1044.400-1047.700=-3.300
σ312.550-305.196=7.354
min577.000-593.000=-16.000
max1634.000-1640.000=-6.000
mean1.564-1.572=-0.009
σ0.094-0.111=-0.017
min1.473-1.504=-0.031
max1.833-1.986=-0.153

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean0.408-0.411=-0.003
σ0.136-0.144=-0.008
min0.327-0.325=0.002
max0.649-0.666=-0.016
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean0.890-0.893=-0.002
σ0.088-0.094=-0.006
min0.838-0.823=0.014
max1.047-1.057=-0.011
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean0.544-0.543=0.001
σ0.054-0.057=-0.003
min0.512-0.500=0.012
max0.639-0.640=-0.001
name=nested_use.art
mean2.360-2.360=-0.000
σ0.002-0.002=0.000
min2.359
max2.363
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean0.850-0.849=0.001
σ0.039-0.049=-0.010
min0.825-0.797=0.028
max0.919-0.923=-0.005

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.115=0.001
σ0.035-0.033=0.002
min964.086-964.087=-0.000
max964.173-964.170=0.003
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean0.832-0.818=0.014
σ0.043-0.059=-0.016
min0.765-0.728=0.037
max0.867-0.862=0.005
name=cdr_enhanced_4k_loc.art
mean884.711-884.712=-0.001
σ0.008-0.008=0.000
min884.703-884.705=-0.001
max884.723-884.723=-0.000
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean0.683-0.710=-0.027
σ0.073-0.035=0.038
min0.595-0.653=-0.058
max0.742-0.738=0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean4.261-4.213=0.048
σ0.102-0.086=0.016
min4.103-4.058=0.046
max4.732-4.737=-0.005
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean4.211-4.194=0.017
σ0.086-0.075=0.012
min4.065-4.067=-0.002
max4.467-4.449=0.018
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean0.742-0.731=0.012
σ0.020-0.018=0.002
min0.719-0.704=0.015
max0.895-0.852=0.044
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean0.705-0.700=0.005
σ0.016-0.015=0.001
min0.671-0.672=-0.001
max0.791-0.788=0.003

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.324-296.180=0.144
σ0.165-0.217=-0.053
min296.191-296.051=0.139
max296.751-296.778=-0.026
mean1899.000-1901.000=-2.000
σ0.000
min1899.000-1901.000=-2.000
max1899.000-1901.000=-2.000
mean0.603-0.588=0.015
σ0.016-0.042=-0.026
min0.574-0.513=0.061
max0.635-0.673=-0.038

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.694-284.689=0.004
σ0.038-0.035=0.003
min284.640-284.641=-0.001
max284.732-284.728=0.004
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean0.398-0.396=0.002
σ0.009-0.011=-0.002
min0.389-0.383=0.006
max0.407-0.404=0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.071-1295.077=-0.006
σ0.107-0.110=-0.003
min1294.946-1294.960=-0.014
max1295.213-1295.215=-0.002
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean2.008-1.918=0.090
σ0.122-0.100=0.022
min1.833-1.812=0.021
max2.168-2.039=0.129
iters=5
new-facts=6402
prior-facts=1
mean1539.206-1539.187=0.019
σ6.839-6.848=-0.010
min1535.958-1535.941=0.017
max1551.437-1551.435=0.002
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean2.155-2.252=-0.098
σ0.139-0.255=-0.116
min2.043-2.045=-0.002
max2.391-2.621=-0.230
iters=5
new-facts=6402
prior-facts=6402
mean1856.980-1856.988=-0.007
σ0.052-0.051=0.001
min1856.936-1856.944=-0.007
max1857.058-1857.068=-0.009
mean1779.600-1769.600=10.000
σ125.532-128.910=-3.378
min1634.000-1640.000=-6.000
max1899.000-1901.000=-2.000
mean2.987-3.056=-0.070
σ0.099-0.276=-0.178
min2.832-2.837=-0.004
max3.107-3.538=-0.431

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.224-1.191=0.033
σ0.212-0.285=-0.073
min0.954-0.934=0.020
max1.511-1.659=-0.148

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.784=0.001
σ581.213-581.212=0.000
min157.179-157.177=0.002
max1319.604-1319.603=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean0.543-0.536=0.007
σ0.566-0.560=0.007
min0.254-0.253=0.002
max1.393-1.375=0.018
policies=20
mean1572.103-1572.083=0.020
σ0.355-0.356=-0.002
min1571.863-1571.844=0.019
max1572.630-1572.613=0.017
mean920.000
σ0.000
min920.000
max920.000
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean2.631-2.629=0.002
σ0.009-0.025=-0.016
min2.622-2.601=0.021
max2.639-2.661=-0.022
policies=200
mean15729.033-15728.982=0.051
σ0.047-0.141=-0.094
min15728.976-15728.829=0.147
max15729.077-15729.169=-0.092
mean9200.000
σ0.000
min9200.000
max9200.000
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean26.501-26.537=-0.035
σ0.032-0.027=0.004
min26.459-26.497=-0.039
max26.535-26.559=-0.025