Compare commits

Home / Compare c9fa4ccf .. f73bb643

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.031-54.031=-0.000
σ0.369-0.370=-0.001
min53.886-53.884=0.002
max55.079-55.083=-0.004
mean414.700-415.000=-0.300
σ0.483-0.000=0.483
min414.000-415.000=-1.000
max415.000
mean0.139-0.138=0.000
σ0.004-0.006=-0.002
min0.133-0.132=0.001
max0.144-0.151=-0.007
cache=y
dps=1
iters=10
policies=100
mean43.384-43.384=0.000
σ0.006-0.007=-0.001
min43.374-43.373=0.001
max43.392-43.396=-0.004
mean415.000
σ0.000
min415.000
max415.000
mean0.123-0.123=-0.000
σ0.004-0.003=0.001
min0.119-0.120=-0.000
max0.131-0.129=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.334-1006.336=-0.002
σ0.873-0.877=-0.004
min1005.836-1005.835=0.001
max1009.951-1009.956=-0.004
mean1055.600-1048.200=7.400
σ316.757-306.862=9.895
min564.000-573.000=-9.000
max1620.000-1643.000=-23.000
mean1.554-1.566=-0.012
σ0.075-0.099=-0.024
min1.480-1.486=-0.005
max1.763-1.865=-0.103

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.882=0.001
σ0.002-0.002=0.000
min0.881
max0.886
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean0.418-0.423=-0.004
σ0.128-0.127=0.001
min0.337-0.335=0.002
max0.645-0.635=0.010
name=error_case.art
mean2.334-2.334=-0.000
σ0.004-0.003=0.001
min2.332
max2.340-2.337=0.002
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean0.879-0.886=-0.007
σ0.080-0.080=0.000
min0.822-0.827=-0.005
max1.020-1.026=-0.006
name=heavy_item.art
mean1.521-1.521=0.001
σ0.002-0.001=0.001
min1.520
max1.524-1.523=0.001
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean0.542-0.539=0.003
σ0.059-0.057=0.002
min0.497-0.497=0.000
max0.639-0.635=0.004
name=nested_use.art
mean2.355-2.356=-0.001
σ0.002-0.002=-0.000
min2.355
max2.358
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean0.840-0.849=-0.009
σ0.036-0.046=-0.010
min0.811-0.815=-0.004
max0.898-0.927=-0.029

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-963.557=-0.005
σ0.024-0.031=-0.007
min963.524-963.532=-0.008
max963.583-963.609=-0.026
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean0.834-0.811=0.022
σ0.036-0.050=-0.013
min0.781-0.751=0.030
max0.865-0.863=0.001
name=cdr_enhanced_4k_loc.art
mean884.856-884.856=-0.001
σ0.009-0.005=0.003
min884.847-884.848=-0.001
max884.867-884.862=0.005
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean0.696-0.724=-0.028
σ0.031-0.024=0.007
min0.660-0.691=-0.031
max0.741-0.755=-0.014

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=-0.000
min7.705
max7.709-7.709=-0.000
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean4.273-4.269=0.005
σ0.094-0.084=0.010
min4.146-4.130=0.017
max4.604-4.737=-0.133
name=record_render_large_syntax_err.art
mean7.655-7.655=-0.000
σ0.002-0.002=-0.000
min7.654
max7.658-7.658=-0.000
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean4.240-4.269=-0.029
σ0.086-0.101=-0.015
min4.103-4.118=-0.015
max4.499-4.908=-0.409
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean0.746-0.746=-0.000
σ0.018-0.029=-0.011
min0.720-0.711=0.009
max0.862-0.941=-0.079
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean0.712-0.708=0.004
σ0.022-0.016=0.006
min0.630-0.678=-0.048
max0.802-0.800=0.002

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.525-295.468=0.057
σ0.227-0.202=0.024
min295.355-295.287=0.068
max296.135-296.021=0.115
mean1910.000-1891.000=19.000
σ0.000
min1910.000-1891.000=19.000
max1910.000-1891.000=19.000
mean0.573-0.581=-0.008
σ0.062-0.034=0.028
min0.505-0.510=-0.005
max0.715-0.611=0.104

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.241-285.247=-0.006
σ0.035-0.036=-0.002
min285.188-285.200=-0.012
max285.283-285.285=-0.002
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean0.391-0.383=0.008
σ0.009-0.001=0.008
min0.381-0.382=-0.001
max0.399-0.384=0.016
iters=5
new-facts=1
prior-facts=6402
mean1295.196-1295.191=0.006
σ0.105-0.107=-0.003
min1295.078-1295.075=0.003
max1295.311-1295.309=0.002
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean1.937-1.925=0.012
σ0.141-0.117=0.024
min1.785-1.815=-0.030
max2.138-2.100=0.038
iters=5
new-facts=6402
prior-facts=1
mean1538.118-1538.098=0.020
σ3.989-4.048=-0.059
min1536.094-1536.040=0.054
max1545.243-1545.327=-0.083
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean2.356-2.312=0.044
σ0.236-0.354=-0.118
min2.020-2.016=0.004
max2.678-2.789=-0.111
iters=5
new-facts=6402
prior-facts=6402
mean1857.106-1857.103=0.003
σ0.047-0.053=-0.007
min1857.060-1857.057=0.003
max1857.170-1857.183=-0.013
mean1766.600-1771.400=-4.800
σ139.236-121.115=18.122
min1620.000-1643.000=-23.000
max1910.000-1891.000=19.000
mean3.091-3.049=0.042
σ0.314-0.221=0.093
min2.862-2.860=0.001
max3.642-3.429=0.213

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.398-1.298=0.100
σ0.320-0.181=0.139
min1.114-1.110=0.004
max1.834-1.598=0.236

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.611-443.612=-0.001
σ577.065-577.066=-0.001
min155.076-155.076=0.001
max1309.208-1309.210=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean0.510-0.537=-0.027
σ0.498-0.547=-0.050
min0.259-0.262=-0.003
max1.257-1.358=-0.102
policies=20
mean1551.052-1551.061=-0.010
σ0.333-0.331=0.002
min1550.824-1550.838=-0.014
max1551.547-1551.553=-0.007
mean920.000
σ0.000
min920.000
max920.000
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean2.586-2.599=-0.013
σ0.015-0.011=0.004
min2.571-2.584=-0.013
max2.606-2.607=-0.001
policies=200
mean15518.730-15518.597=0.134
σ0.099-0.117=-0.019
min15518.635-15518.477=0.158
max15518.862-15518.756=0.105
mean9200.000
σ0.000
min9200.000
max9200.000
mean1620.000-1643.000=-23.000
σ0.000
min1620.000-1643.000=-23.000
max1620.000-1643.000=-23.000
mean26.127-26.203=-0.076
σ0.176-0.187=-0.011
min26.005-26.073=-0.068
max26.378-26.477=-0.099