Compare commits

Home / Compare f7359aed .. 58a04565

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.126-54.127=-0.001
σ0.350-0.351=-0.002
min53.992-53.990=0.002
max55.121-55.127=-0.006
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.139-0.140=-0.001
σ0.004-0.004=-0.000
min0.133-0.137=-0.004
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.404-43.403=0.001
σ0.006-0.006=-0.000
min43.394-43.392=0.001
max43.415-43.414=0.002
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.123-0.119=0.004
σ0.003-0.005=-0.002
min0.120-0.114=0.006
max0.128-0.127=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.331-1006.328=0.003
σ0.889-0.914=-0.025
min1005.836-1005.863=-0.027
max1010.023-1010.124=-0.101
mean1047.750-1052.850=-5.100
σ311.133-310.136=0.997
min563.000-556.000=7.000
max1642.000-1647.000=-5.000
mean1.547-1.558=-0.011
σ0.066-0.102=-0.036
min1.478-1.481=-0.003
max1.668-1.851=-0.184

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.881
max0.886
mean1642.000-1647.000=-5.000
σ0.000
min1642.000-1647.000=-5.000
max1642.000-1647.000=-5.000
mean0.450-0.428=0.022
σ0.171-0.129=0.041
min0.356-0.342=0.014
max0.755-0.657=0.098
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1642.000-1647.000=-5.000
σ0.000
min1642.000-1647.000=-5.000
max1642.000-1647.000=-5.000
mean0.912-0.897=0.014
σ0.140-0.097=0.043
min0.821-0.833=-0.013
max1.160-1.070=0.090
name=heavy_item.art
mean1.521-1.522=-0.001
σ0.002-0.002=-0.000
min1.520
max1.524-1.526=-0.002
mean1642.000-1647.000=-5.000
σ0.000
min1642.000-1647.000=-5.000
max1642.000-1647.000=-5.000
mean0.541-0.545=-0.003
σ0.054-0.046=0.008
min0.497-0.505=-0.008
max0.630-0.613=0.018
name=nested_use.art
mean2.355-2.356=-0.001
σ0.002-0.002=0.000
min2.355
max2.358
mean1642.000-1647.000=-5.000
σ0.000
min1642.000-1647.000=-5.000
max1642.000-1647.000=-5.000
mean0.850-0.845=0.005
σ0.040-0.035=0.005
min0.808-0.817=-0.009
max0.912-0.906=0.006

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-963.553=-0.001
σ0.025-0.023=0.003
min963.523-963.536=-0.013
max963.584-963.590=-0.006
mean1642.000-1647.000=-5.000
σ0.000
min1642.000-1647.000=-5.000
max1642.000-1647.000=-5.000
mean0.815-0.836=-0.021
σ0.042-0.027=0.016
min0.756-0.804=-0.047
max0.858-0.858=0.000
name=cdr_enhanced_4k_loc.art
mean884.855-884.853=0.002
σ0.005-0.008=-0.003
min884.847
max884.861-884.866=-0.005
mean1642.000-1647.000=-5.000
σ0.000
min1642.000-1647.000=-5.000
max1642.000-1647.000=-5.000
mean0.713-0.733=-0.020
σ0.032-0.034=-0.002
min0.668-0.672=-0.004
max0.740-0.753=-0.013

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.711-7.709=0.001
mean1642.000-1647.000=-5.000
σ0.000
min1642.000-1647.000=-5.000
max1642.000-1647.000=-5.000
mean4.276-4.307=-0.031
σ0.094-0.090=0.004
min4.128-4.163=-0.035
max4.593-4.611=-0.017
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1642.000-1647.000=-5.000
σ0.000
min1642.000-1647.000=-5.000
max1642.000-1647.000=-5.000
mean4.252-4.279=-0.027
σ0.092-0.089=0.003
min4.117-4.150=-0.033
max4.548-4.578=-0.030
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1642.000-1647.000=-5.000
σ0.000
min1642.000-1647.000=-5.000
max1642.000-1647.000=-5.000
mean0.763-0.769=-0.006
σ0.030-0.016=0.014
min0.725-0.737=-0.012
max0.929-0.870=0.059
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1642.000-1647.000=-5.000
σ0.000
min1642.000-1647.000=-5.000
max1642.000-1647.000=-5.000
mean0.720-0.729=-0.010
σ0.016-0.016=0.000
min0.683-0.698=-0.015
max0.787-0.807=-0.020

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.533-295.503=0.030
σ0.264-0.224=0.040
min295.291-295.279=0.012
max296.234-296.098=0.136
mean1919.000-1903.000=16.000
σ0.000
min1919.000-1903.000=16.000
max1919.000-1903.000=16.000
mean0.596-0.559=0.038
σ0.040-0.060=-0.021
min0.566-0.501=0.065
max0.700-0.689=0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.257-285.250=0.007
σ0.037-0.037=0.000
min285.205-285.208=-0.002
max285.294-285.290=0.005
mean1642.000-1647.000=-5.000
σ0.000
min1642.000-1647.000=-5.000
max1642.000-1647.000=-5.000
mean0.415-0.407=0.008
σ0.014-0.012=0.003
min0.402-0.395=0.007
max0.439-0.422=0.017
iters=5
new-facts=1
prior-facts=6402
mean1295.203-1295.198=0.004
σ0.114-0.107=0.007
min1295.085-1295.077=0.008
max1295.356-1295.316=0.040
mean1642.000-1647.000=-5.000
σ0.000
min1642.000-1647.000=-5.000
max1642.000-1647.000=-5.000
mean1.902-1.939=-0.037
σ0.073-0.112=-0.039
min1.815-1.810=0.005
max1.978-2.056=-0.078
iters=5
new-facts=6402
prior-facts=1
mean1538.153-1538.077=0.076
σ4.008-4.045=-0.036
min1536.073-1536.053=0.020
max1545.313-1545.304=0.009
mean1642.000-1647.000=-5.000
σ0.000
min1642.000-1647.000=-5.000
max1642.000-1647.000=-5.000
mean2.434-2.240=0.193
σ0.286-0.153=0.133
min2.100-2.050=0.050
max2.754-2.397=0.357
iters=5
new-facts=6402
prior-facts=6402
mean1857.110-1857.107=0.003
σ0.058-0.055=0.003
min1857.051-1857.047=0.004
max1857.185-1857.171=0.015
mean1774.600-1779.600=-5.000
σ139.127-123.664=15.463
min1642.000-1647.000=-5.000
max1919.000-1903.000=16.000
mean2.941-3.088=-0.147
σ0.109-0.252=-0.143
min2.858-2.736=0.123
max3.124-3.381=-0.257

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.386-1.454=-0.068
σ0.302-0.170=0.132
min1.117-1.265=-0.148
max1.853-1.725=0.127

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.613-443.614=-0.001
σ577.066-577.065=0.001
min155.077-155.080=-0.003
max1309.211-1309.211=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1642.000-1647.000=-5.000
σ0.000
min1642.000-1647.000=-5.000
max1642.000-1647.000=-5.000
mean0.557-0.544=0.013
σ0.588-0.562=0.026
min0.259-0.259=0.000
max1.438-1.386=0.052
policies=20
mean1551.079-1551.065=0.014
σ0.342-0.327=0.015
min1550.846-1550.849=-0.002
max1551.587-1551.552=0.036
mean920.000
σ0.000
min920.000
max920.000
mean1642.000-1647.000=-5.000
σ0.000
min1642.000-1647.000=-5.000
max1642.000-1647.000=-5.000
mean2.607-2.607=0.001
σ0.012-0.012=-0.000
min2.591-2.595=-0.004
max2.618-2.620=-0.002
policies=200
mean15518.815-15518.731=0.084
σ0.103-0.185=-0.082
min15518.736-15518.541=0.195
max15518.962-15518.983=-0.021
mean9200.000
σ0.000
min9200.000
max9200.000
mean1642.000-1647.000=-5.000
σ0.000
min1642.000-1647.000=-5.000
max1642.000-1647.000=-5.000
mean26.368-26.371=-0.003
σ0.071-0.066=0.005
min26.284-26.314=-0.031
max26.452-26.459=-0.007