Compare commits

Home / Compare 25c00dc6 .. d4127476

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.031-54.032=-0.002
σ0.370-0.369=0.000
min53.890-53.889=0.000
max55.082-55.082=-0.000
mean418.000-418.700=-0.700
σ0.000-0.483=-0.483
min418.000
max418.000-419.000=-1.000
mean0.139-0.139=0.001
σ0.005-0.004=0.001
min0.132-0.131=0.000
max0.148-0.146=0.003
cache=y
dps=1
iters=10
policies=100
mean43.384-43.383=0.001
σ0.007-0.006=0.000
min43.374-43.374=0.000
max43.397-43.396=0.001
mean418.000-419.000=-1.000
σ0.000
min418.000-419.000=-1.000
max418.000-419.000=-1.000
mean0.124-0.120=0.004
σ0.004-0.006=-0.001
min0.120-0.114=0.006
max0.131-0.129=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.328-1006.336=-0.009
σ0.891-0.864=0.028
min1005.858-1005.834=0.025
max1010.034-1009.902=0.132
mean1057.600-1052.300=5.300
σ317.923-306.983=10.941
min550.000-577.000=-27.000
max1636.000-1647.000=-11.000
mean1.549-1.531=0.018
σ0.088-0.069=0.019
min1.408-1.396=0.012
max1.814-1.656=0.159

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.882-0.883=-0.001
σ0.002-0.002=-0.000
min0.881
max0.886-0.886=0.000
mean1636.000-1647.000=-11.000
σ0.000
min1636.000-1647.000=-11.000
max1636.000-1647.000=-11.000
mean0.415-0.443=-0.028
σ0.134-0.192=-0.057
min0.336-0.328=0.008
max0.654-0.784=-0.130
name=error_case.art
mean2.334-2.333=0.001
σ0.003-0.003=-0.000
min2.332
max2.337
mean1636.000-1647.000=-11.000
σ0.000
min1636.000-1647.000=-11.000
max1636.000-1647.000=-11.000
mean0.887-0.934=-0.047
σ0.085-0.190=-0.105
min0.833-0.825=0.008
max1.037-1.271=-0.234
name=heavy_item.art
mean1.521-1.521=-0.000
σ0.001-0.002=-0.001
min1.520
max1.523-1.524=-0.001
mean1636.000-1647.000=-11.000
σ0.000
min1636.000-1647.000=-11.000
max1636.000-1647.000=-11.000
mean0.542-0.540=0.002
σ0.051-0.041=0.010
min0.495-0.499=-0.005
max0.627-0.604=0.024
name=nested_use.art
mean2.356-2.355=0.001
σ0.002-0.002=0.000
min2.355
max2.358
mean1636.000-1647.000=-11.000
σ0.000
min1636.000-1647.000=-11.000
max1636.000-1647.000=-11.000
mean0.845-0.839=0.007
σ0.046-0.029=0.017
min0.812-0.820=-0.008
max0.926-0.889=0.037

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.554-963.552=0.002
σ0.030-0.025=0.005
min963.523
max963.599-963.584=0.015
mean1636.000-1647.000=-11.000
σ0.000
min1636.000-1647.000=-11.000
max1636.000-1647.000=-11.000
mean0.826-0.778=0.048
σ0.038-0.021=0.017
min0.768-0.753=0.015
max0.870-0.808=0.062
name=cdr_enhanced_4k_loc.art
mean884.857-884.856=0.001
σ0.004-0.007=-0.002
min884.851-884.847=0.004
max884.862-884.862=0.000
mean1636.000-1647.000=-11.000
σ0.000
min1636.000-1647.000=-11.000
max1636.000-1647.000=-11.000
mean0.716-0.672=0.044
σ0.027-0.065=-0.038
min0.677-0.600=0.077
max0.743-0.732=0.011

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.711-7.709=0.001
mean1636.000-1647.000=-11.000
σ0.000
min1636.000-1647.000=-11.000
max1636.000-1647.000=-11.000
mean4.229-4.263=-0.034
σ0.088-0.073=0.014
min4.059-4.117=-0.058
max4.529-4.556=-0.027
name=record_render_large_syntax_err.art
mean7.655-7.655=-0.000
σ0.002-0.002=-0.000
min7.654
max7.658
mean1636.000-1647.000=-11.000
σ0.000
min1636.000-1647.000=-11.000
max1636.000-1647.000=-11.000
mean3.839-4.279=-0.440
σ0.450-0.089=0.361
min2.601-4.118=-1.517
max5.005-4.570=0.436
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1636.000-1647.000=-11.000
σ0.000
min1636.000-1647.000=-11.000
max1636.000-1647.000=-11.000
mean0.544-0.749=-0.205
σ0.029-0.022=0.007
min0.512-0.616=-0.104
max0.728-0.868=-0.140
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1636.000-1647.000=-11.000
σ0.000
min1636.000-1647.000=-11.000
max1636.000-1647.000=-11.000
mean0.510-0.707=-0.197
σ0.013-0.014=-0.001
min0.489-0.676=-0.187
max0.569-0.793=-0.224

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.555-295.560=-0.006
σ0.192-0.241=-0.049
min295.409-295.355=0.054
max296.055-296.224=-0.169
mean1912.000
σ0.000
min1912.000
max1912.000
mean0.599-0.561=0.038
σ0.031-0.058=-0.027
min0.554-0.497=0.057
max0.664-0.687=-0.023

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.247-285.250=-0.004
σ0.037-0.037=0.000
min285.194-285.199=-0.004
max285.292-285.287=0.005
mean1636.000-1647.000=-11.000
σ0.000
min1636.000-1647.000=-11.000
max1636.000-1647.000=-11.000
mean0.390-0.390=0.001
σ0.011-0.009=0.002
min0.381-0.381=0.001
max0.404-0.402=0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.171-1295.208=-0.037
σ0.110-0.124=-0.014
min1295.070-1295.078=-0.009
max1295.349-1295.379=-0.029
mean1636.000-1647.000=-11.000
σ0.000
min1636.000-1647.000=-11.000
max1636.000-1647.000=-11.000
mean2.000-1.881=0.119
σ0.207-0.065=0.142
min1.804-1.812=-0.008
max2.305-1.956=0.349
iters=5
new-facts=6402
prior-facts=1
mean1538.136-1538.078=0.058
σ3.968-3.996=-0.028
min1536.243-1536.045=0.198
max1545.232-1545.220=0.012
mean1636.000-1647.000=-11.000
σ0.000
min1636.000-1647.000=-11.000
max1636.000-1647.000=-11.000
mean2.318-2.276=0.042
σ0.276-0.261=0.016
min2.077-2.020=0.057
max2.768-2.665=0.104
iters=5
new-facts=6402
prior-facts=6402
mean1857.106-1857.102=0.005
σ0.050-0.056=-0.006
min1857.056-1857.048=0.008
max1857.175-1857.180=-0.005
mean1779.400-1780.400=-1.000
σ132.728-130.554=2.174
min1636.000-1647.000=-11.000
max1912.000
mean3.072-3.060=0.012
σ0.275-0.306=-0.031
min2.867-2.813=0.054
max3.552-3.592=-0.040

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.337-1.374=-0.037
σ0.244-0.264=-0.021
min1.109-1.102=0.007
max1.752-1.814=-0.062

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.611-443.610=0.001
σ577.064-577.065=-0.001
min155.077-155.076=0.002
max1309.208-1309.208=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1636.000-1647.000=-11.000
σ0.000
min1636.000-1647.000=-11.000
max1636.000-1647.000=-11.000
mean0.544-0.538=0.006
σ0.572-0.562=0.010
min0.257-0.254=0.003
max1.403-1.382=0.021
policies=20
mean1551.029-1551.037=-0.009
σ0.312-0.315=-0.003
min1550.821-1550.820=0.001
max1551.493-1551.505=-0.012
mean920.000
σ0.000
min920.000
max920.000
mean1636.000-1647.000=-11.000
σ0.000
min1636.000-1647.000=-11.000
max1636.000-1647.000=-11.000
mean2.577-2.579=-0.002
σ0.018-0.023=-0.005
min2.555-2.547=0.008
max2.597-2.597=0.000
policies=200
mean15518.467-15518.544=-0.078
σ0.183-0.084=0.098
min15518.309-15518.469=-0.160
max15518.713-15518.665=0.048
mean9200.000
σ0.000
min9200.000
max9200.000
mean1636.000-1647.000=-11.000
σ0.000
min1636.000-1647.000=-11.000
max1636.000-1647.000=-11.000
mean26.182-26.138=0.044
σ0.148-0.161=-0.014
min26.052-25.987=0.065
max26.386-26.366=0.020