Compare commits

Home / Compare 0cb99967 .. c620e1a4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.032-54.032=0.000
σ0.369-0.369=0.000
min53.889-53.895=-0.005
max55.082-55.081=0.001
mean418.700-418.000=0.700
σ0.483-0.000=0.483
min418.000
max419.000-418.000=1.000
mean0.139-0.139=-0.000
σ0.004-0.004=0.000
min0.131-0.133=-0.002
max0.146-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.383-43.382=0.000
σ0.006-0.006=0.000
min43.374-43.373=0.001
max43.396-43.393=0.003
mean419.000-418.000=1.000
σ0.000
min419.000-418.000=1.000
max419.000-418.000=1.000
mean0.120-0.120=-0.001
σ0.006-0.004=0.002
min0.114-0.116=-0.002
max0.129-0.126=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.336-1006.332=0.004
σ0.864-0.883=-0.019
min1005.834-1005.853=-0.019
max1009.902-1009.992=-0.090
mean1052.300-1051.600=0.700
σ306.983-310.260=-3.277
min577.000-567.000=10.000
max1647.000-1644.000=3.000
mean1.531-1.546=-0.016
σ0.069-0.059=0.011
min1.396-1.489=-0.093
max1.656-1.681=-0.025

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.002=-0.000
min0.881
max0.886-0.886=-0.000
mean1647.000-1644.000=3.000
σ0.000
min1647.000-1644.000=3.000
max1647.000-1644.000=3.000
mean0.443-0.423=0.020
σ0.192-0.129=0.063
min0.328-0.355=-0.027
max0.784-0.653=0.130
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1647.000-1644.000=3.000
σ0.000
min1647.000-1644.000=3.000
max1647.000-1644.000=3.000
mean0.934-0.902=0.032
σ0.190-0.090=0.101
min0.825-0.823=0.002
max1.271-1.028=0.243
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1647.000-1644.000=3.000
σ0.000
min1647.000-1644.000=3.000
max1647.000-1644.000=3.000
mean0.540-0.540=0.000
σ0.041-0.039=0.002
min0.499-0.505=-0.005
max0.604-0.606=-0.002
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1647.000-1644.000=3.000
σ0.000
min1647.000-1644.000=3.000
max1647.000-1644.000=3.000
mean0.839-0.847=-0.008
σ0.029-0.044=-0.015
min0.820-0.819=0.001
max0.889-0.924=-0.035

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-963.552=-0.000
σ0.025-0.023=0.002
min963.523-963.535=-0.012
max963.584-963.590=-0.006
mean1647.000-1644.000=3.000
σ0.000
min1647.000-1644.000=3.000
max1647.000-1644.000=3.000
mean0.778-0.847=-0.070
σ0.021-0.011=0.010
min0.753-0.830=-0.077
max0.808-0.857=-0.049
name=cdr_enhanced_4k_loc.art
mean884.856-884.854=0.002
σ0.007-0.009=-0.002
min884.847
max884.862-884.866=-0.005
mean1647.000-1644.000=3.000
σ0.000
min1647.000-1644.000=3.000
max1647.000-1644.000=3.000
mean0.672-0.690=-0.018
σ0.065-0.051=0.015
min0.600-0.610=-0.010
max0.732-0.745=-0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=-0.000
min7.705
max7.709-7.711=-0.001
mean1647.000-1644.000=3.000
σ0.000
min1647.000-1644.000=3.000
max1647.000-1644.000=3.000
mean4.263-4.006=0.257
σ0.073-0.359=-0.286
min4.117-3.436=0.681
max4.556-4.566=-0.010
name=record_render_large_syntax_err.art
mean7.655-7.655=0.000
σ0.002-0.002=0.000
min7.654
max7.658
mean1647.000-1644.000=3.000
σ0.000
min1647.000-1644.000=3.000
max1647.000-1644.000=3.000
mean4.279-4.233=0.045
σ0.089-0.083=0.006
min4.118-4.080=0.038
max4.570-4.491=0.079
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1647.000-1644.000=3.000
σ0.000
min1647.000-1644.000=3.000
max1647.000-1644.000=3.000
mean0.749-0.749=-0.000
σ0.022-0.026=-0.003
min0.616-0.720=-0.104
max0.868-0.934=-0.066
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1647.000-1644.000=3.000
σ0.000
min1647.000-1644.000=3.000
max1647.000-1644.000=3.000
mean0.707-0.700=0.007
σ0.014-0.044=-0.030
min0.676-0.498=0.178
max0.793-0.786=0.007

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.560-295.531=0.029
σ0.241-0.184=0.057
min295.355-295.328=0.028
max296.224-296.001=0.223
mean1912.000-1919.000=-7.000
σ0.000
min1912.000-1919.000=-7.000
max1912.000-1919.000=-7.000
mean0.561-0.585=-0.023
σ0.058-0.059=-0.000
min0.497-0.503=-0.006
max0.687-0.718=-0.032

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.250-285.249=0.001
σ0.037-0.036=0.002
min285.199-285.201=-0.003
max285.287-285.286=0.001
mean1647.000-1644.000=3.000
σ0.000
min1647.000-1644.000=3.000
max1647.000-1644.000=3.000
mean0.390-0.392=-0.002
σ0.009-0.009=0.000
min0.381-0.384=-0.004
max0.402-0.402=0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.208-1295.198=0.010
σ0.124-0.102=0.021
min1295.078-1295.058=0.020
max1295.379-1295.309=0.069
mean1647.000-1644.000=3.000
σ0.000
min1647.000-1644.000=3.000
max1647.000-1644.000=3.000
mean1.881-2.001=-0.120
σ0.065-0.269=-0.204
min1.812-1.804=0.008
max1.956-2.463=-0.506
iters=5
new-facts=6402
prior-facts=1
mean1538.078-1538.069=0.009
σ3.996-4.025=-0.028
min1536.045-1536.076=-0.031
max1545.220-1545.260=-0.041
mean1647.000-1644.000=3.000
σ0.000
min1647.000-1644.000=3.000
max1647.000-1644.000=3.000
mean2.276-2.242=0.034
σ0.261-0.177=0.084
min2.020-2.038=-0.018
max2.665-2.464=0.201
iters=5
new-facts=6402
prior-facts=6402
mean1857.102-1857.108=-0.006
σ0.056-0.052=0.004
min1857.048-1857.068=-0.021
max1857.180-1857.187=-0.007
mean1780.400-1776.800=3.600
σ130.554-137.296=-6.742
min1647.000-1644.000=3.000
max1912.000-1919.000=-7.000
mean3.060-3.029=0.031
σ0.306-0.357=-0.051
min2.813-2.718=0.095
max3.592-3.639=-0.047

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.374-1.465=-0.092
σ0.264-0.195=0.070
min1.102-1.268=-0.165
max1.814-1.791=0.023

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.610-443.611=-0.000
σ577.065-577.065=-0.000
min155.076-155.077=-0.002
max1309.208-1309.209=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1647.000-1644.000=3.000
σ0.000
min1647.000-1644.000=3.000
max1647.000-1644.000=3.000
mean0.538-0.550=-0.012
σ0.562-0.567=-0.005
min0.254-0.259=-0.005
max1.382-1.400=-0.019
policies=20
mean1551.037-1551.046=-0.008
σ0.315-0.330=-0.015
min1550.820-1550.821=-0.000
max1551.505-1551.536=-0.031
mean920.000
σ0.000
min920.000
max920.000
mean1647.000-1644.000=3.000
σ0.000
min1647.000-1644.000=3.000
max1647.000-1644.000=3.000
mean2.579-2.585=-0.006
σ0.023-0.017=0.006
min2.547-2.570=-0.023
max2.597-2.604=-0.006
policies=200
mean15518.544-15518.476=0.069
σ0.084-0.149=-0.065
min15518.469-15518.311=0.157
max15518.665-15518.644=0.021
mean9200.000
σ0.000
min9200.000
max9200.000
mean1647.000-1644.000=3.000
σ0.000
min1647.000-1644.000=3.000
max1647.000-1644.000=3.000
mean26.138-26.204=-0.067
σ0.161-0.249=-0.088
min25.987-26.011=-0.024
max26.366-26.570=-0.204