Compare commits

Home / Compare d0549aad .. 881a9bf3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.030-54.032=-0.002
σ0.368-0.368=0.000
min53.883-53.882=0.001
max55.078-55.079=-0.001
mean416.300-414.000=2.300
σ0.483-0.000=0.483
min416.000-414.000=2.000
max417.000-414.000=3.000
mean0.139-0.139=0.000
σ0.003-0.003=-0.000
min0.136-0.136=0.000
max0.144-0.145=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.384-43.385=-0.001
σ0.007-0.006=0.000
min43.373-43.374=-0.001
max43.393-43.396=-0.002
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.121-0.123=-0.003
σ0.004-0.003=0.001
min0.116-0.120=-0.005
max0.130-0.128=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.337-1006.330=0.007
σ0.863-0.889=-0.026
min1005.835-1005.833=0.002
max1009.897-1010.023=-0.125
mean1050.200-1048.200=2.000
σ314.047-306.607=7.440
min580.000-572.000=8.000
max1648.000-1642.000=6.000
mean1.553-1.540=0.013
σ0.064-0.082=-0.017
min1.494-1.468=0.026
max1.763-1.814=-0.051

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.882=0.001
σ0.002-0.002=0.000
min0.881
max0.886
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean0.412-0.407=0.005
σ0.140-0.133=0.006
min0.322-0.332=-0.010
max0.659-0.644=0.015
name=error_case.art
mean2.333-2.334=-0.001
σ0.003-0.003=0.000
min2.332
max2.337
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean0.879-0.871=0.008
σ0.101-0.088=0.013
min0.818-0.794=0.024
max1.058-1.022=0.036
name=heavy_item.art
mean1.521-1.521=0.000
σ0.002-0.001=0.001
min1.520
max1.524-1.523=0.001
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean0.539-0.540=-0.001
σ0.047-0.047=0.000
min0.492-0.489=0.003
max0.616-0.611=0.005
name=nested_use.art
mean2.355-2.357=-0.001
σ0.002-0.002=-0.000
min2.355-2.355=-0.000
max2.358
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean0.845-0.832=0.013
σ0.044-0.043=0.001
min0.801-0.793=0.008
max0.915-0.900=0.015

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.550-963.555=-0.005
σ0.025-0.031=-0.006
min963.523
max963.582-963.601=-0.019
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean0.813-0.831=-0.018
σ0.029-0.045=-0.015
min0.787-0.751=0.036
max0.846-0.856=-0.010
name=cdr_enhanced_4k_loc.art
mean884.856-884.857=-0.001
σ0.006-0.004=0.002
min884.847-884.851=-0.004
max884.860
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean0.726-0.721=0.005
σ0.029-0.031=-0.002
min0.674-0.674=0.000
max0.744-0.746=-0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=-0.000
min7.705
max7.711-7.711=-0.000
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean4.246-4.235=0.010
σ0.080-0.087=-0.007
min4.092-4.094=-0.001
max4.466-4.542=-0.076
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean4.257-4.181=0.076
σ0.078-0.061=0.016
min4.132-4.084=0.048
max4.489-4.447=0.042
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean0.749-0.746=0.003
σ0.019-0.016=0.002
min0.680-0.716=-0.036
max0.861-0.851=0.010
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean0.714-0.705=0.008
σ0.015-0.017=-0.002
min0.680-0.636=0.044
max0.796-0.793=0.002

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.409-295.488=-0.080
σ0.203-0.213=-0.010
min295.241-295.297=-0.057
max295.952-296.044=-0.092
mean1910.000-1904.000=6.000
σ0.000
min1910.000-1904.000=6.000
max1910.000-1904.000=6.000
mean0.570-0.573=-0.003
σ0.048-0.026=0.022
min0.499-0.521=-0.022
max0.635-0.600=0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.257-285.246=0.012
σ0.035-0.032=0.003
min285.209-285.206=0.003
max285.295-285.288=0.007
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean0.394-0.393=0.001
σ0.007-0.011=-0.004
min0.386-0.381=0.006
max0.402-0.406=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.201-1295.209=-0.008
σ0.109-0.114=-0.005
min1295.080-1295.082=-0.002
max1295.330-1295.351=-0.021
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean1.919-1.884=0.035
σ0.105-0.097=0.008
min1.801-1.771=0.029
max2.018-2.016=0.003
iters=5
new-facts=6402
prior-facts=1
mean1538.075-1538.080=-0.004
σ4.022-4.007=0.015
min1536.051-1536.104=-0.053
max1545.262-1545.241=0.021
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean2.257-2.205=0.053
σ0.201-0.163=0.039
min2.021-2.031=-0.010
max2.482-2.390=0.092
iters=5
new-facts=6402
prior-facts=6402
mean1857.105-1857.110=-0.005
σ0.062-0.052=0.009
min1857.032-1857.060=-0.027
max1857.189-1857.187=0.002
mean1779.400-1773.200=6.200
σ129.541-129.783=-0.243
min1648.000-1642.000=6.000
max1910.000-1904.000=6.000
mean3.025-3.029=-0.004
σ0.322-0.376=-0.055
min2.787-2.653=0.134
max3.588-3.657=-0.069

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.402-1.343=0.060
σ0.236-0.289=-0.053
min1.207-1.106=0.101
max1.749-1.810=-0.061

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.612-443.610=0.002
σ577.065-577.065=-0.000
min155.079-155.077=0.002
max1309.210-1309.208=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean0.548-0.533=0.015
σ0.582-0.550=0.031
min0.255-0.257=-0.002
max1.421-1.359=0.062
policies=20
mean1551.058-1551.037=0.021
σ0.325-0.309=0.017
min1550.835-1550.820=0.015
max1551.542-1551.495=0.046
mean920.000
σ0.000
min920.000
max920.000
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean2.590-2.559=0.032
σ0.010-0.009=0.001
min2.576-2.551=0.024
max2.597-2.568=0.029
policies=200
mean15518.627-15518.733=-0.106
σ0.154-0.078=0.076
min15518.507-15518.683=-0.176
max15518.851-15518.848=0.003
mean9200.000
σ0.000
min9200.000
max9200.000
mean1648.000-1642.000=6.000
σ0.000
min1648.000-1642.000=6.000
max1648.000-1642.000=6.000
mean26.084-26.180=-0.096
σ0.038-0.146=-0.109
min26.029-26.005=0.024
max26.114-26.306=-0.192