Compare commits

Home / Compare f237d6e6 .. 2bea489b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=-0.000
σ0.368-0.368=0.000
min53.913-53.905=0.008
max55.102-55.102=0.000
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.142-0.142=-0.000
σ0.004-0.004=-0.000
min0.139-0.138=0.000
max0.148-0.149=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.001
σ0.006-0.007=-0.001
min43.385-43.384=0.001
max43.406-43.407=-0.001
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.122-0.123=-0.001
σ0.004-0.003=0.001
min0.117-0.120=-0.004
max0.128-0.130=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.004-1007.005=-0.000
σ1.199-1.204=-0.005
min1006.444-1006.433=0.011
max1012.031-1012.052=-0.021
mean1050.100-1053.200=-3.100
σ307.981-307.708=0.273
min575.000-578.000=-3.000
max1642.000-1646.000=-4.000
mean1.538-1.549=-0.011
σ0.078-0.106=-0.027
min1.473-1.361=0.112
max1.756-1.807=-0.051

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1642.000-1646.000=-4.000
σ0.000
min1642.000-1646.000=-4.000
max1642.000-1646.000=-4.000
mean0.422-0.406=0.016
σ0.139-0.138=0.001
min0.338-0.332=0.006
max0.668-0.651=0.017
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1642.000-1646.000=-4.000
σ0.000
min1642.000-1646.000=-4.000
max1642.000-1646.000=-4.000
mean0.892-0.873=0.020
σ0.092-0.099=-0.007
min0.831-0.817=0.015
max1.053-1.046=0.007
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1642.000-1646.000=-4.000
σ0.000
min1642.000-1646.000=-4.000
max1642.000-1646.000=-4.000
mean0.539-0.532=0.007
σ0.047-0.051=-0.003
min0.500-0.493=0.007
max0.617-0.621=-0.003
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1642.000-1646.000=-4.000
σ0.000
min1642.000-1646.000=-4.000
max1642.000-1646.000=-4.000
mean0.862-0.844=0.018
σ0.034-0.037=-0.002
min0.838-0.814=0.024
max0.922-0.907=0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.840=0.000
σ0.035-0.035=0.001
min964.810-964.811=-0.000
max964.899-964.897=0.001
mean1642.000-1646.000=-4.000
σ0.000
min1642.000-1646.000=-4.000
max1642.000-1646.000=-4.000
mean0.842-0.826=0.016
σ0.023-0.047=-0.024
min0.802-0.744=0.058
max0.855-0.859=-0.004
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.007-0.008=-0.001
min885.504
max885.521-885.522=-0.001
mean1642.000-1646.000=-4.000
σ0.000
min1642.000-1646.000=-4.000
max1642.000-1646.000=-4.000
mean0.703-0.729=-0.026
σ0.031-0.027=0.004
min0.671-0.681=-0.010
max0.738-0.746=-0.008

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.721=-0.001
mean1642.000-1646.000=-4.000
σ0.000
min1642.000-1646.000=-4.000
max1642.000-1646.000=-4.000
mean4.238-4.220=0.018
σ0.167-0.092=0.075
min4.054-4.076=-0.022
max5.538-4.758=0.780
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1642.000-1646.000=-4.000
σ0.000
min1642.000-1646.000=-4.000
max1642.000-1646.000=-4.000
mean4.202-4.191=0.011
σ0.094-0.071=0.023
min4.022-4.062=-0.040
max4.666-4.428=0.238
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1642.000-1646.000=-4.000
σ0.000
min1642.000-1646.000=-4.000
max1642.000-1646.000=-4.000
mean0.747-0.743=0.004
σ0.020-0.034=-0.014
min0.710-0.704=0.006
max0.850-0.953=-0.103
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1642.000-1646.000=-4.000
σ0.000
min1642.000-1646.000=-4.000
max1642.000-1646.000=-4.000
mean0.704-0.691=0.013
σ0.015-0.016=-0.001
min0.672-0.659=0.013
max0.770-0.790=-0.020

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.753-296.990=-0.237
σ0.238-0.217=0.021
min296.568-296.794=-0.226
max297.346-297.533=-0.187
mean1911.000-1901.000=10.000
σ0.000
min1911.000-1901.000=10.000
max1911.000-1901.000=10.000
mean0.576-0.591=-0.015
σ0.044-0.039=0.005
min0.515-0.543=-0.028
max0.681-0.687=-0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.829-286.825=0.003
σ0.043-0.038=0.005
min286.774-286.778=-0.004
max286.873-286.865=0.008
mean1642.000-1646.000=-4.000
σ0.000
min1642.000-1646.000=-4.000
max1642.000-1646.000=-4.000
mean0.409-0.397=0.011
σ0.014-0.006=0.007
min0.386-0.389=-0.002
max0.420-0.403=0.017
iters=5
new-facts=1
prior-facts=6402
mean1297.258-1297.229=0.028
σ0.122-0.073=0.050
min1297.079-1297.139=-0.061
max1297.408-1297.305=0.104
mean1642.000-1646.000=-4.000
σ0.000
min1642.000-1646.000=-4.000
max1642.000-1646.000=-4.000
mean2.204-2.072=0.132
σ0.018-0.070=-0.053
min2.175-1.983=0.191
max2.220-2.143=0.076
iters=5
new-facts=6402
prior-facts=1
mean1541.377-1541.317=0.060
σ6.837-6.836=0.002
min1538.203-1538.068=0.135
max1553.606-1553.541=0.065
mean1642.000-1646.000=-4.000
σ0.000
min1642.000-1646.000=-4.000
max1642.000-1646.000=-4.000
mean2.331-2.214=0.118
σ0.258-0.132=0.126
min2.123-2.085=0.037
max2.706-2.371=0.335
iters=5
new-facts=6402
prior-facts=6402
mean1859.113-1859.111=0.002
σ0.063-0.081=-0.018
min1859.033-1858.988=0.045
max1859.192-1859.189=0.003
mean1770.800-1771.600=-0.800
σ134.530-124.160=10.369
min1642.000-1646.000=-4.000
max1911.000-1901.000=10.000
mean3.115-3.155=-0.040
σ0.243-0.261=-0.018
min2.867-2.896=-0.029
max3.456-3.558=-0.102

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.220-1.201=0.019
σ0.356-0.364=-0.008
min0.935-0.942=-0.007
max1.832-1.815=0.017

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.821=-0.001
σ581.372-581.371=0.001
min158.133-158.135=-0.002
max1320.877-1320.877=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1642.000-1646.000=-4.000
σ0.000
min1642.000-1646.000=-4.000
max1642.000-1646.000=-4.000
mean0.547-0.565=-0.018
σ0.554-0.599=-0.045
min0.260-0.262=-0.001
max1.378-1.464=-0.086
policies=20
mean1581.610-1581.629=-0.019
σ0.365-0.363=0.002
min1581.362-1581.386=-0.024
max1582.152-1582.168=-0.016
mean920.000
σ0.000
min920.000
max920.000
mean1642.000-1646.000=-4.000
σ0.000
min1642.000-1646.000=-4.000
max1642.000-1646.000=-4.000
mean2.644-2.646=-0.002
σ0.025-0.013=0.012
min2.618-2.630=-0.012
max2.674-2.663=0.011
policies=200
mean15824.163-15824.236=-0.073
σ0.126-0.080=0.046
min15824.006-15824.170=-0.164
max15824.312-15824.351=-0.040
mean9200.000
σ0.000
min9200.000
max9200.000
mean1642.000-1646.000=-4.000
σ0.000
min1642.000-1646.000=-4.000
max1642.000-1646.000=-4.000
mean26.589-26.626=-0.038
σ0.069-0.079=-0.010
min26.542-26.554=-0.012
max26.691-26.721=-0.030