Compare commits

Home / Compare 42e78bfe .. 7fb956f6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.015=-0.001
σ0.370-0.369=0.001
min53.867-53.875=-0.008
max55.066-55.066=0.001
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.137-0.140=-0.004
σ0.004-0.004=0.001
min0.130-0.133=-0.003
max0.142-0.147=-0.005
cache=y
dps=1
iters=10
policies=100
mean43.321-43.322=-0.001
σ0.006-0.007=-0.001
min43.312-43.314=-0.003
max43.333-43.338=-0.005
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.118-0.123=-0.006
σ0.004-0.004=-0.001
min0.113-0.119=-0.005
max0.123-0.130=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.311-1006.311=-0.000
σ1.157-1.176=-0.018
min1005.768-1005.770=-0.002
max1011.150-1011.235=-0.085
mean1046.450-1055.600=-9.150
σ313.488-319.187=-5.699
min596.000-599.000=-3.000
max1642.000-1621.000=21.000
mean1.560-1.565=-0.005
σ0.075-0.087=-0.012
min1.470-1.435=0.035
max1.777-1.835=-0.059

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1642.000-1621.000=21.000
σ0.000
min1642.000-1621.000=21.000
max1642.000-1621.000=21.000
mean0.431-0.415=0.015
σ0.140-0.154=-0.014
min0.339-0.330=0.008
max0.672-0.690=-0.017
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1642.000-1621.000=21.000
σ0.000
min1642.000-1621.000=21.000
max1642.000-1621.000=21.000
mean0.872-0.892=-0.020
σ0.100-0.081=0.018
min0.816-0.837=-0.021
max1.049-1.032=0.017
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1642.000-1621.000=21.000
σ0.000
min1642.000-1621.000=21.000
max1642.000-1621.000=21.000
mean0.536-0.552=-0.017
σ0.057-0.053=0.004
min0.500-0.505=-0.005
max0.636-0.642=-0.006
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1642.000-1621.000=21.000
σ0.000
min1642.000-1621.000=21.000
max1642.000-1621.000=21.000
mean0.846-0.849=-0.003
σ0.040-0.038=0.001
min0.817-0.822=-0.005
max0.912-0.911=0.002

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.116=-0.001
σ0.034-0.034=-0.001
min964.085-964.088=-0.002
max964.170-964.173=-0.003
mean1642.000-1621.000=21.000
σ0.000
min1642.000-1621.000=21.000
max1642.000-1621.000=21.000
mean0.856-0.836=0.020
σ0.006-0.019=-0.013
min0.847-0.810=0.037
max0.864-0.853=0.010
name=cdr_enhanced_4k_loc.art
mean884.712-884.711=0.001
σ0.008-0.006=0.002
min884.705-884.705=-0.000
max884.723-884.719=0.004
mean1642.000-1621.000=21.000
σ0.000
min1642.000-1621.000=21.000
max1642.000-1621.000=21.000
mean0.702-0.690=0.013
σ0.034-0.024=0.010
min0.658-0.660=-0.002
max0.736-0.721=0.015

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718
mean1642.000-1621.000=21.000
σ0.000
min1642.000-1621.000=21.000
max1642.000-1621.000=21.000
mean4.288-4.242=0.045
σ0.081-0.065=0.016
min4.141-4.111=0.030
max4.600-4.448=0.153
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1642.000-1621.000=21.000
σ0.000
min1642.000-1621.000=21.000
max1642.000-1621.000=21.000
mean4.271-4.214=0.057
σ0.074-0.082=-0.008
min4.131-4.077=0.054
max4.541-4.540=0.002
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1642.000-1621.000=21.000
σ0.000
min1642.000-1621.000=21.000
max1642.000-1621.000=21.000
mean0.741-0.740=0.001
σ0.016-0.018=-0.002
min0.710-0.705=0.005
max0.835-0.852=-0.016
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1642.000-1621.000=21.000
σ0.000
min1642.000-1621.000=21.000
max1642.000-1621.000=21.000
mean0.703-0.704=-0.001
σ0.023-0.016=0.007
min0.561-0.671=-0.110
max0.788-0.778=0.009

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.127-296.162=-0.035
σ0.219-0.216=0.003
min295.949-295.957=-0.007
max296.714-296.717=-0.003
mean1908.000-1912.000=-4.000
σ0.000
min1908.000-1912.000=-4.000
max1908.000-1912.000=-4.000
mean0.576-0.576=-0.000
σ0.031-0.027=0.004
min0.506-0.540=-0.034
max0.614-0.610=0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.692-284.692=-0.000
σ0.036-0.034=0.002
min284.640-284.648=-0.008
max284.729-284.731=-0.002
mean1642.000-1621.000=21.000
σ0.000
min1642.000-1621.000=21.000
max1642.000-1621.000=21.000
mean0.401-0.395=0.005
σ0.013-0.010=0.003
min0.386-0.385=0.002
max0.419-0.403=0.016
iters=5
new-facts=1
prior-facts=6402
mean1295.049-1295.036=0.013
σ0.108-0.111=-0.002
min1294.950-1294.957=-0.007
max1295.222-1295.218=0.004
mean1642.000-1621.000=21.000
σ0.000
min1642.000-1621.000=21.000
max1642.000-1621.000=21.000
mean1.953-1.971=-0.018
σ0.177-0.180=-0.003
min1.803-1.824=-0.021
max2.243-2.267=-0.023
iters=5
new-facts=6402
prior-facts=1
mean1539.203-1539.227=-0.024
σ6.837-6.804=0.033
min1535.990-1536.069=-0.080
max1551.431-1551.397=0.034
mean1642.000-1621.000=21.000
σ0.000
min1642.000-1621.000=21.000
max1642.000-1621.000=21.000
mean2.196-2.297=-0.101
σ0.142-0.253=-0.111
min2.049-2.117=-0.068
max2.364-2.719=-0.355
iters=5
new-facts=6402
prior-facts=6402
mean1856.986-1856.990=-0.004
σ0.057-0.055=0.002
min1856.926-1856.932=-0.006
max1857.066-1857.068=-0.002
mean1776.400-1776.000=0.400
σ130.803-137.097=-6.294
min1642.000-1621.000=21.000
max1908.000-1912.000=-4.000
mean3.059-3.090=-0.031
σ0.229-0.296=-0.067
min2.874-2.864=0.011
max3.454-3.605=-0.151

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.208-1.220=-0.013
σ0.320-0.374=-0.054
min0.932-0.930=0.003
max1.741-1.842=-0.102

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.787=-0.000
σ581.212-581.212=0.000
min157.178-157.179=-0.001
max1319.605-1319.605=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1642.000-1621.000=21.000
σ0.000
min1642.000-1621.000=21.000
max1642.000-1621.000=21.000
mean0.539-0.545=-0.006
σ0.551-0.561=-0.011
min0.259-0.262=-0.003
max1.365-1.387=-0.022
policies=20
mean1572.101-1572.088=0.014
σ0.349-0.347=0.001
min1571.863-1571.857=0.006
max1572.619-1572.604=0.015
mean920.000
σ0.000
min920.000
max920.000
mean1642.000-1621.000=21.000
σ0.000
min1642.000-1621.000=21.000
max1642.000-1621.000=21.000
mean2.634-2.622=0.011
σ0.009-0.012=-0.004
min2.623-2.613=0.009
max2.644-2.640=0.004
policies=200
mean15729.084-15729.097=-0.014
σ0.120-0.117=0.003
min15728.992-15729.021=-0.029
max15729.257-15729.270=-0.013
mean9200.000
σ0.000
min9200.000
max9200.000
mean1642.000-1621.000=21.000
σ0.000
min1642.000-1621.000=21.000
max1642.000-1621.000=21.000
mean26.607-26.547=0.060
σ0.095-0.116=-0.021
min26.529-26.401=0.128
max26.744-26.679=0.065