Compare commits

Home / Compare cd359361 .. f860f0bc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.056=-0.001
σ0.368-0.370=-0.002
min53.912-53.912=-0.001
max55.101-55.109=-0.008
mean418.000
σ0.000
min418.000
max418.000
mean0.139-0.143=-0.004
σ0.005-0.006=-0.001
min0.132-0.136=-0.004
max0.147-0.156=-0.009
cache=y
dps=1
iters=10
policies=100
mean43.392-43.394=-0.002
σ0.006-0.007=-0.001
min43.383-43.386=-0.002
max43.401-43.405=-0.004
mean418.000
σ0.000
min418.000
max418.000
mean0.119-0.126=-0.006
σ0.005-0.010=-0.005
min0.113-0.114=-0.001
max0.128-0.147=-0.020

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.007-1007.006=0.000
σ1.192-1.209=-0.016
min1006.433-1006.433=0.000
max1012.004-1012.075=-0.071
mean1053.300-1053.800=-0.500
σ307.686-308.918=-1.232
min578.000-579.000=-1.000
max1645.000-1652.000=-7.000
mean1.555-1.557=-0.002
σ0.070-0.061=0.009
min1.484-1.479=0.006
max1.780-1.692=0.089

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.414-0.423=-0.009
σ0.110-0.151=-0.041
min0.356-0.350=0.006
max0.610-0.692=-0.083
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.930-0.897=0.033
σ0.186-0.097=0.089
min0.817-0.831=-0.014
max1.260-1.068=0.193
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.536-0.531=0.005
σ0.046-0.049=-0.003
min0.504-0.495=0.008
max0.610-0.614=-0.004
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.841-0.845=-0.004
σ0.037-0.037=0.000
min0.819-0.812=0.007
max0.905-0.905=0.000

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.839=-0.001
σ0.032-0.033=-0.000
min964.811-964.813=-0.002
max964.891-964.894=-0.002
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.812-0.848=-0.036
σ0.058-0.026=0.032
min0.730-0.803=-0.074
max0.865-0.872=-0.007
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.001
σ0.008-0.007=0.000
min885.506-885.504=0.001
max885.524-885.522=0.002
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.720-0.711=0.009
σ0.030-0.032=-0.002
min0.668-0.680=-0.012
max0.739-0.746=-0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.720=0.000
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean3.485-4.234=-0.749
σ0.069-0.075=-0.007
min3.358-4.092=-0.735
max3.819-4.538=-0.719
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean3.498-4.242=-0.744
σ0.086-0.096=-0.010
min3.370-4.089=-0.719
max3.778-4.524=-0.746
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.744-0.740=0.004
σ0.018-0.039=-0.021
min0.671-0.542=0.129
max0.828-0.937=-0.110
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.701-0.697=0.005
σ0.016-0.016=0.001
min0.671-0.665=0.006
max0.771-0.781=-0.009

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.811-296.830=-0.019
σ0.180-0.266=-0.086
min296.669-296.633=0.036
max297.303-297.569=-0.267
mean1925.000-1899.000=26.000
σ0.000
min1925.000-1899.000=26.000
max1925.000-1899.000=26.000
mean0.581-0.592=-0.011
σ0.054-0.033=0.021
min0.521-0.556=-0.036
max0.702-0.673=0.029

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.826-286.821=0.005
σ0.039-0.039=0.000
min286.773-286.770=0.003
max286.866-286.860=0.006
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.396-0.396=0.000
σ0.007-0.007=-0.000
min0.388-0.387=0.001
max0.405-0.401=0.004
iters=5
new-facts=1
prior-facts=6402
mean1297.245-1297.226=0.019
σ0.062-0.076=-0.014
min1297.172-1297.131=0.041
max1297.307-1297.300=0.007
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean2.078-2.039=0.039
σ0.059-0.059=0.000
min2.013-1.993=0.020
max2.139-2.139=-0.000
iters=5
new-facts=6402
prior-facts=1
mean1541.305-1541.317=-0.012
σ6.843-6.837=0.006
min1538.051-1538.058=-0.007
max1553.541-1553.542=-0.002
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean2.164-2.247=-0.083
σ0.107-0.139=-0.032
min2.083-2.087=-0.004
max2.346-2.415=-0.069
iters=5
new-facts=6402
prior-facts=6402
mean1859.108-1859.114=-0.006
σ0.074-0.079=-0.005
min1859.009-1858.995=0.014
max1859.186-1859.187=-0.002
mean1778.200-1770.600=7.600
σ140.823-122.680=18.144
min1645.000-1652.000=-7.000
max1925.000-1899.000=26.000
mean3.076-3.096=-0.020
σ0.175-0.265=-0.090
min2.793-2.872=-0.078
max3.226-3.547=-0.321

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.208-1.225=-0.017
σ0.308-0.340=-0.032
min0.939-0.938=0.001
max1.716-1.793=-0.076

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.821=0.001
σ581.372-581.372=-0.000
min158.134-158.131=0.003
max1320.880-1320.879=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean0.547-0.537=0.010
σ0.564-0.547=0.017
min0.264-0.262=0.002
max1.393-1.358=0.035
policies=20
mean1581.628-1581.629=-0.001
σ0.361-0.359=0.002
min1581.387-1581.387=0.000
max1582.165-1582.163=0.002
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean2.647-2.638=0.010
σ0.022-0.020=0.001
min2.625-2.625=-0.000
max2.672-2.668=0.004
policies=200
mean15824.235-15824.218=0.016
σ0.086-0.037=0.049
min15824.164-15824.182=-0.018
max15824.355-15824.263=0.091
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1652.000=-7.000
σ0.000
min1645.000-1652.000=-7.000
max1645.000-1652.000=-7.000
mean26.640-26.637=0.003
σ0.046-0.058=-0.012
min26.580-26.555=0.024
max26.691-26.679=0.011