Compare commits

Home / Compare 59f9d92c .. 4679515b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.046-54.046=-0.000
σ0.368-0.369=-0.001
min53.903-53.892=0.010
max55.092-55.096=-0.004
mean415.800-414.000=1.800
σ0.422-0.000=0.422
min415.000-414.000=1.000
max416.000-414.000=2.000
mean0.138-0.139=-0.000
σ0.005-0.004=0.001
min0.131-0.135=-0.004
max0.146-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean43.385-43.385=0.000
σ0.006-0.004=0.002
min43.376-43.380=-0.005
max43.394-43.392=0.002
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.122-0.121=0.001
σ0.005-0.004=0.001
min0.116-0.114=0.002
max0.131-0.130=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.983-1006.979=0.004
σ0.853-0.868=-0.014
min1006.482-1006.480=0.002
max1010.495-1010.569=-0.074
mean1044.400-1047.100=-2.700
σ313.668-315.079=-1.411
min576.000-577.000=-1.000
max1638.000-1650.000=-12.000
mean1.557-1.557=0.000
σ0.082-0.062=0.020
min1.485-1.500=-0.014
max1.822-1.727=0.095

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.003-0.003=0.000
min0.882
max0.888-0.887=0.001
mean1638.000-1650.000=-12.000
σ0.000
min1638.000-1650.000=-12.000
max1638.000-1650.000=-12.000
mean0.419-0.437=-0.017
σ0.146-0.191=-0.045
min0.338-0.332=0.006
max0.678-0.777=-0.099
name=error_case.art
mean2.340-2.339=0.001
σ0.003-0.003=0.000
min2.337
max2.344-2.342=0.002
mean1638.000-1650.000=-12.000
σ0.000
min1638.000-1650.000=-12.000
max1638.000-1650.000=-12.000
mean0.875-0.906=-0.031
σ0.086-0.153=-0.067
min0.819-0.822=-0.003
max1.025-1.178=-0.153
name=heavy_item.art
mean1.523-1.524=-0.001
σ0.001-0.002=-0.001
min1.522
max1.525-1.526=-0.001
mean1638.000-1650.000=-12.000
σ0.000
min1638.000-1650.000=-12.000
max1638.000-1650.000=-12.000
mean0.535-0.535=0.000
σ0.052-0.050=0.002
min0.495-0.497=-0.001
max0.624-0.616=0.008
name=nested_use.art
mean2.362-2.361=0.001
σ0.002-0.002=0.000
min2.360
max2.364
mean1638.000-1650.000=-12.000
σ0.000
min1638.000-1650.000=-12.000
max1638.000-1650.000=-12.000
mean0.836-0.839=-0.003
σ0.040-0.036=0.004
min0.809-0.803=0.006
max0.907-0.896=0.011

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.829-964.831=-0.003
σ0.024-0.025=-0.000
min964.802
max964.862-964.861=0.000
mean1638.000-1650.000=-12.000
σ0.000
min1638.000-1650.000=-12.000
max1638.000-1650.000=-12.000
mean0.805-0.823=-0.018
σ0.054-0.031=0.023
min0.727-0.786=-0.059
max0.856-0.856=0.000
name=cdr_enhanced_4k_loc.art
mean885.514-885.513=0.001
σ0.006-0.005=0.001
min885.505-885.504=0.001
max885.519-885.516=0.003
mean1638.000-1650.000=-12.000
σ0.000
min1638.000-1650.000=-12.000
max1638.000-1650.000=-12.000
mean0.687-0.701=-0.014
σ0.052-0.037=0.014
min0.609-0.643=-0.034
max0.734-0.743=-0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.720=-0.001
mean1638.000-1650.000=-12.000
σ0.000
min1638.000-1650.000=-12.000
max1638.000-1650.000=-12.000
mean3.484-3.480=0.004
σ0.072-0.105=-0.033
min3.367-3.327=0.039
max3.851-4.158=-0.307
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1638.000-1650.000=-12.000
σ0.000
min1638.000-1650.000=-12.000
max1638.000-1650.000=-12.000
mean3.486-3.779=-0.293
σ0.061-0.355=-0.294
min3.369-3.310=0.059
max3.690-4.323=-0.633
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1638.000-1650.000=-12.000
σ0.000
min1638.000-1650.000=-12.000
max1638.000-1650.000=-12.000
mean0.733-0.733=-0.000
σ0.022-0.019=0.004
min0.670-0.697=-0.027
max0.836-0.849=-0.013
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1638.000-1650.000=-12.000
σ0.000
min1638.000-1650.000=-12.000
max1638.000-1650.000=-12.000
mean0.698-0.693=0.005
σ0.017-0.027=-0.010
min0.657-0.521=0.135
max0.780-0.793=-0.013

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.471-295.693=-0.222
σ0.233-0.248=-0.015
min295.314-295.425=-0.111
max296.075-296.351=-0.276
mean1904.000-1888.000=16.000
σ0.000
min1904.000-1888.000=16.000
max1904.000-1888.000=16.000
mean0.585-0.565=0.020
σ0.041-0.045=-0.005
min0.507-0.497=0.010
max0.641-0.614=0.027

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.413-285.405=0.008
σ0.036-0.041=-0.005
min285.368-285.360=0.008
max285.453-285.452=0.001
mean1638.000-1650.000=-12.000
σ0.000
min1638.000-1650.000=-12.000
max1638.000-1650.000=-12.000
mean0.389-0.384=0.004
σ0.012-0.005=0.007
min0.379-0.378=0.001
max0.406-0.391=0.014
iters=5
new-facts=1
prior-facts=6402
mean1295.798-1295.794=0.004
σ0.112-0.104=0.008
min1295.671-1295.681=-0.009
max1295.930-1295.923=0.006
mean1638.000-1650.000=-12.000
σ0.000
min1638.000-1650.000=-12.000
max1638.000-1650.000=-12.000
mean1.966-1.923=0.043
σ0.190-0.102=0.088
min1.817-1.810=0.007
max2.282-2.034=0.248
iters=5
new-facts=6402
prior-facts=1
mean1539.931-1539.916=0.016
σ6.852-6.854=-0.002
min1536.655-1536.648=0.006
max1552.182-1552.173=0.009
mean1638.000-1650.000=-12.000
σ0.000
min1638.000-1650.000=-12.000
max1638.000-1650.000=-12.000
mean2.300-2.231=0.068
σ0.243-0.301=-0.058
min2.034-1.930=0.103
max2.590-2.685=-0.095
iters=5
new-facts=6402
prior-facts=6402
mean1857.704-1857.709=-0.005
σ0.054-0.054=-0.001
min1857.649-1857.648=0.002
max1857.779-1857.778=0.002
mean1772.800-1771.000=1.800
σ130.325-118.030=12.296
min1638.000-1650.000=-12.000
max1904.000-1888.000=16.000
mean3.046-2.995=0.051
σ0.241-0.101=0.140
min2.851-2.860=-0.008
max3.453-3.101=0.351

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.352-1.422=-0.070
σ0.274-0.290=-0.016
min1.103-1.110=-0.007
max1.822-1.815=0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.739-445.740=-0.001
σ580.935-580.934=0.001
min155.269-155.272=-0.003
max1317.141-1317.141=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1638.000-1650.000=-12.000
σ0.000
min1638.000-1650.000=-12.000
max1638.000-1650.000=-12.000
mean0.542-0.525=0.017
σ0.568-0.538=0.030
min0.257-0.256=0.001
max1.393-1.332=0.062
policies=20
mean1552.977-1552.978=-0.001
σ0.319-0.321=-0.002
min1552.749-1552.755=-0.006
max1553.450-1553.455=-0.005
mean920.000
σ0.000
min920.000
max920.000
mean1638.000-1650.000=-12.000
σ0.000
min1638.000-1650.000=-12.000
max1638.000-1650.000=-12.000
mean2.577-2.579=-0.002
σ0.016-0.043=-0.027
min2.565-2.551=0.014
max2.600-2.641=-0.041
policies=200
mean15537.936-15537.863=0.073
σ0.067-0.133=-0.065
min15537.845-15537.773=0.073
max15538.000-15538.060=-0.061
mean9200.000
σ0.000
min9200.000
max9200.000
mean1638.000-1650.000=-12.000
σ0.000
min1638.000-1650.000=-12.000
max1638.000-1650.000=-12.000
mean26.085-26.074=0.010
σ0.115-0.075=0.041
min25.967-25.963=0.004
max26.219-26.122=0.096