Compare commits

Home / Compare 7e22c44d .. 90c61493

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.965-53.967=-0.002
σ0.371-0.368=0.003
min53.829-53.815=0.014
max55.021-55.014=0.007
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.140-0.148=-0.009
σ0.006-0.013=-0.007
min0.131-0.136=-0.004
max0.147-0.168=-0.021
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=-0.000
σ0.006-0.009=-0.002
min43.313-43.309=0.005
max43.337-43.342=-0.005
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.123-0.120=0.002
σ0.005-0.004=0.000
min0.118-0.114=0.004
max0.131-0.127=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.518-1006.517=0.001
σ1.164-1.182=-0.018
min1005.952-1005.945=0.007
max1011.394-1011.459=-0.064
mean1049.450-1039.150=10.300
σ305.834-311.332=-5.498
min591.000-548.000=43.000
max1643.000-1508.000=135.000
mean1.530-1.525=0.005
σ0.058-0.086=-0.028
min1.462-1.379=0.083
max1.641-1.737=-0.096

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.000
σ0.002-0.002=-0.000
min0.882
max0.887-0.887=0.000
mean1643.000-1508.000=135.000
σ0.000
min1643.000-1508.000=135.000
max1643.000-1508.000=135.000
mean0.424-0.438=-0.014
σ0.135-0.208=-0.074
min0.342-0.322=0.020
max0.663-0.809=-0.146
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1643.000-1508.000=135.000
σ0.000
min1643.000-1508.000=135.000
max1643.000-1508.000=135.000
mean0.886-0.937=-0.051
σ0.088-0.190=-0.102
min0.827-0.823=0.004
max1.041-1.276=-0.235
name=heavy_item.art
mean1.524-1.524=-0.000
σ0.002-0.002=0.000
min1.522
max1.526
mean1643.000-1508.000=135.000
σ0.000
min1643.000-1508.000=135.000
max1643.000-1508.000=135.000
mean0.538-0.535=0.003
σ0.052-0.057=-0.005
min0.499-0.486=0.013
max0.625-0.626=-0.001
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.002=-0.001
min2.360
max2.364-2.366=-0.002
mean1643.000-1508.000=135.000
σ0.000
min1643.000-1508.000=135.000
max1643.000-1508.000=135.000
mean0.847-0.846=0.001
σ0.049-0.034=0.015
min0.809-0.824=-0.015
max0.929-0.905=0.024

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.828=0.012
σ0.033-0.034=-0.000
min964.811-964.802=0.009
max964.894-964.886=0.008
mean1643.000-1508.000=135.000
σ0.000
min1643.000-1508.000=135.000
max1643.000-1508.000=135.000
mean0.829-0.782=0.047
σ0.032-0.053=-0.021
min0.794-0.714=0.080
max0.863-0.849=0.014
name=cdr_enhanced_4k_loc.art
mean885.512-885.510=0.003
σ0.007-0.005=0.001
min885.506-885.504=0.001
max885.522-885.517=0.005
mean1643.000-1508.000=135.000
σ0.000
min1643.000-1508.000=135.000
max1643.000-1508.000=135.000
mean0.728-0.723=0.005
σ0.028-0.041=-0.013
min0.678-0.649=0.029
max0.744-0.748=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.719=0.003
mean1643.000-1508.000=135.000
σ0.000
min1643.000-1508.000=135.000
max1643.000-1508.000=135.000
mean4.327-4.171=0.156
σ0.111-0.077=0.034
min4.112-4.070=0.042
max4.921-4.497=0.424
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1643.000-1508.000=135.000
σ0.000
min1643.000-1508.000=135.000
max1643.000-1508.000=135.000
mean4.270-4.152=0.117
σ0.078-0.062=0.016
min4.149-4.020=0.129
max4.598-4.341=0.257
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1643.000-1508.000=135.000
σ0.000
min1643.000-1508.000=135.000
max1643.000-1508.000=135.000
mean0.650-0.741=-0.091
σ0.112-0.018=0.095
min0.515-0.711=-0.196
max0.844-0.849=-0.004
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1643.000-1508.000=135.000
σ0.000
min1643.000-1508.000=135.000
max1643.000-1508.000=135.000
mean0.497-0.701=-0.204
σ0.056-0.015=0.042
min0.289-0.669=-0.380
max0.590-0.769=-0.178

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.575-296.326=0.249
σ0.179-0.264=-0.085
min296.413-296.142=0.271
max297.042-297.047=-0.005
mean1901.000-1912.000=-11.000
σ0.000
min1901.000-1912.000=-11.000
max1901.000-1912.000=-11.000
mean0.584-0.584=-0.000
σ0.046-0.049=-0.003
min0.508-0.505=0.003
max0.689-0.679=0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.030-285.035=-0.005
σ0.036-0.036=-0.000
min284.990-284.990=0.000
max285.071-285.071=-0.001
mean1643.000-1508.000=135.000
σ0.000
min1643.000-1508.000=135.000
max1643.000-1508.000=135.000
mean0.402-0.395=0.007
σ0.010-0.007=0.003
min0.387-0.387=-0.000
max0.412-0.405=0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.414-1295.448=-0.034
σ0.111-0.053=0.058
min1295.296-1295.392=-0.096
max1295.547-1295.506=0.042
mean1643.000-1508.000=135.000
σ0.000
min1643.000-1508.000=135.000
max1643.000-1508.000=135.000
mean1.910-2.160=-0.251
σ0.099-0.125=-0.027
min1.806-2.030=-0.224
max2.047-2.354=-0.307
iters=5
new-facts=6402
prior-facts=1
mean1539.553-1539.562=-0.010
σ6.840-6.812=0.027
min1536.280-1536.346=-0.065
max1551.783-1551.745=0.037
mean1643.000-1508.000=135.000
σ0.000
min1643.000-1508.000=135.000
max1643.000-1508.000=135.000
mean2.347-2.344=0.003
σ0.230-0.231=-0.001
min2.041-2.124=-0.083
max2.590-2.695=-0.105
iters=5
new-facts=6402
prior-facts=6402
mean1857.329-1857.313=0.016
σ0.053-0.080=-0.026
min1857.268-1857.202=0.066
max1857.400-1857.402=-0.002
mean1770.800-1748.400=22.400
σ125.850-174.347=-48.497
min1643.000-1508.000=135.000
max1901.000-1912.000=-11.000
mean3.144-3.062=0.081
σ0.386-0.243=0.142
min2.876-2.854=0.022
max3.817-3.385=0.433

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.198-1.632=-0.434
σ0.342-0.273=0.068
min0.943-1.266=-0.322
max1.763-1.893=-0.129

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.189-448.191=-0.002
σ581.332-581.331=0.001
min157.520-157.523=-0.003
max1320.187-1320.188=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1508.000=135.000
σ0.000
min1643.000-1508.000=135.000
max1643.000-1508.000=135.000
mean0.551-0.526=0.025
σ0.563-0.530=0.033
min0.263-0.260=0.003
max1.395-1.320=0.075
policies=20
mean1575.552-1575.567=-0.014
σ0.350-0.360=-0.011
min1575.316-1575.327=-0.011
max1576.073-1576.103=-0.030
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1508.000=135.000
σ0.000
min1643.000-1508.000=135.000
max1643.000-1508.000=135.000
mean2.622-2.630=-0.008
σ0.049-0.018=0.030
min2.551-2.605=-0.054
max2.654-2.649=0.005
policies=200
mean15763.599-15763.730=-0.131
σ0.093-0.095=-0.002
min15763.516-15763.652=-0.136
max15763.724-15763.868=-0.144
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1508.000=135.000
σ0.000
min1643.000-1508.000=135.000
max1643.000-1508.000=135.000
mean26.628-26.528=0.100
σ0.039-0.037=0.002
min26.592-26.488=0.104
max26.665-26.567=0.098