Compare commits

Home / Compare 4751c610 .. 3e82d176

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.014=0.000
σ0.371-0.371=-0.000
min53.877-53.876=0.001
max55.069-55.069=0.000
mean415.000-420.000=-5.000
σ0.000
min415.000-420.000=-5.000
max415.000-420.000=-5.000
mean0.137-0.138=-0.000
σ0.004-0.003=0.001
min0.131-0.131=-0.001
max0.143-0.145=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.322-43.321=0.001
σ0.007-0.006=0.001
min43.310-43.312=-0.003
max43.336-43.334=0.002
mean415.000-420.000=-5.000
σ0.000
min415.000-420.000=-5.000
max415.000-420.000=-5.000
mean0.120-0.120=-0.000
σ0.003-0.004=-0.001
min0.115-0.115=-0.001
max0.124-0.128=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.305-1006.304=0.000
σ1.188-1.185=0.003
min1005.774-1005.741=0.033
max1011.278-1011.270=0.008
mean1044.550-1048.650=-4.100
σ313.337-310.070=3.267
min595.000-600.000=-5.000
max1638.000-1643.000=-5.000
mean1.580-1.544=0.037
σ0.103-0.065=0.038
min1.476-1.478=-0.002
max1.814-1.670=0.145

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1638.000-1643.000=-5.000
σ0.000
min1638.000-1643.000=-5.000
max1638.000-1643.000=-5.000
mean0.414-0.412=0.003
σ0.138-0.154=-0.017
min0.331-0.322=0.008
max0.658-0.684=-0.027
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1638.000-1643.000=-5.000
σ0.000
min1638.000-1643.000=-5.000
max1638.000-1643.000=-5.000
mean0.874-0.884=-0.010
σ0.098-0.091=0.007
min0.815-0.821=-0.006
max1.046-1.041=0.005
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1638.000-1643.000=-5.000
σ0.000
min1638.000-1643.000=-5.000
max1638.000-1643.000=-5.000
mean0.537-0.553=-0.016
σ0.052-0.046=0.007
min0.498-0.522=-0.024
max0.627-0.633=-0.005
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1638.000-1643.000=-5.000
σ0.000
min1638.000-1643.000=-5.000
max1638.000-1643.000=-5.000
mean0.877-0.849=0.028
σ0.055-0.035=0.019
min0.826-0.804=0.022
max0.957-0.903=0.054

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113-964.114=-0.000
σ0.032-0.033=-0.001
min964.088-964.088=0.000
max964.167-964.169=-0.002
mean1638.000-1643.000=-5.000
σ0.000
min1638.000-1643.000=-5.000
max1638.000-1643.000=-5.000
mean0.854-0.854=0.000
σ0.005-0.007=-0.001
min0.847-0.845=0.003
max0.860-0.861=-0.000
name=cdr_enhanced_4k_loc.art
mean884.712-884.712=0.000
σ0.006-0.008=-0.001
min884.705-884.703=0.001
max884.721-884.723=-0.002
mean1638.000-1643.000=-5.000
σ0.000
min1638.000-1643.000=-5.000
max1638.000-1643.000=-5.000
mean0.715-0.728=-0.013
σ0.031-0.016=0.014
min0.671-0.700=-0.029
max0.742-0.743=-0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.719=-0.001
mean1638.000-1643.000=-5.000
σ0.000
min1638.000-1643.000=-5.000
max1638.000-1643.000=-5.000
mean3.552-3.502=0.050
σ0.079-0.086=-0.007
min3.423-3.347=0.076
max3.996-3.742=0.253
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1638.000-1643.000=-5.000
σ0.000
min1638.000-1643.000=-5.000
max1638.000-1643.000=-5.000
mean4.094-3.478=0.616
σ0.323-0.071=0.252
min3.433-3.348=0.085
max4.553-3.778=0.775
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1638.000-1643.000=-5.000
σ0.000
min1638.000-1643.000=-5.000
max1638.000-1643.000=-5.000
mean0.737-0.525=0.212
σ0.019-0.014=0.005
min0.699-0.494=0.205
max0.855-0.615=0.240
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1638.000-1643.000=-5.000
σ0.000
min1638.000-1643.000=-5.000
max1638.000-1643.000=-5.000
mean0.701-0.498=0.203
σ0.015-0.036=-0.021
min0.668-0.468=0.200
max0.775-0.835=-0.060

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.160-296.186=-0.026
σ0.210-0.184=0.026
min295.939-295.927=0.011
max296.620-296.638=-0.018
mean1913.000-1917.000=-4.000
σ0.000
min1913.000-1917.000=-4.000
max1913.000-1917.000=-4.000
mean0.587-0.555=0.032
σ0.053-0.046=0.007
min0.512-0.504=0.008
max0.715-0.610=0.105

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.689-284.694=-0.005
σ0.042-0.034=0.008
min284.651-284.649=0.003
max284.744-284.731=0.013
mean1638.000-1643.000=-5.000
σ0.000
min1638.000-1643.000=-5.000
max1638.000-1643.000=-5.000
mean0.398-0.396=0.002
σ0.013-0.007=0.006
min0.380-0.388=-0.008
max0.411-0.404=0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.075-1295.074=0.001
σ0.101-0.105=-0.003
min1294.959-1294.950=0.009
max1295.196-1295.197=-0.002
mean1638.000-1643.000=-5.000
σ0.000
min1638.000-1643.000=-5.000
max1638.000-1643.000=-5.000
mean1.948-1.894=0.054
σ0.121-0.052=0.069
min1.814-1.813=0.001
max2.122-1.942=0.180
iters=5
new-facts=6402
prior-facts=1
mean1539.197-1539.208=-0.010
σ6.845-6.856=-0.011
min1535.906-1535.914=-0.009
max1551.437-1551.468=-0.031
mean1638.000-1643.000=-5.000
σ0.000
min1638.000-1643.000=-5.000
max1638.000-1643.000=-5.000
mean2.330-2.199=0.131
σ0.191-0.234=-0.043
min2.062-2.056=0.006
max2.570-2.614=-0.044
iters=5
new-facts=6402
prior-facts=6402
mean1856.982-1856.991=-0.009
σ0.053-0.054=-0.001
min1856.935-1856.935=-0.000
max1857.062-1857.070=-0.008
mean1771.800-1777.600=-5.800
σ136.710-135.388=1.323
min1638.000-1643.000=-5.000
max1913.000-1917.000=-4.000
mean3.048-3.046=0.002
σ0.259-0.288=-0.029
min2.832-2.873=-0.041
max3.497-3.558=-0.061

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.238-1.237=0.001
σ0.356-0.361=-0.006
min0.935-0.934=0.000
max1.839-1.714=0.124

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.787=-0.002
σ581.212-581.212=0.000
min157.177-157.179=-0.002
max1319.603-1319.605=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1638.000-1643.000=-5.000
σ0.000
min1638.000-1643.000=-5.000
max1638.000-1643.000=-5.000
mean0.544-0.535=0.008
σ0.566-0.540=0.026
min0.259-0.261=-0.002
max1.393-1.345=0.048
policies=20
mean1572.088-1572.101=-0.013
σ0.357-0.349=0.007
min1571.849-1571.867=-0.018
max1572.619-1572.621=-0.002
mean920.000
σ0.000
min920.000
max920.000
mean1638.000-1643.000=-5.000
σ0.000
min1638.000-1643.000=-5.000
max1638.000-1643.000=-5.000
mean2.632-2.619=0.014
σ0.031-0.026=0.005
min2.607-2.599=0.008
max2.674-2.656=0.017
policies=200
mean15729.064-15729.083=-0.019
σ0.136-0.104=0.033
min15728.926-15728.994=-0.068
max15729.243-15729.227=0.016
mean9200.000
σ0.000
min9200.000
max9200.000
mean1638.000-1643.000=-5.000
σ0.000
min1638.000-1643.000=-5.000
max1638.000-1643.000=-5.000
mean26.523-26.521=0.001
σ0.032-0.044=-0.012
min26.493-26.474=0.019
max26.561-26.562=-0.001