Compare commits

Home / Compare f2f21cf6 .. 06c5d009

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.013=0.002
σ0.369-0.368=0.001
min53.869-53.875=-0.005
max55.064-55.060=0.004
mean416.000
σ0.000
min416.000
max416.000
mean0.136-0.139=-0.003
σ0.004-0.004=0.000
min0.129-0.134=-0.005
max0.142-0.147=-0.005
cache=y
dps=1
iters=10
policies=100
mean43.322-43.321=0.001
σ0.007-0.007=0.000
min43.310-43.313=-0.003
max43.334-43.334=0.000
mean416.000
σ0.000
min416.000
max416.000
mean0.122-0.122=-0.001
σ0.004-0.003=0.001
min0.116-0.119=-0.003
max0.128-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.311-1006.302=0.009
σ1.159-1.169=-0.010
min1005.743-1005.767=-0.024
max1011.159-1011.207=-0.049
mean1057.250-1044.850=12.400
σ316.201-313.748=2.454
min569.000-570.000=-1.000
max1621.000-1638.000=-17.000
mean1.531-1.557=-0.026
σ0.046-0.106=-0.060
min1.478-1.464=0.013
max1.628-1.822=-0.193

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1621.000-1638.000=-17.000
σ0.000
min1621.000-1638.000=-17.000
max1621.000-1638.000=-17.000
mean0.407-0.417=-0.010
σ0.143-0.138=0.005
min0.332-0.322=0.010
max0.662-0.660=0.002
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1621.000-1638.000=-17.000
σ0.000
min1621.000-1638.000=-17.000
max1621.000-1638.000=-17.000
mean0.927-0.900=0.027
σ0.166-0.092=0.074
min0.844-0.836=0.008
max1.224-1.054=0.170
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1621.000-1638.000=-17.000
σ0.000
min1621.000-1638.000=-17.000
max1621.000-1638.000=-17.000
mean0.549-0.539=0.010
σ0.048-0.051=-0.003
min0.510-0.503=0.007
max0.627-0.623=0.004
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1621.000-1638.000=-17.000
σ0.000
min1621.000-1638.000=-17.000
max1621.000-1638.000=-17.000
mean0.851-0.853=-0.002
σ0.034-0.034=0.000
min0.819-0.823=-0.004
max0.909-0.910=-0.001

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113-964.112=0.001
σ0.035-0.035=-0.000
min964.086-964.090=-0.005
max964.170-964.173=-0.002
mean1621.000-1638.000=-17.000
σ0.000
min1621.000-1638.000=-17.000
max1621.000-1638.000=-17.000
mean0.758-0.809=-0.051
σ0.056-0.040=0.016
min0.705-0.752=-0.046
max0.835-0.846=-0.011
name=cdr_enhanced_4k_loc.art
mean884.712-884.712=0.000
σ0.006-0.008=-0.002
min884.703
max884.720-884.723=-0.002
mean1621.000-1638.000=-17.000
σ0.000
min1621.000-1638.000=-17.000
max1621.000-1638.000=-17.000
mean0.698-0.725=-0.026
σ0.031-0.022=0.009
min0.657-0.686=-0.029
max0.737-0.738=-0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.714-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.719=-0.001
mean1621.000-1638.000=-17.000
σ0.000
min1621.000-1638.000=-17.000
max1621.000-1638.000=-17.000
mean4.221-3.491=0.730
σ0.094-0.083=0.012
min4.066-3.357=0.709
max4.613-3.924=0.689
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.666
mean1621.000-1638.000=-17.000
σ0.000
min1621.000-1638.000=-17.000
max1621.000-1638.000=-17.000
mean4.220-3.483=0.737
σ0.089-0.086=0.003
min4.074-3.356=0.718
max4.479-3.838=0.640
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1621.000-1638.000=-17.000
σ0.000
min1621.000-1638.000=-17.000
max1621.000-1638.000=-17.000
mean0.738-0.734=0.004
σ0.019-0.021=-0.002
min0.702-0.704=-0.003
max0.860-0.893=-0.034
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1621.000-1638.000=-17.000
σ0.000
min1621.000-1638.000=-17.000
max1621.000-1638.000=-17.000
mean0.705-0.696=0.009
σ0.014-0.014=0.001
min0.677-0.664=0.012
max0.762-0.757=0.005

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.224-296.079=0.145
σ0.247-0.252=-0.005
min296.089-295.881=0.207
max296.914-296.760=0.153
mean1901.000-1907.000=-6.000
σ0.000
min1901.000-1907.000=-6.000
max1901.000-1907.000=-6.000
mean0.590-0.580=0.009
σ0.047-0.028=0.019
min0.511-0.511=0.001
max0.695-0.606=0.089

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.695-284.694=0.001
σ0.036-0.037=-0.001
min284.646-284.647=-0.001
max284.736-284.731=0.005
mean1621.000-1638.000=-17.000
σ0.000
min1621.000-1638.000=-17.000
max1621.000-1638.000=-17.000
mean0.395-0.397=-0.003
σ0.010-0.011=-0.001
min0.383-0.383=-0.000
max0.404-0.407=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.079-1295.077=0.002
σ0.116-0.106=0.010
min1294.952-1294.962=-0.010
max1295.212-1295.206=0.005
mean1621.000-1638.000=-17.000
σ0.000
min1621.000-1638.000=-17.000
max1621.000-1638.000=-17.000
mean1.988-1.914=0.074
σ0.130-0.089=0.041
min1.835-1.823=0.012
max2.144-2.035=0.108
iters=5
new-facts=6402
prior-facts=1
mean1539.173-1539.185=-0.012
σ6.842-6.843=-0.001
min1535.937-1535.937=-0.000
max1551.409-1551.423=-0.014
mean1621.000-1638.000=-17.000
σ0.000
min1621.000-1638.000=-17.000
max1621.000-1638.000=-17.000
mean2.196-2.231=-0.035
σ0.140-0.193=-0.053
min2.041-2.049=-0.008
max2.353-2.497=-0.144
iters=5
new-facts=6402
prior-facts=6402
mean1856.975-1856.990=-0.015
σ0.068-0.054=0.014
min1856.901-1856.934=-0.033
max1857.070-1857.066=0.004
mean1767.000-1775.200=-8.200
σ131.246-131.336=-0.090
min1621.000-1638.000=-17.000
max1901.000-1907.000=-6.000
mean3.090-3.065=0.025
σ0.258-0.255=0.003
min2.875-2.861=0.014
max3.534-3.501=0.033

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.230-1.277=-0.046
σ0.354-0.314=0.040
min0.933-1.062=-0.129
max1.833-1.785=0.048

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.785=0.000
σ581.213-581.212=0.001
min157.178-157.177=0.001
max1319.605-1319.603=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1621.000-1638.000=-17.000
σ0.000
min1621.000-1638.000=-17.000
max1621.000-1638.000=-17.000
mean0.543-0.552=-0.010
σ0.561-0.585=-0.024
min0.259-0.259=0.001
max1.384-1.430=-0.046
policies=20
mean1572.107-1572.093=0.015
σ0.357-0.354=0.003
min1571.867-1571.855=0.012
max1572.638-1572.619=0.019
mean920.000
σ0.000
min920.000
max920.000
mean1621.000-1638.000=-17.000
σ0.000
min1621.000-1638.000=-17.000
max1621.000-1638.000=-17.000
mean2.630-2.635=-0.005
σ0.022-0.019=0.003
min2.607-2.607=-0.000
max2.659-2.647=0.011
policies=200
mean15729.070-15728.902=0.169
σ0.047-0.037=0.011
min15729.018-15728.859=0.159
max15729.128-15728.949=0.180
mean9200.000
σ0.000
min9200.000
max9200.000
mean1621.000-1638.000=-17.000
σ0.000
min1621.000-1638.000=-17.000
max1621.000-1638.000=-17.000
mean26.481-26.543=-0.062
σ0.129-0.076=0.053
min26.407-26.496=-0.089
max26.674-26.656=0.018