Compare commits

Home / Compare 6ac8c389 .. 5e6a015c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.016=-0.001
σ0.370-0.371=-0.000
min53.876-53.875=0.000
max55.068-55.070=-0.002
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.139-0.137=0.001
σ0.004-0.010=-0.005
min0.132-0.113=0.019
max0.147-0.146=0.000
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.001
σ0.007-0.005=0.002
min43.313-43.317=-0.004
max43.339-43.336=0.003
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.123-0.121=0.002
σ0.004-0.003=0.001
min0.120-0.119=0.000
max0.129-0.129=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.308-1006.304=0.005
σ1.169-1.199=-0.030
min1005.772-1005.745=0.027
max1011.188-1011.336=-0.148
mean1047.800-1050.050=-2.250
σ313.388-303.945=9.443
min597.000-585.000=12.000
max1646.000-1639.000=7.000
mean1.579-1.544=0.036
σ0.087-0.062=0.025
min1.491-1.472=0.018
max1.817-1.715=0.102

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean0.411-0.403=0.009
σ0.133-0.131=0.002
min0.326-0.327=-0.001
max0.646-0.636=0.011
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean0.911-0.881=0.029
σ0.151-0.096=0.054
min0.816-0.815=0.001
max1.176-1.050=0.126
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean0.543-0.574=-0.031
σ0.049-0.057=-0.007
min0.503-0.518=-0.015
max0.625-0.652=-0.027
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean0.841-0.829=0.012
σ0.033-0.048=-0.016
min0.805-0.794=0.011
max0.890-0.913=-0.023

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.112-964.115=-0.003
σ0.022-0.034=-0.012
min964.086-964.087=-0.001
max964.137-964.171=-0.034
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean0.813-0.826=-0.012
σ0.035-0.052=-0.017
min0.759-0.736=0.023
max0.855-0.860=-0.005
name=cdr_enhanced_4k_loc.art
mean884.714-884.711=0.003
σ0.008-0.008=0.001
min884.703
max884.727-884.723=0.004
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean0.715-0.725=-0.011
σ0.031-0.028=0.003
min0.666-0.675=-0.009
max0.744-0.742=0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.719
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean4.244-4.259=-0.016
σ0.079-0.085=-0.006
min4.091-4.120=-0.029
max4.514-4.578=-0.063
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.666
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean4.242-4.242=-0.000
σ0.068-0.074=-0.005
min4.118-4.072=0.046
max4.405-4.597=-0.192
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean0.750-0.580=0.170
σ0.018-0.092=-0.073
min0.716-0.509=0.207
max0.864-0.864=0.000
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean0.702-0.500=0.202
σ0.017-0.010=0.006
min0.670-0.480=0.190
max0.794-0.547=0.246

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.303-296.186=0.118
σ0.218-0.221=-0.003
min296.164-295.992=0.172
max296.902-296.780=0.123
mean1907.000-1902.000=5.000
σ0.000
min1907.000-1902.000=5.000
max1907.000-1902.000=5.000
mean0.564-0.578=-0.014
σ0.038-0.049=-0.011
min0.508-0.518=-0.011
max0.611-0.702=-0.091

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.694-284.702=-0.008
σ0.033-0.027=0.006
min284.657-284.671=-0.014
max284.731-284.733=-0.002
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean0.400-0.397=0.003
σ0.016-0.012=0.004
min0.385-0.384=0.002
max0.425-0.408=0.017
iters=5
new-facts=1
prior-facts=6402
mean1295.087-1295.078=0.010
σ0.115-0.101=0.014
min1294.960-1294.959=0.002
max1295.238-1295.193=0.046
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean1.869-1.891=-0.022
σ0.071-0.075=-0.004
min1.807-1.816=-0.008
max1.986-1.977=0.010
iters=5
new-facts=6402
prior-facts=1
mean1539.190-1539.239=-0.049
σ6.866-6.834=0.032
min1535.942-1536.004=-0.062
max1551.469-1551.461=0.008
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean2.236-2.400=-0.164
σ0.192-0.280=-0.087
min2.039-2.026=0.013
max2.500-2.690=-0.190
iters=5
new-facts=6402
prior-facts=6402
mean1856.981-1856.985=-0.004
σ0.066-0.053=0.012
min1856.896-1856.934=-0.038
max1857.057-1857.064=-0.007
mean1775.200-1770.000=5.200
σ128.954-127.650=1.304
min1646.000-1639.000=7.000
max1907.000-1902.000=5.000
mean3.043-3.052=-0.009
σ0.173-0.224=-0.051
min2.859-2.858=0.001
max3.319-3.433=-0.114

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.055-1.235=-0.180
σ0.134-0.350=-0.215
min0.943-0.944=-0.001
max1.263-1.826=-0.563

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.784-447.786=-0.002
σ581.212-581.212=-0.000
min157.177-157.178=-0.002
max1319.603-1319.605=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean0.548-0.542=0.005
σ0.570-0.560=0.010
min0.259-0.261=-0.002
max1.403-1.383=0.020
policies=20
mean1572.078-1572.106=-0.028
σ0.342-0.357=-0.015
min1571.847-1571.867=-0.021
max1572.586-1572.637=-0.051
mean920.000
σ0.000
min920.000
max920.000
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean2.610-2.637=-0.026
σ0.017-0.016=0.002
min2.589-2.620=-0.031
max2.632-2.658=-0.026
policies=200
mean15729.078-15728.999=0.079
σ0.101-0.099=0.002
min15729.023-15728.881=0.141
max15729.229-15729.104=0.125
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000-1639.000=7.000
σ0.000
min1646.000-1639.000=7.000
max1646.000-1639.000=7.000
mean26.561-26.545=0.015
σ0.049-0.032=0.017
min26.488-26.513=-0.025
max26.593-26.589=0.004