Compare commits

Home / Compare d44d930e .. 9c0ccb76

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.013-54.014=-0.001
σ0.368-0.371=-0.003
min53.877-53.871=0.006
max55.060-55.069=-0.009
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.138-0.137=0.001
σ0.005-0.006=-0.000
min0.131-0.132=-0.001
max0.145-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.327-43.321=0.006
σ0.008-0.006=0.002
min43.314-43.313=0.002
max43.341-43.333=0.007
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.140-0.121=0.019
σ0.008-0.004=0.004
min0.120-0.115=0.005
max0.150-0.128=0.022

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.335-1006.333=0.002
σ1.183-1.178=0.006
min1005.790-1005.792=-0.002
max1011.293-1011.266=0.028
mean1046.550-1044.250=2.300
σ313.477-292.129=21.348
min596.000-597.000=-1.000
max1644.000-1426.000=218.000
mean1.565-1.577=-0.012
σ0.076-0.080=-0.003
min1.500-1.498=0.003
max1.783-1.780=0.002

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1644.000-1426.000=218.000
σ0.000
min1644.000-1426.000=218.000
max1644.000-1426.000=218.000
mean0.417-0.414=0.003
σ0.171-0.138=0.033
min0.323-0.339=-0.016
max0.721-0.660=0.061
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1644.000-1426.000=218.000
σ0.000
min1644.000-1426.000=218.000
max1644.000-1426.000=218.000
mean0.931-0.958=-0.026
σ0.182-0.156=0.026
min0.831-0.835=-0.004
max1.255-1.185=0.070
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1644.000-1426.000=218.000
σ0.000
min1644.000-1426.000=218.000
max1644.000-1426.000=218.000
mean0.552-0.583=-0.030
σ0.050-0.039=0.011
min0.508-0.541=-0.033
max0.639-0.644=-0.005
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1644.000-1426.000=218.000
σ0.000
min1644.000-1426.000=218.000
max1644.000-1426.000=218.000
mean0.846-0.853=-0.007
σ0.040-0.039=0.001
min0.816-0.812=0.004
max0.914-0.916=-0.002

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.112-964.097=0.016
σ0.018-0.025=-0.007
min964.097-964.077=0.020
max964.143-964.138=0.006
mean1644.000-1426.000=218.000
σ0.000
min1644.000-1426.000=218.000
max1644.000-1426.000=218.000
mean0.829-0.819=0.010
σ0.027-0.033=-0.006
min0.801-0.782=0.019
max0.862-0.855=0.008
name=cdr_enhanced_4k_loc.art
mean884.713-884.710=0.004
σ0.007-0.005=0.001
min884.703
max884.721-884.716=0.006
mean1644.000-1426.000=218.000
σ0.000
min1644.000-1426.000=218.000
max1644.000-1426.000=218.000
mean0.720-0.713=0.007
σ0.033-0.036=-0.004
min0.673-0.659=0.014
max0.749-0.741=0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.714-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.721=-0.003
mean1644.000-1426.000=218.000
σ0.000
min1644.000-1426.000=218.000
max1644.000-1426.000=218.000
mean2.786-4.213=-1.427
σ0.077-0.077=0.000
min2.653-4.078=-1.425
max3.157-4.473=-1.316
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.667-7.666=0.001
mean1644.000-1426.000=218.000
σ0.000
min1644.000-1426.000=218.000
max1644.000-1426.000=218.000
mean2.764-4.229=-1.465
σ0.067-0.088=-0.020
min2.666-4.102=-1.437
max2.993-4.533=-1.540
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1644.000-1426.000=218.000
σ0.000
min1644.000-1426.000=218.000
max1644.000-1426.000=218.000
mean0.529-0.745=-0.216
σ0.014-0.035=-0.021
min0.507-0.688=-0.180
max0.611-0.888=-0.277
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1644.000-1426.000=218.000
σ0.000
min1644.000-1426.000=218.000
max1644.000-1426.000=218.000
mean0.505-0.528=-0.023
σ0.018-0.064=-0.045
min0.476-0.469=0.006
max0.628-0.849=-0.221

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.370-296.214=0.157
σ0.213-0.248=-0.035
min296.207-296.060=0.147
max296.956-296.889=0.067
mean1909.000-1906.000=3.000
σ0.000
min1909.000-1906.000=3.000
max1909.000-1906.000=3.000
mean0.567-0.595=-0.028
σ0.040-0.049=-0.010
min0.501-0.504=-0.003
max0.600-0.701=-0.101

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.718-284.724=-0.005
σ0.040-0.026=0.014
min284.663-284.699=-0.036
max284.763-284.754=0.010
mean1644.000-1426.000=218.000
σ0.000
min1644.000-1426.000=218.000
max1644.000-1426.000=218.000
mean0.398-0.397=0.001
σ0.014-0.011=0.003
min0.384-0.387=-0.003
max0.418-0.412=0.006
iters=5
new-facts=1
prior-facts=6402
mean1295.103-1295.116=-0.013
σ0.107-0.072=0.035
min1294.980-1295.032=-0.052
max1295.230-1295.187=0.043
mean1644.000-1426.000=218.000
σ0.000
min1644.000-1426.000=218.000
max1644.000-1426.000=218.000
mean1.934-2.097=-0.163
σ0.122-0.113=0.009
min1.804-2.022=-0.218
max2.126-2.291=-0.166
iters=5
new-facts=6402
prior-facts=1
mean1539.235-1539.272=-0.037
σ6.832-6.809=0.023
min1535.946-1536.084=-0.138
max1551.451-1551.450=0.001
mean1644.000-1426.000=218.000
σ0.000
min1644.000-1426.000=218.000
max1644.000-1426.000=218.000
mean2.345-2.355=-0.011
σ0.275-0.205=0.071
min1.945-2.108=-0.162
max2.674-2.557=0.117
iters=5
new-facts=6402
prior-facts=6402
mean1857.005-1857.007=-0.002
σ0.051-0.060=-0.009
min1856.965-1856.924=0.041
max1857.087-1857.068=0.019
mean1770.000-1736.600=33.400
σ133.109-181.524=-48.415
min1644.000-1481.000=163.000
max1909.000-1906.000=3.000
mean3.074-3.098=-0.024
σ0.265-0.307=-0.042
min2.864-2.844=0.020
max3.535-3.598=-0.063

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.148-1.746=-0.598
σ0.213-0.080=0.133
min0.938-1.609=-0.671
max1.476-1.812=-0.336

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.830-447.832=-0.001
σ581.212-581.212=0.000
min157.222-157.224=-0.002
max1319.649-1319.650=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1644.000-1426.000=218.000
σ0.000
min1644.000-1426.000=218.000
max1644.000-1426.000=218.000
mean0.549-0.544=0.005
σ0.569-0.562=0.007
min0.260-0.260=-0.000
max1.402-1.386=0.016
policies=20
mean1572.555-1572.567=-0.013
σ0.369-0.359=0.010
min1572.306-1572.327=-0.021
max1573.103-1573.102=0.001
mean920.000
σ0.000
min920.000
max920.000
mean1644.000-1426.000=218.000
σ0.000
min1644.000-1426.000=218.000
max1644.000-1426.000=218.000
mean2.659-2.637=0.022
σ0.034-0.027=0.007
min2.632-2.620=0.012
max2.707-2.677=0.030
policies=200
mean15733.402-15733.601=-0.199
σ0.050-0.060=-0.010
min15733.367-15733.564=-0.198
max15733.476-15733.691=-0.214
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000-1426.000=218.000
σ0.000
min1644.000-1426.000=218.000
max1644.000-1426.000=218.000
mean26.652-26.623=0.029
σ0.186-0.043=0.143
min26.548-26.572=-0.024
max26.931-26.660=0.271