Compare commits

Home / Compare 31a5979a .. 0ea41ead

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.016-54.015=0.000
σ0.369-0.370=-0.001
min53.876-53.866=0.010
max55.065-55.067=-0.002
mean416.900-416.000=0.900
σ0.316-0.000=0.316
min416.000
max417.000-416.000=1.000
mean0.140-0.140=-0.001
σ0.004-0.004=-0.000
min0.133-0.136=-0.003
max0.146-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.001
σ0.006-0.007=-0.001
min43.314-43.310=0.004
max43.337-43.334=0.003
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.120-0.121=-0.002
σ0.003-0.003=-0.000
min0.115-0.117=-0.002
max0.124-0.128=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1006.307=0.002
σ1.162-1.172=-0.009
min1005.741-1005.767=-0.026
max1011.177-1011.217=-0.039
mean1044.400-1045.850=-1.450
σ312.550-313.861=-1.310
min577.000
max1634.000-1643.000=-9.000
mean1.564-1.557=0.006
σ0.094-0.096=-0.001
min1.473-1.485=-0.012
max1.833-1.819=0.014

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1634.000-1643.000=-9.000
σ0.000
min1634.000-1643.000=-9.000
max1634.000-1643.000=-9.000
mean0.408-0.404=0.004
σ0.136-0.130=0.006
min0.327-0.327=0.000
max0.649-0.631=0.018
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1634.000-1643.000=-9.000
σ0.000
min1634.000-1643.000=-9.000
max1634.000-1643.000=-9.000
mean0.890-0.897=-0.007
σ0.088-0.110=-0.022
min0.838-0.815=0.022
max1.047-1.088=-0.042
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1634.000-1643.000=-9.000
σ0.000
min1634.000-1643.000=-9.000
max1634.000-1643.000=-9.000
mean0.544-0.562=-0.018
σ0.054-0.069=-0.015
min0.512-0.490=0.022
max0.639-0.654=-0.016
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1634.000-1643.000=-9.000
σ0.000
min1634.000-1643.000=-9.000
max1634.000-1643.000=-9.000
mean0.850-0.836=0.014
σ0.039-0.041=-0.001
min0.825-0.806=0.019
max0.919-0.902=0.017

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.114=0.001
σ0.035-0.034=0.001
min964.086
max964.173-964.170=0.003
mean1634.000-1643.000=-9.000
σ0.000
min1634.000-1643.000=-9.000
max1634.000-1643.000=-9.000
mean0.832-0.809=0.023
σ0.043-0.051=-0.008
min0.765-0.730=0.035
max0.867-0.855=0.012
name=cdr_enhanced_4k_loc.art
mean884.711-884.711=0.000
σ0.008-0.007=0.000
min884.703
max884.723-884.721=0.001
mean1634.000-1643.000=-9.000
σ0.000
min1634.000-1643.000=-9.000
max1634.000-1643.000=-9.000
mean0.683-0.705=-0.023
σ0.073-0.033=0.040
min0.595-0.669=-0.074
max0.742-0.737=0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.719=-0.001
mean1634.000-1643.000=-9.000
σ0.000
min1634.000-1643.000=-9.000
max1634.000-1643.000=-9.000
mean4.261-3.519=0.742
σ0.102-0.076=0.026
min4.103-3.360=0.744
max4.732-3.796=0.936
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=-0.000
min7.662
max7.666
mean1634.000-1643.000=-9.000
σ0.000
min1634.000-1643.000=-9.000
max1634.000-1643.000=-9.000
mean4.211-3.512=0.699
σ0.086-0.064=0.022
min4.065-3.227=0.838
max4.467-3.791=0.676
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1634.000-1643.000=-9.000
σ0.000
min1634.000-1643.000=-9.000
max1634.000-1643.000=-9.000
mean0.742-0.569=0.173
σ0.020-0.091=-0.071
min0.719-0.510=0.209
max0.895-0.844=0.052
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1634.000-1643.000=-9.000
σ0.000
min1634.000-1643.000=-9.000
max1634.000-1643.000=-9.000
mean0.705-0.507=0.198
σ0.016-0.020=-0.005
min0.671-0.482=0.189
max0.791-0.628=0.163

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.324-296.013=0.311
σ0.165-0.210=-0.045
min296.191-295.762=0.429
max296.751-296.473=0.279
mean1899.000-1912.000=-13.000
σ0.000
min1899.000-1912.000=-13.000
max1899.000-1912.000=-13.000
mean0.603-0.593=0.010
σ0.016-0.047=-0.031
min0.574-0.538=0.036
max0.635-0.713=-0.078

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.694-284.695=-0.001
σ0.038-0.038=-0.000
min284.640-284.648=-0.008
max284.732-284.739=-0.008
mean1634.000-1643.000=-9.000
σ0.000
min1634.000-1643.000=-9.000
max1634.000-1643.000=-9.000
mean0.398-0.396=0.002
σ0.009-0.011=-0.002
min0.389-0.384=0.005
max0.407-0.406=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.071-1295.081=-0.010
σ0.107-0.112=-0.005
min1294.946-1294.955=-0.009
max1295.213-1295.216=-0.003
mean1634.000-1643.000=-9.000
σ0.000
min1634.000-1643.000=-9.000
max1634.000-1643.000=-9.000
mean2.008-1.914=0.094
σ0.122-0.096=0.026
min1.833-1.809=0.024
max2.168-2.008=0.160
iters=5
new-facts=6402
prior-facts=1
mean1539.206-1539.184=0.022
σ6.839-6.836=0.003
min1535.958-1535.941=0.016
max1551.437-1551.408=0.028
mean1634.000-1643.000=-9.000
σ0.000
min1634.000-1643.000=-9.000
max1634.000-1643.000=-9.000
mean2.155-2.223=-0.069
σ0.139-0.190=-0.051
min2.043-2.042=0.001
max2.391-2.494=-0.104
iters=5
new-facts=6402
prior-facts=6402
mean1856.980-1856.986=-0.006
σ0.052-0.057=-0.004
min1856.936-1856.932=0.005
max1857.058-1857.069=-0.011
mean1779.600-1772.000=7.600
σ125.532-135.061=-9.529
min1634.000-1643.000=-9.000
max1899.000-1912.000=-13.000
mean2.987-3.009=-0.022
σ0.099-0.240=-0.141
min2.832-2.686=0.146
max3.107-3.355=-0.248

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.224-1.228=-0.004
σ0.212-0.340=-0.128
min0.954-0.926=0.028
max1.511-1.798=-0.287

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.786=-0.000
σ581.213-581.213=-0.000
min157.179-157.176=0.002
max1319.604-1319.605=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1634.000-1643.000=-9.000
σ0.000
min1634.000-1643.000=-9.000
max1634.000-1643.000=-9.000
mean0.543-0.542=0.001
σ0.566-0.555=0.011
min0.254-0.261=-0.007
max1.393-1.375=0.018
policies=20
mean1572.103-1572.099=0.004
σ0.355-0.351=0.003
min1571.863-1571.863=0.001
max1572.630-1572.621=0.009
mean920.000
σ0.000
min920.000
max920.000
mean1634.000-1643.000=-9.000
σ0.000
min1634.000-1643.000=-9.000
max1634.000-1643.000=-9.000
mean2.631-2.625=0.006
σ0.009-0.017=-0.008
min2.622-2.613=0.010
max2.639-2.650=-0.011
policies=200
mean15729.033-15728.998=0.035
σ0.047-0.131=-0.085
min15728.976-15728.884=0.092
max15729.077-15729.166=-0.089
mean9200.000
σ0.000
min9200.000
max9200.000
mean1634.000-1643.000=-9.000
σ0.000
min1634.000-1643.000=-9.000
max1634.000-1643.000=-9.000
mean26.501-26.456=0.045
σ0.032-0.062=-0.031
min26.459-26.400=0.059
max26.535-26.545=-0.011