Compare commits

Home / Compare 52ac541a .. a9abb6d9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.703-53.704=-0.000
σ0.369-0.368=0.001
min53.562-53.558=0.004
max54.754-54.752=0.002
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.139-0.138=0.001
σ0.004-0.005=-0.000
min0.134-0.130=0.005
max0.145-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.057-43.057=0.000
σ0.006-0.005=0.001
min43.045-43.050=-0.005
max43.069-43.064=0.005
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.121-0.118=0.003
σ0.004-0.004=0.000
min0.113-0.112=0.001
max0.128-0.125=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.107-1005.115=-0.007
σ0.883-0.859=0.023
min1004.632-1004.609=0.023
max1008.763-1008.651=0.112
mean1049.850-1053.000=-3.150
σ321.397-309.828=11.570
min549.000-571.000=-22.000
max1632.000-1655.000=-23.000
mean1.635-1.615=0.020
σ0.088-0.055=0.033
min1.501-1.549=-0.048
max1.855-1.738=0.117

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.882=0.001
σ0.002-0.002=0.000
min0.881
max0.886
mean1632.000-1655.000=-23.000
σ0.000
min1632.000-1655.000=-23.000
max1632.000-1655.000=-23.000
mean0.412-0.421=-0.009
σ0.136-0.135=0.002
min0.327-0.342=-0.015
max0.654-0.661=-0.007
name=error_case.art
mean2.333-2.334=-0.001
σ0.003-0.003=0.000
min2.332
max2.337
mean1632.000-1655.000=-23.000
σ0.000
min1632.000-1655.000=-23.000
max1632.000-1655.000=-23.000
mean0.880-0.884=-0.003
σ0.083-0.089=-0.006
min0.829-0.823=0.006
max1.026-1.039=-0.012
name=heavy_item.art
mean1.522-1.521=0.001
σ0.001-0.001=0.000
min1.520
max1.524-1.523=0.001
mean1632.000-1655.000=-23.000
σ0.000
min1632.000-1655.000=-23.000
max1632.000-1655.000=-23.000
mean0.536-0.543=-0.007
σ0.054-0.054=-0.000
min0.486-0.504=-0.018
max0.623-0.636=-0.013
name=nested_use.art
mean2.356-2.356=-0.000
σ0.002-0.002=-0.000
min2.355
max2.358
mean1632.000-1655.000=-23.000
σ0.000
min1632.000-1655.000=-23.000
max1632.000-1655.000=-23.000
mean0.867-0.848=0.019
σ0.035-0.032=0.003
min0.840-0.821=0.018
max0.928-0.904=0.024

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-963.552=0.001
σ0.023-0.025=-0.002
min963.536-963.523=0.013
max963.591-963.583=0.009
mean1632.000-1655.000=-23.000
σ0.000
min1632.000-1655.000=-23.000
max1632.000-1655.000=-23.000
mean0.833-0.812=0.021
σ0.029-0.013=0.016
min0.799-0.794=0.005
max0.862-0.824=0.038
name=cdr_enhanced_4k_loc.art
mean884.853-884.857=-0.003
σ0.008-0.004=0.004
min884.847-884.851=-0.004
max884.866-884.861=0.004
mean1632.000-1655.000=-23.000
σ0.000
min1632.000-1655.000=-23.000
max1632.000-1655.000=-23.000
mean0.727-0.717=0.010
σ0.032-0.037=-0.005
min0.671-0.673=-0.003
max0.748-0.756=-0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=-0.000
σ0.002-0.002=0.000
min7.705
max7.711-7.710=0.001
mean1632.000-1655.000=-23.000
σ0.000
min1632.000-1655.000=-23.000
max1632.000-1655.000=-23.000
mean4.264-3.585=0.679
σ0.073-0.101=-0.027
min4.146-3.430=0.716
max4.535-3.977=0.557
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1632.000-1655.000=-23.000
σ0.000
min1632.000-1655.000=-23.000
max1632.000-1655.000=-23.000
mean4.238-3.562=0.676
σ0.077-0.090=-0.012
min4.119-3.395=0.724
max4.536-3.889=0.647
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1632.000-1655.000=-23.000
σ0.000
min1632.000-1655.000=-23.000
max1632.000-1655.000=-23.000
mean0.750-0.751=-0.001
σ0.018-0.018=-0.001
min0.672-0.724=-0.052
max0.842-0.861=-0.019
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1632.000-1655.000=-23.000
σ0.000
min1632.000-1655.000=-23.000
max1632.000-1655.000=-23.000
mean0.697-0.692=0.005
σ0.039-0.070=-0.031
min0.508-0.498=0.010
max0.796-0.810=-0.014

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.340-294.245=0.095
σ0.265-0.250=0.015
min294.171-294.037=0.134
max295.079-294.911=0.168
mean1964.000-1935.000=29.000
σ0.000
min1964.000-1935.000=29.000
max1964.000-1935.000=29.000
mean0.561-0.569=-0.008
σ0.045-0.048=-0.003
min0.510-0.498=0.012
max0.634-0.631=0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.487-281.492=-0.005
σ0.039-0.037=0.002
min281.431-281.441=-0.010
max281.524-281.534=-0.010
mean1632.000-1655.000=-23.000
σ0.000
min1632.000-1655.000=-23.000
max1632.000-1655.000=-23.000
mean0.387-0.389=-0.003
σ0.004-0.011=-0.007
min0.381-0.371=0.010
max0.391-0.401=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1291.440-1291.482=-0.042
σ0.083-0.115=-0.031
min1291.348-1291.355=-0.007
max1291.568-1291.650=-0.082
mean1632.000-1655.000=-23.000
σ0.000
min1632.000-1655.000=-23.000
max1632.000-1655.000=-23.000
mean1.952-1.974=-0.022
σ0.151-0.122=0.029
min1.751-1.825=-0.074
max2.162-2.143=0.019
iters=5
new-facts=6402
prior-facts=1
mean1534.428-1534.348=0.080
σ3.931-3.997=-0.066
min1532.540-1532.343=0.197
max1541.455-1541.492=-0.037
mean1632.000-1655.000=-23.000
σ0.000
min1632.000-1655.000=-23.000
max1632.000-1655.000=-23.000
mean2.409-2.170=0.239
σ0.295-0.146=0.149
min2.169-2.028=0.141
max2.913-2.385=0.528
iters=5
new-facts=6402
prior-facts=6402
mean1853.367-1853.349=0.018
σ0.065-0.054=0.010
min1853.291-1853.298=-0.007
max1853.435-1853.422=0.013
mean1796.200-1795.000=1.200
σ165.352-139.752=25.600
min1632.000-1655.000=-23.000
max1964.000-1935.000=29.000
mean3.176-3.095=0.081
σ0.273-0.419=-0.147
min2.840-2.616=0.224
max3.551-3.771=-0.220

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.430-1.410=0.020
σ0.366-0.244=0.122
min1.108-1.108=0.000
max1.913-1.789=0.125

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.427-442.427=-0.001
σ577.065-577.064=0.001
min153.892-153.895=-0.002
max1308.024-1308.024=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1632.000-1655.000=-23.000
σ0.000
min1632.000-1655.000=-23.000
max1632.000-1655.000=-23.000
mean0.540-0.536=0.004
σ0.562-0.556=0.006
min0.256-0.256=-0.000
max1.383-1.369=0.013
policies=20
mean1539.204-1539.207=-0.002
σ0.317-0.319=-0.002
min1538.985-1538.984=0.000
max1539.675-1539.679=-0.005
mean920.000
σ0.000
min920.000
max920.000
mean1632.000-1655.000=-23.000
σ0.000
min1632.000-1655.000=-23.000
max1632.000-1655.000=-23.000
mean2.567-2.575=-0.008
σ0.008-0.012=-0.004
min2.557-2.557=-0.000
max2.575-2.583=-0.009
policies=200
mean15400.408-15400.371=0.037
σ0.162-0.104=0.058
min15400.291-15400.226=0.066
max15400.640-15400.463=0.178
mean9200.000
σ0.000
min9200.000
max9200.000
mean1632.000-1655.000=-23.000
σ0.000
min1632.000-1655.000=-23.000
max1632.000-1655.000=-23.000
mean26.080-25.987=0.092
σ0.221-0.059=0.162
min25.888-25.902=-0.014
max26.358-26.036=0.322