Compare commits

Home / Compare 4ac002c4 .. a17ad3a6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.015=0.000
σ0.369-0.370=-0.001
min53.873-53.870=0.003
max55.065-55.069=-0.003
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.140-0.137=0.004
σ0.004-0.006=-0.001
min0.136-0.130=0.006
max0.147-0.144=0.003
cache=y
dps=1
iters=10
policies=100
mean43.323-43.321=0.001
σ0.006-0.007=-0.001
min43.314-43.311=0.003
max43.334-43.335=-0.001
mean415.000-419.000=-4.000
σ0.000
min415.000-419.000=-4.000
max415.000-419.000=-4.000
mean0.122-0.122=-0.000
σ0.004-0.004=-0.000
min0.118-0.119=-0.001
max0.129-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.310-1006.305=0.005
σ1.186-1.181=0.004
min1005.743-1005.769=-0.026
max1011.273-1011.257=0.016
mean1046.750-1062.950=-16.200
σ310.519-316.002=-5.484
min551.000-595.000=-44.000
max1517.000-1636.000=-119.000
mean1.552-1.555=-0.004
σ0.065-0.078=-0.013
min1.495-1.474=0.020
max1.772-1.780=-0.007

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean0.409-0.417=-0.008
σ0.142-0.150=-0.008
min0.313-0.334=-0.021
max0.658-0.685=-0.027
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean0.887-0.890=-0.004
σ0.097-0.091=0.007
min0.815-0.828=-0.013
max1.056-1.048=0.008
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean0.544-0.549=-0.005
σ0.049-0.046=0.002
min0.507-0.509=-0.002
max0.626-0.620=0.006
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean0.833-0.865=-0.032
σ0.040-0.032=0.008
min0.788-0.834=-0.046
max0.898-0.918=-0.020

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.106-964.114=-0.008
σ0.039-0.033=0.006
min964.081-964.086=-0.005
max964.174-964.169=0.005
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean0.820-0.828=-0.009
σ0.024-0.042=-0.018
min0.793-0.762=0.031
max0.846-0.862=-0.016
name=cdr_enhanced_4k_loc.art
mean884.709-884.712=-0.002
σ0.005-0.008=-0.003
min884.703-884.705=-0.001
max884.717-884.724=-0.007
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean0.731-0.726=0.005
σ0.014-0.021=-0.007
min0.706-0.689=0.017
max0.740-0.739=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.719=-0.002
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean4.271-4.202=0.069
σ0.093-0.080=0.013
min4.097-4.088=0.009
max4.550-4.618=-0.069
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean4.272-4.207=0.065
σ0.100-0.067=0.034
min4.136-4.072=0.064
max4.706-4.404=0.302
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean0.737-0.736=0.001
σ0.026-0.018=0.008
min0.697-0.707=-0.010
max0.906-0.842=0.064
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean0.695-0.697=-0.002
σ0.014-0.016=-0.002
min0.666-0.667=-0.001
max0.772-0.806=-0.035

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.149-296.137=0.013
σ0.219-0.263=-0.044
min295.970-295.969=0.001
max296.732-296.866=-0.134
mean1902.000-1908.000=-6.000
σ0.000
min1902.000-1908.000=-6.000
max1902.000-1908.000=-6.000
mean0.586-0.581=0.005
σ0.026-0.039=-0.013
min0.545-0.516=0.029
max0.645-0.651=-0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.692-284.704=-0.012
σ0.035-0.029=0.007
min284.653-284.678=-0.024
max284.732-284.738=-0.006
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean0.398-0.397=0.000
σ0.009-0.012=-0.003
min0.387-0.384=0.003
max0.407-0.406=0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.063-1295.078=-0.015
σ0.087-0.109=-0.021
min1294.960-1294.950=0.009
max1295.164-1295.209=-0.046
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean1.918-1.900=0.018
σ0.102-0.111=-0.009
min1.804-1.803=0.001
max2.042-2.049=-0.008
iters=5
new-facts=6402
prior-facts=1
mean1539.182-1539.191=-0.009
σ6.861-6.847=0.014
min1535.935-1535.929=0.007
max1551.452-1551.435=0.017
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean2.243-2.257=-0.014
σ0.275-0.234=0.041
min1.952-2.076=-0.124
max2.540-2.623=-0.083
iters=5
new-facts=6402
prior-facts=6402
mean1856.988-1856.988=0.001
σ0.059-0.053=0.005
min1856.930-1856.941=-0.010
max1857.073-1857.071=0.003
mean1745.400-1774.600=-29.200
σ166.644-131.722=34.922
min1517.000-1636.000=-119.000
max1902.000-1908.000=-6.000
mean3.052-2.997=0.055
σ0.257-0.308=-0.051
min2.854-2.756=0.098
max3.490-3.534=-0.044

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.563-1.237=0.326
σ0.311-0.277=0.034
min1.189-0.938=0.251
max1.823-1.537=0.286

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.787=-0.000
σ581.213-581.212=0.000
min157.178-157.179=-0.000
max1319.605-1319.605=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean0.554-0.524=0.030
σ0.589-0.514=0.074
min0.258-0.260=-0.001
max1.437-1.296=0.142
policies=20
mean1572.105-1572.100=0.005
σ0.356-0.345=0.011
min1571.862-1571.865=-0.002
max1572.634-1572.613=0.021
mean920.000
σ0.000
min920.000
max920.000
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean2.635-2.612=0.022
σ0.012-0.014=-0.002
min2.620-2.602=0.019
max2.650-2.633=0.017
policies=200
mean15728.982-15729.079=-0.097
σ0.146-0.075=0.071
min15728.877-15729.031=-0.153
max15729.195-15729.191=0.004
mean9200.000
σ0.000
min9200.000
max9200.000
mean1517.000-1636.000=-119.000
σ0.000
min1517.000-1636.000=-119.000
max1517.000-1636.000=-119.000
mean26.516-26.452=0.064
σ0.038-0.033=0.006
min26.469-26.416=0.053
max26.550-26.489=0.061