Compare commits

Home / Compare 1f62bee1 .. c1a13481

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.057=-0.001
σ0.369-0.367=0.001
min53.917-53.917=0.000
max55.105-55.102=0.003
mean413.000-419.000=-6.000
σ0.000
min413.000-419.000=-6.000
max413.000-419.000=-6.000
mean0.140-0.139=0.001
σ0.004-0.003=0.000
min0.136-0.136=0.000
max0.147-0.144=0.003
cache=y
dps=1
iters=10
policies=100
mean43.394-43.395=-0.001
σ0.007-0.006=0.001
min43.387-43.385=0.002
max43.404-43.404=0.000
mean413.000-419.000=-6.000
σ0.000
min413.000-419.000=-6.000
max413.000-419.000=-6.000
mean0.121-0.123=-0.001
σ0.004-0.004=-0.000
min0.116-0.117=-0.001
max0.127-0.130=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.981-1006.979=0.002
σ0.871-0.866=0.005
min1006.484-1006.505=-0.021
max1010.586-1010.558=0.028
mean1042.650-1053.650=-11.000
σ314.008-319.689=-5.680
min573.000-577.000=-4.000
max1637.000-1621.000=16.000
mean1.568-1.542=0.025
σ0.093-0.124=-0.032
min1.467-1.454=0.013
max1.826-2.044=-0.218

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1637.000-1621.000=16.000
σ0.000
min1637.000-1621.000=16.000
max1637.000-1621.000=16.000
mean0.427-0.409=0.019
σ0.147-0.098=0.048
min0.336-0.341=-0.005
max0.688-0.581=0.107
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1637.000-1621.000=16.000
σ0.000
min1637.000-1621.000=16.000
max1637.000-1621.000=16.000
mean0.921-0.886=0.035
σ0.087-0.092=-0.005
min0.841-0.807=0.034
max1.047-1.044=0.003
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1637.000-1621.000=16.000
σ0.000
min1637.000-1621.000=16.000
max1637.000-1621.000=16.000
mean0.533-0.536=-0.003
σ0.051-0.057=-0.006
min0.487-0.479=0.008
max0.614-0.625=-0.011
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1637.000-1621.000=16.000
σ0.000
min1637.000-1621.000=16.000
max1637.000-1621.000=16.000
mean0.840-0.841=-0.001
σ0.035-0.043=-0.008
min0.807-0.809=-0.002
max0.900-0.914=-0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.830-964.831=-0.001
σ0.030-0.025=0.006
min964.802-964.803=-0.001
max964.876-964.859=0.017
mean1637.000-1621.000=16.000
σ0.000
min1637.000-1621.000=16.000
max1637.000-1621.000=16.000
mean0.823-0.814=0.009
σ0.027-0.051=-0.023
min0.800-0.734=0.067
max0.854-0.859=-0.005
name=cdr_enhanced_4k_loc.art
mean885.513-885.513=0.000
σ0.009-0.008=0.000
min885.504
max885.523-885.523=-0.000
mean1637.000-1621.000=16.000
σ0.000
min1637.000-1621.000=16.000
max1637.000-1621.000=16.000
mean0.723-0.734=-0.011
σ0.017-0.022=-0.005
min0.696-0.695=0.001
max0.736-0.749=-0.012

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.720=0.000
mean1637.000-1621.000=16.000
σ0.000
min1637.000-1621.000=16.000
max1637.000-1621.000=16.000
mean4.208-4.240=-0.032
σ0.081-0.087=-0.006
min4.085-4.105=-0.021
max4.522-4.522=-0.000
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1637.000-1621.000=16.000
σ0.000
min1637.000-1621.000=16.000
max1637.000-1621.000=16.000
mean4.208-4.215=-0.006
σ0.076-0.085=-0.009
min4.072-4.067=0.004
max4.434-4.495=-0.061
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1637.000-1621.000=16.000
σ0.000
min1637.000-1621.000=16.000
max1637.000-1621.000=16.000
mean0.738-0.742=-0.004
σ0.018-0.016=0.002
min0.701-0.708=-0.007
max0.847-0.844=0.002
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1637.000-1621.000=16.000
σ0.000
min1637.000-1621.000=16.000
max1637.000-1621.000=16.000
mean0.693-0.704=-0.011
σ0.015-0.013=0.002
min0.661-0.680=-0.019
max0.769-0.773=-0.004

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.674-295.515=0.159
σ0.154-0.247=-0.093
min295.456-295.327=0.129
max296.045-296.137=-0.092
mean1890.000-1941.000=-51.000
σ0.000
min1890.000-1941.000=-51.000
max1890.000-1941.000=-51.000
mean0.574-0.587=-0.014
σ0.048-0.034=0.014
min0.511-0.541=-0.030
max0.661-0.657=0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.416-285.404=0.012
σ0.031-0.039=-0.008
min285.382-285.361=0.021
max285.451-285.446=0.005
mean1637.000-1621.000=16.000
σ0.000
min1637.000-1621.000=16.000
max1637.000-1621.000=16.000
mean0.390-0.393=-0.002
σ0.010-0.005=0.005
min0.381-0.384=-0.003
max0.404-0.397=0.007
iters=5
new-facts=1
prior-facts=6402
mean1295.793-1295.793=-0.000
σ0.100-0.104=-0.005
min1295.685-1295.673=0.012
max1295.909-1295.932=-0.024
mean1637.000-1621.000=16.000
σ0.000
min1637.000-1621.000=16.000
max1637.000-1621.000=16.000
mean1.907-1.890=0.017
σ0.089-0.084=0.005
min1.815-1.795=0.020
max2.019-1.969=0.050
iters=5
new-facts=6402
prior-facts=1
mean1539.936-1539.941=-0.005
σ6.917-6.859=0.057
min1536.562-1536.686=-0.124
max1552.302-1552.209=0.093
mean1637.000-1621.000=16.000
σ0.000
min1637.000-1621.000=16.000
max1637.000-1621.000=16.000
mean2.403-2.132=0.271
σ0.343-0.178=0.165
min2.059-1.952=0.106
max2.855-2.421=0.434
iters=5
new-facts=6402
prior-facts=6402
mean1857.702-1857.707=-0.006
σ0.053-0.061=-0.008
min1857.653-1857.645=0.009
max1857.780-1857.779=0.001
mean1770.200-1784.400=-14.200
σ122.013-154.343=-32.330
min1637.000-1621.000=16.000
max1890.000-1941.000=-51.000
mean3.047-2.971=0.077
σ0.225-0.075=0.150
min2.858-2.882=-0.024
max3.432-3.074=0.358

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.438-1.405=0.033
σ0.288-0.272=0.016
min1.101-1.105=-0.003
max1.844-1.769=0.075

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.739-445.740=-0.001
σ580.934-580.934=-0.000
min155.271-155.270=0.001
max1317.141-1317.142=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1637.000-1621.000=16.000
σ0.000
min1637.000-1621.000=16.000
max1637.000-1621.000=16.000
mean0.543-0.538=0.004
σ0.571-0.554=0.017
min0.255-0.259=-0.004
max1.399-1.369=0.030
policies=20
mean1552.969-1552.991=-0.022
σ0.319-0.330=-0.010
min1552.748-1552.762=-0.014
max1553.443-1553.480=-0.038
mean920.000
σ0.000
min920.000
max920.000
mean1637.000-1621.000=16.000
σ0.000
min1637.000-1621.000=16.000
max1637.000-1621.000=16.000
mean2.577-2.593=-0.017
σ0.008-0.019=-0.010
min2.569-2.574=-0.005
max2.588-2.615=-0.027
policies=200
mean15537.995-15538.048=-0.053
σ0.074-0.086=-0.012
min15537.908-15537.935=-0.027
max15538.088-15538.140=-0.052
mean9200.000
σ0.000
min9200.000
max9200.000
mean1637.000-1621.000=16.000
σ0.000
min1637.000-1621.000=16.000
max1637.000-1621.000=16.000
mean26.182-26.226=-0.044
σ0.246-0.234=0.012
min26.051-26.093=-0.042
max26.551-26.574=-0.024