Compare commits

Home / Compare b69dd8a8 .. 55b1daf1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.055=0.001
σ0.369-0.368=0.001
min53.911-53.916=-0.005
max55.105-55.103=0.002
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.140-0.139=0.000
σ0.004-0.004=-0.001
min0.136-0.135=0.001
max0.147-0.147=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.001
σ0.007-0.007=0.001
min43.383-43.385=-0.002
max43.405-43.406=-0.001
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.121-0.122=-0.000
σ0.005-0.003=0.001
min0.114-0.119=-0.005
max0.130-0.128=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.982-1006.984=-0.002
σ0.856-0.855=0.001
min1006.483-1006.483=-0.001
max1010.517-1010.507=0.010
mean1043.150-1047.200=-4.050
σ314.018-314.016=0.002
min574.000-577.000=-3.000
max1637.000-1645.000=-8.000
mean1.528-1.534=-0.006
σ0.093-0.082=0.011
min1.461-1.404=0.057
max1.794-1.798=-0.004

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.000
σ0.002-0.002=-0.000
min0.882
max0.887
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean0.406-0.430=-0.025
σ0.112-0.144=-0.031
min0.337-0.326=0.011
max0.606-0.684=-0.078
name=error_case.art
mean2.340-2.340=-0.000
σ0.003-0.003=0.000
min2.337
max2.342-2.343=-0.001
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean0.880-0.887=-0.007
σ0.081-0.091=-0.010
min0.821-0.812=0.010
max1.022-1.046=-0.023
name=heavy_item.art
mean1.523-1.524=-0.000
σ0.001-0.001=0.000
min1.522
max1.525
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean0.536-0.545=-0.009
σ0.056-0.054=0.001
min0.498-0.496=0.002
max0.634-0.632=0.002
name=nested_use.art
mean2.362
σ0.002
min2.360
max2.364
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean0.848-0.865=-0.017
σ0.043-0.033=0.009
min0.814-0.843=-0.030
max0.919-0.924=-0.005

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.832-964.832=0.000
σ0.028-0.028=0.001
min964.802-964.810=-0.008
max964.873-964.876=-0.003
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean0.832-0.808=0.024
σ0.023-0.048=-0.025
min0.808-0.748=0.060
max0.861-0.864=-0.003
name=cdr_enhanced_4k_loc.art
mean885.514-885.514=0.000
σ0.004-0.007=-0.002
min885.508-885.504=0.004
max885.519-885.520=-0.001
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean0.704-0.686=0.019
σ0.035-0.057=-0.023
min0.659-0.608=0.050
max0.742-0.758=-0.016

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.719=0.003
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean4.195-4.233=-0.038
σ0.105-0.099=0.007
min4.037-4.098=-0.061
max4.808-4.633=0.175
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean4.205-4.236=-0.032
σ0.073-0.077=-0.004
min4.054-4.113=-0.059
max4.416-4.536=-0.120
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean0.758-0.747=0.010
σ0.019-0.019=0.001
min0.696-0.685=0.011
max0.881-0.851=0.030
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean0.713-0.706=0.007
σ0.015-0.016=-0.001
min0.684-0.635=0.049
max0.799-0.764=0.035

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.512-295.627=-0.115
σ0.244-0.258=-0.013
min295.373-295.377=-0.004
max296.197-296.311=-0.114
mean2031.000-1913.000=118.000
σ0.000
min2031.000-1913.000=118.000
max2031.000-1913.000=118.000
mean0.562-0.575=-0.014
σ0.033-0.053=-0.020
min0.513-0.513=-0.000
max0.603-0.694=-0.091

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-285.406=0.006
σ0.034-0.032=0.002
min285.369-285.365=0.004
max285.448-285.441=0.007
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean0.389-0.391=-0.002
σ0.007-0.009=-0.002
min0.383-0.381=0.002
max0.398-0.401=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.792-1295.795=-0.003
σ0.105-0.114=-0.009
min1295.679-1295.666=0.013
max1295.937-1295.947=-0.010
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean1.884-1.978=-0.094
σ0.106-0.124=-0.017
min1.743-1.843=-0.100
max1.997-2.132=-0.136
iters=5
new-facts=6402
prior-facts=1
mean1539.917-1539.936=-0.019
σ6.894-6.890=0.004
min1536.596-1536.634=-0.038
max1552.243-1552.255=-0.012
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean2.255-2.345=-0.091
σ0.240-0.207=0.033
min2.030-2.102=-0.072
max2.609-2.618=-0.009
iters=5
new-facts=6402
prior-facts=6402
mean1857.702-1857.705=-0.003
σ0.057-0.059=-0.002
min1857.648-1857.642=0.006
max1857.776-1857.785=-0.010
mean1782.200-1772.800=9.400
σ170.873-134.715=36.158
min1637.000-1645.000=-8.000
max2031.000-1913.000=118.000
mean3.024-2.971=0.053
σ0.188-0.212=-0.024
min2.829-2.677=0.153
max3.270-3.277=-0.007

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.369-1.344=0.025
σ0.291-0.221=0.070
min1.112-1.107=0.005
max1.868-1.702=0.166

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.741=-0.001
σ580.935-580.934=0.000
min155.270-155.272=-0.002
max1317.142-1317.142=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean0.537-0.534=0.003
σ0.559-0.549=0.010
min0.253-0.255=-0.002
max1.377-1.358=0.018
policies=20
mean1552.986-1552.990=-0.004
σ0.320-0.328=-0.008
min1552.766-1552.767=-0.001
max1553.462-1553.478=-0.015
mean920.000
σ0.000
min920.000
max920.000
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean2.579-2.590=-0.010
σ0.025-0.024=0.002
min2.549-2.569=-0.020
max2.609-2.620=-0.011
policies=200
mean15537.963-15537.931=0.033
σ0.167-0.082=0.085
min15537.840-15537.839=0.000
max15538.207-15538.012=0.195
mean9200.000
σ0.000
min9200.000
max9200.000
mean1637.000-1645.000=-8.000
σ0.000
min1637.000-1645.000=-8.000
max1637.000-1645.000=-8.000
mean26.096-26.122=-0.027
σ0.114-0.106=0.008
min25.981-26.029=-0.049
max26.253-26.272=-0.019