Compare commits

Home / Compare 5c2bfe85 .. 70f3674d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.055=0.001
σ0.369-0.368=0.000
min53.922-53.916=0.007
max55.106-55.103=0.003
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.141-0.139=0.002
σ0.007-0.004=0.003
min0.133-0.135=-0.002
max0.156-0.147=0.009
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.001
σ0.006-0.007=-0.001
min43.385-43.385=-0.000
max43.401-43.406=-0.005
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.122-0.122=0.001
σ0.003-0.003=0.000
min0.119-0.119=-0.000
max0.128-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.980-1006.984=-0.004
σ0.870-0.855=0.015
min1006.481-1006.483=-0.002
max1010.582-1010.507=0.075
mean1048.250-1047.200=1.050
σ311.486-314.016=-2.530
min577.000
max1650.000-1645.000=5.000
mean1.542-1.534=0.008
σ0.096-0.082=0.014
min1.460-1.404=0.056
max1.791-1.798=-0.007

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.001
σ0.002-0.002=-0.000
min0.882
max0.887
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.445-0.430=0.015
σ0.181-0.144=0.038
min0.346-0.326=0.020
max0.767-0.684=0.083
name=error_case.art
mean2.339-2.340=-0.002
σ0.003-0.003=-0.000
min2.337
max2.342-2.343=-0.001
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.921-0.887=0.035
σ0.155-0.091=0.064
min0.830-0.812=0.018
max1.197-1.046=0.151
name=heavy_item.art
mean1.524-1.524=0.000
σ0.002-0.001=0.001
min1.522
max1.526-1.525=0.001
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.529-0.545=-0.016
σ0.046-0.054=-0.008
min0.494-0.496=-0.002
max0.607-0.632=-0.026
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.002=-0.000
min2.360
max2.364
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.839-0.865=-0.026
σ0.038-0.033=0.005
min0.802-0.843=-0.041
max0.902-0.924=-0.022

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.832=0.003
σ0.030-0.028=0.002
min964.811-964.810=0.001
max964.886-964.876=0.010
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.785-0.808=-0.023
σ0.058-0.048=0.010
min0.708-0.748=-0.040
max0.864-0.864=0.000
name=cdr_enhanced_4k_loc.art
mean885.514-885.514=-0.000
σ0.009-0.007=0.002
min885.504
max885.525-885.520=0.005
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.710-0.686=0.024
σ0.064-0.057=0.007
min0.598-0.608=-0.010
max0.755-0.758=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716
σ0.002
min7.715
max7.719
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean4.224-4.233=-0.009
σ0.070-0.099=-0.029
min4.093-4.098=-0.005
max4.591-4.633=-0.042
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean4.231-4.236=-0.005
σ0.069-0.077=-0.008
min4.106-4.113=-0.007
max4.511-4.536=-0.025
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.742-0.747=-0.006
σ0.025-0.019=0.006
min0.575-0.685=-0.109
max0.859-0.851=0.008
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.704-0.706=-0.002
σ0.015-0.016=-0.002
min0.676-0.635=0.041
max0.802-0.764=0.038

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.572-295.627=-0.055
σ0.240-0.258=-0.017
min295.411-295.377=0.034
max296.235-296.311=-0.077
mean2031.000-1913.000=118.000
σ0.000
min2031.000-1913.000=118.000
max2031.000-1913.000=118.000
mean0.545-0.575=-0.030
σ0.029-0.053=-0.025
min0.505-0.513=-0.008
max0.574-0.694=-0.120

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.409-285.406=0.003
σ0.031-0.032=-0.001
min285.375-285.365=0.010
max285.442-285.441=0.001
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.386-0.391=-0.005
σ0.007-0.009=-0.002
min0.380-0.381=-0.000
max0.398-0.401=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.807-1295.795=0.012
σ0.111-0.114=-0.003
min1295.682-1295.666=0.016
max1295.951-1295.947=0.004
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean1.893-1.978=-0.085
σ0.089-0.124=-0.035
min1.805-1.843=-0.037
max2.023-2.132=-0.109
iters=5
new-facts=6402
prior-facts=1
mean1539.915-1539.936=-0.021
σ6.882-6.890=-0.007
min1536.608-1536.634=-0.026
max1552.221-1552.255=-0.034
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean2.297-2.345=-0.048
σ0.235-0.207=0.028
min2.037-2.102=-0.065
max2.587-2.618=-0.031
iters=5
new-facts=6402
prior-facts=6402
mean1857.710-1857.705=0.006
σ0.048-0.059=-0.011
min1857.660-1857.642=0.017
max1857.768-1857.785=-0.018
mean1789.200-1772.800=16.400
σ165.069-134.715=30.354
min1650.000-1645.000=5.000
max2031.000-1913.000=118.000
mean3.037-2.971=0.067
σ0.252-0.212=0.039
min2.839-2.677=0.162
max3.461-3.277=0.185

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.305-1.344=-0.040
σ0.216-0.221=-0.004
min1.107-1.107=-0.000
max1.628-1.702=-0.074

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.741=-0.001
σ580.934-580.934=0.000
min155.270-155.272=-0.002
max1317.142-1317.142=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean0.524-0.534=-0.010
σ0.537-0.549=-0.012
min0.254-0.255=-0.001
max1.330-1.358=-0.028
policies=20
mean1552.987-1552.990=-0.003
σ0.328-0.328=-0.000
min1552.761-1552.767=-0.006
max1553.474-1553.478=-0.004
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean2.587-2.590=-0.003
σ0.015-0.024=-0.009
min2.572-2.569=0.004
max2.606-2.620=-0.014
policies=200
mean15537.993-15537.931=0.062
σ0.070-0.082=-0.011
min15537.897-15537.839=0.058
max15538.064-15538.012=0.053
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1645.000=5.000
σ0.000
min1650.000-1645.000=5.000
max1650.000-1645.000=5.000
mean26.155-26.122=0.032
σ0.190-0.106=0.085
min26.021-26.029=-0.008
max26.433-26.272=0.161