Compare commits

Home / Compare 06dcc858 .. 37ba03dd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.047-54.045=0.002
σ0.370-0.368=0.001
min53.902-53.900=0.003
max55.099-55.093=0.006
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.144-0.139=0.004
σ0.009-0.004=0.005
min0.137-0.134=0.002
max0.159-0.147=0.013
cache=y
dps=1
iters=10
policies=100
mean43.383-43.385=-0.001
σ0.007-0.007=0.000
min43.374-43.376=-0.001
max43.399-43.395=0.004
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.122-0.122=0.000
σ0.004-0.004=-0.001
min0.119-0.117=0.002
max0.129-0.130=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.978-1006.981=-0.003
σ0.923-0.872=0.051
min1006.512-1006.484=0.028
max1010.816-1010.590=0.225
mean1049.950-1045.600=4.350
σ307.735-314.243=-6.508
min575.000
max1649.000-1643.000=6.000
mean1.565-1.544=0.021
σ0.112-0.076=0.036
min1.488-1.485=0.003
max1.998-1.793=0.204

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1649.000-1643.000=6.000
σ0.000
min1649.000-1643.000=6.000
max1649.000-1643.000=6.000
mean0.424-0.414=0.010
σ0.128-0.133=-0.005
min0.341-0.324=0.017
max0.643-0.649=-0.007
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1649.000-1643.000=6.000
σ0.000
min1649.000-1643.000=6.000
max1649.000-1643.000=6.000
mean0.873-0.880=-0.007
σ0.081-0.086=-0.005
min0.818-0.813=0.005
max1.016-1.028=-0.012
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1649.000-1643.000=6.000
σ0.000
min1649.000-1643.000=6.000
max1649.000-1643.000=6.000
mean0.527-0.531=-0.004
σ0.046-0.050=-0.004
min0.483-0.489=-0.006
max0.601-0.611=-0.010
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1649.000-1643.000=6.000
σ0.000
min1649.000-1643.000=6.000
max1649.000-1643.000=6.000
mean0.844-0.837=0.007
σ0.035-0.039=-0.004
min0.805-0.791=0.014
max0.900-0.893=0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.831=0.007
σ0.032-0.025=0.007
min964.811-964.802=0.009
max964.893-964.863=0.030
mean1649.000-1643.000=6.000
σ0.000
min1649.000-1643.000=6.000
max1649.000-1643.000=6.000
mean0.834-0.813=0.021
σ0.039-0.061=-0.022
min0.770-0.709=0.061
max0.860-0.852=0.008
name=cdr_enhanced_4k_loc.art
mean885.513-885.513=0.000
σ0.006-0.006=0.000
min885.504
max885.518-885.519=-0.000
mean1649.000-1643.000=6.000
σ0.000
min1649.000-1643.000=6.000
max1649.000-1643.000=6.000
mean0.741-0.684=0.057
σ0.003-0.036=-0.033
min0.736-0.638=0.098
max0.744-0.734=0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.719=0.001
mean1649.000-1643.000=6.000
σ0.000
min1649.000-1643.000=6.000
max1649.000-1643.000=6.000
mean4.255-4.200=0.055
σ0.076-0.096=-0.020
min4.135-3.777=0.358
max4.509-4.512=-0.003
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668
mean1649.000-1643.000=6.000
σ0.000
min1649.000-1643.000=6.000
max1649.000-1643.000=6.000
mean4.238-4.153=0.085
σ0.087-0.070=0.017
min4.114-4.037=0.077
max4.579-4.456=0.123
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1649.000-1643.000=6.000
σ0.000
min1649.000-1643.000=6.000
max1649.000-1643.000=6.000
mean0.623-0.737=-0.114
σ0.108-0.018=0.090
min0.506-0.711=-0.205
max0.852-0.856=-0.004
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1649.000-1643.000=6.000
σ0.000
min1649.000-1643.000=6.000
max1649.000-1643.000=6.000
mean0.501-0.699=-0.198
σ0.027-0.014=0.013
min0.295-0.668=-0.373
max0.628-0.766=-0.138

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.618-295.617=0.001
σ0.264-0.215=0.050
min295.412-295.420=-0.008
max296.346-296.203=0.143
mean1895.000-1913.000=-18.000
σ0.000
min1895.000-1913.000=-18.000
max1895.000-1913.000=-18.000
mean0.551-0.589=-0.038
σ0.050-0.051=-0.000
min0.503-0.510=-0.007
max0.666-0.703=-0.037

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.409-285.404=0.005
σ0.034-0.034=0.000
min285.362-285.358=0.004
max285.448-285.442=0.007
mean1649.000-1643.000=6.000
σ0.000
min1649.000-1643.000=6.000
max1649.000-1643.000=6.000
mean0.394-0.388=0.006
σ0.011-0.010=0.000
min0.386-0.383=0.003
max0.411-0.407=0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.807-1295.806=0.000
σ0.122-0.124=-0.002
min1295.678-1295.679=-0.000
max1295.972-1295.973=-0.001
mean1649.000-1643.000=6.000
σ0.000
min1649.000-1643.000=6.000
max1649.000-1643.000=6.000
mean1.897-1.905=-0.008
σ0.089-0.071=0.017
min1.803-1.828=-0.025
max1.998-1.974=0.025
iters=5
new-facts=6402
prior-facts=1
mean1539.917-1539.931=-0.014
σ6.868-6.916=-0.048
min1536.663-1536.561=0.101
max1552.201-1552.297=-0.097
mean1649.000-1643.000=6.000
σ0.000
min1649.000-1643.000=6.000
max1649.000-1643.000=6.000
mean2.199-2.402=-0.203
σ0.152-0.344=-0.192
min2.066-2.018=0.047
max2.414-2.869=-0.456
iters=5
new-facts=6402
prior-facts=6402
mean1857.711-1857.703=0.008
σ0.048-0.055=-0.007
min1857.663-1857.650=0.013
max1857.777-1857.779=-0.003
mean1768.400-1779.000=-10.600
σ121.679-130.499=-8.820
min1649.000-1643.000=6.000
max1895.000-1913.000=-18.000
mean3.114-3.071=0.042
σ0.340-0.191=0.149
min2.832-2.853=-0.021
max3.705-3.274=0.430

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.298-1.434=-0.137
σ0.188-0.272=-0.083
min1.101-1.096=0.006
max1.611-1.803=-0.193

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.740=0.001
σ580.934-580.934=-0.000
min155.272-155.272=0.000
max1317.142-1317.142=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1649.000-1643.000=6.000
σ0.000
min1649.000-1643.000=6.000
max1649.000-1643.000=6.000
mean0.554-0.539=0.016
σ0.588-0.565=0.023
min0.257-0.254=0.004
max1.436-1.386=0.050
policies=20
mean1552.989-1552.985=0.003
σ0.324-0.327=-0.003
min1552.767-1552.753=0.014
max1553.470-1553.470=0.000
mean920.000
σ0.000
min920.000
max920.000
mean1649.000-1643.000=6.000
σ0.000
min1649.000-1643.000=6.000
max1649.000-1643.000=6.000
mean2.588-2.582=0.006
σ0.009-0.013=-0.004
min2.575-2.567=0.007
max2.593-2.597=-0.004
policies=200
mean15538.058-15538.064=-0.006
σ0.081-0.053=0.028
min15537.993-15538.028=-0.035
max15538.166-15538.141=0.025
mean9200.000
σ0.000
min9200.000
max9200.000
mean1649.000-1643.000=6.000
σ0.000
min1649.000-1643.000=6.000
max1649.000-1643.000=6.000
mean26.261-26.306=-0.045
σ0.077-0.150=-0.073
min26.204-26.145=0.059
max26.373-26.499=-0.126