Compare commits

Home / Compare 9697fda7 .. 771833ff

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.058=-0.000
σ0.370-0.369=0.001
min53.909-53.911=-0.002
max55.110-55.106=0.003
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.137-0.141=-0.003
σ0.005-0.004=0.001
min0.131-0.135=-0.004
max0.147-0.148=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.394-43.396=-0.002
σ0.007-0.006=0.001
min43.381-43.385=-0.004
max43.406-43.406=0.000
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.119-0.129=-0.010
σ0.005-0.009=-0.004
min0.114-0.118=-0.004
max0.129-0.142=-0.013

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.959-1006.959=0.000
σ0.887-0.890=-0.003
min1006.467-1006.491=-0.024
max1010.641-1010.656=-0.015
mean1040.500-1043.300=-2.800
σ307.928-312.819=-4.891
min545.000-544.000=1.000
max1598.000-1625.000=-27.000
mean1.553-1.562=-0.009
σ0.072-0.116=-0.045
min1.489-1.372=0.116
max1.730-1.825=-0.095

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.001
σ0.003-0.002=0.001
min0.882
max0.887
mean1598.000-1625.000=-27.000
σ0.000
min1598.000-1625.000=-27.000
max1598.000-1625.000=-27.000
mean0.406-0.410=-0.004
σ0.130-0.130=0.001
min0.329-0.332=-0.002
max0.637-0.638=-0.000
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.003=0.000
min2.337
max2.342
mean1598.000-1625.000=-27.000
σ0.000
min1598.000-1625.000=-27.000
max1598.000-1625.000=-27.000
mean0.878-0.887=-0.009
σ0.089-0.089=0.000
min0.819-0.834=-0.015
max1.033-1.044=-0.011
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002-0.001=0.001
min1.522
max1.526-1.525=0.001
mean1598.000-1625.000=-27.000
σ0.000
min1598.000-1625.000=-27.000
max1598.000-1625.000=-27.000
mean0.532-0.532=0.000
σ0.044-0.047=-0.003
min0.491-0.495=-0.004
max0.605-0.613=-0.008
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.002=-0.000
min2.360
max2.364
mean1598.000-1625.000=-27.000
σ0.000
min1598.000-1625.000=-27.000
max1598.000-1625.000=-27.000
mean0.838-0.845=-0.007
σ0.048-0.048=-0.000
min0.795-0.806=-0.012
max0.917-0.928=-0.011

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=0.001
σ0.034-0.035=-0.000
min964.813-964.810=0.003
max964.894-964.894=-0.000
mean1598.000-1625.000=-27.000
σ0.000
min1598.000-1625.000=-27.000
max1598.000-1625.000=-27.000
mean0.807-0.814=-0.008
σ0.038-0.031=0.008
min0.751-0.774=-0.023
max0.859-0.853=0.006
name=cdr_enhanced_4k_loc.art
mean885.511-885.513=-0.002
σ0.007-0.006=0.000
min885.504-885.506=-0.001
max885.521-885.521=-0.000
mean1598.000-1625.000=-27.000
σ0.000
min1598.000-1625.000=-27.000
max1598.000-1625.000=-27.000
mean0.719-0.728=-0.009
σ0.029-0.009=0.020
min0.669-0.716=-0.047
max0.740-0.736=0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.722=-0.003
mean1598.000-1625.000=-27.000
σ0.000
min1598.000-1625.000=-27.000
max1598.000-1625.000=-27.000
mean3.546-4.258=-0.712
σ0.101-0.078=0.023
min3.411-4.132=-0.721
max4.060-4.537=-0.477
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1598.000-1625.000=-27.000
σ0.000
min1598.000-1625.000=-27.000
max1598.000-1625.000=-27.000
mean3.530-4.203=-0.672
σ0.080-0.068=0.012
min3.412-4.085=-0.673
max4.007-4.488=-0.481
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1598.000-1625.000=-27.000
σ0.000
min1598.000-1625.000=-27.000
max1598.000-1625.000=-27.000
mean0.740-0.731=0.010
σ0.029-0.043=-0.015
min0.604-0.521=0.082
max0.864-0.839=0.025
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1598.000-1625.000=-27.000
σ0.000
min1598.000-1625.000=-27.000
max1598.000-1625.000=-27.000
mean0.545-0.701=-0.156
σ0.086-0.016=0.070
min0.475-0.673=-0.198
max0.762-0.788=-0.026

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.587-295.529=0.057
σ0.226-0.288=-0.062
min295.451-295.292=0.159
max296.217-296.314=-0.097
mean2066.000-1898.000=168.000
σ0.000
min2066.000-1898.000=168.000
max2066.000-1898.000=168.000
mean0.528-0.593=-0.064
σ0.030-0.019=0.010
min0.503-0.558=-0.054
max0.574-0.619=-0.044

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.399-285.396=0.003
σ0.036-0.038=-0.002
min285.350-285.345=0.005
max285.439-285.435=0.004
mean1598.000-1625.000=-27.000
σ0.000
min1598.000-1625.000=-27.000
max1598.000-1625.000=-27.000
mean0.389-0.394=-0.005
σ0.007-0.007=0.000
min0.381-0.384=-0.002
max0.396-0.400=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.773-1295.780=-0.007
σ0.100-0.115=-0.015
min1295.661-1295.657=0.005
max1295.878-1295.913=-0.036
mean1598.000-1625.000=-27.000
σ0.000
min1598.000-1625.000=-27.000
max1598.000-1625.000=-27.000
mean1.941-1.912=0.029
σ0.122-0.084=0.038
min1.814-1.822=-0.007
max2.102-1.999=0.103
iters=5
new-facts=6402
prior-facts=1
mean1539.935-1539.901=0.034
σ6.840-6.862=-0.022
min1536.707-1536.658=0.048
max1552.169-1552.173=-0.005
mean1598.000-1625.000=-27.000
σ0.000
min1598.000-1625.000=-27.000
max1598.000-1625.000=-27.000
mean2.134-2.201=-0.068
σ0.149-0.150=-0.001
min2.025-2.044=-0.018
max2.382-2.365=0.017
iters=5
new-facts=6402
prior-facts=6402
mean1857.689-1857.688=0.002
σ0.071-0.070=0.001
min1857.610-1857.603=0.007
max1857.784-1857.782=0.002
mean1784.600-1764.800=19.800
σ203.715-129.598=74.117
min1598.000-1625.000=-27.000
max2066.000-1898.000=168.000
mean2.897-2.990=-0.093
σ0.080-0.271=-0.192
min2.805-2.726=0.079
max2.998-3.373=-0.375

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.258-1.228=0.029
σ0.267-0.345=-0.079
min0.931-0.931=-0.000
max1.568-1.822=-0.254

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.707-445.705=0.002
σ580.934-580.934=-0.001
min155.239-155.234=0.004
max1317.107-1317.106=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1598.000-1625.000=-27.000
σ0.000
min1598.000-1625.000=-27.000
max1598.000-1625.000=-27.000
mean0.531-0.536=-0.005
σ0.553-0.537=0.015
min0.251-0.264=-0.012
max1.360-1.342=0.018
policies=20
mean1552.665-1552.652=0.013
σ0.342-0.322=0.020
min1552.431-1552.427=0.005
max1553.174-1553.130=0.044
mean920.000
σ0.000
min920.000
max920.000
mean1598.000-1625.000=-27.000
σ0.000
min1598.000-1625.000=-27.000
max1598.000-1625.000=-27.000
mean2.606-2.582=0.024
σ0.032-0.022=0.010
min2.579-2.566=0.012
max2.646-2.613=0.033
policies=200
mean15534.742-15534.732=0.011
σ0.087-0.088=-0.000
min15534.625-15534.632=-0.006
max15534.834-15534.837=-0.003
mean9200.000
σ0.000
min9200.000
max9200.000
mean1598.000-1625.000=-27.000
σ0.000
min1598.000-1625.000=-27.000
max1598.000-1625.000=-27.000
mean26.196-26.100=0.096
σ0.159-0.121=0.038
min26.043-25.988=0.055
max26.334-26.208=0.126