Compare commits

Home / Compare 7fb956f6 .. e531a58e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.014=0.001
σ0.370-0.370=-0.001
min53.871-53.867=0.004
max55.066-55.066=-0.000
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.139-0.137=0.002
σ0.003-0.004=-0.001
min0.136-0.130=0.006
max0.145-0.142=0.003
cache=y
dps=1
iters=10
policies=100
mean43.322-43.321=0.001
σ0.008-0.006=0.002
min43.308-43.312=-0.004
max43.334-43.333=0.001
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.118-0.118=0.001
σ0.004-0.004=0.000
min0.113-0.113=-0.000
max0.125-0.123=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.306-1006.311=-0.005
σ1.167-1.157=0.010
min1005.743-1005.768=-0.026
max1011.194-1011.150=0.044
mean1041.250-1046.450=-5.200
σ312.933-313.488=-0.555
min593.000-596.000=-3.000
max1634.000-1642.000=-8.000
mean1.550-1.560=-0.010
σ0.064-0.075=-0.011
min1.481-1.470=0.011
max1.699-1.777=-0.078

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1634.000-1642.000=-8.000
σ0.000
min1634.000-1642.000=-8.000
max1634.000-1642.000=-8.000
mean0.411-0.431=-0.020
σ0.134-0.140=-0.006
min0.333-0.339=-0.006
max0.650-0.672=-0.023
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1634.000-1642.000=-8.000
σ0.000
min1634.000-1642.000=-8.000
max1634.000-1642.000=-8.000
mean0.861-0.872=-0.011
σ0.096-0.100=-0.004
min0.782-0.816=-0.033
max1.025-1.049=-0.024
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1634.000-1642.000=-8.000
σ0.000
min1634.000-1642.000=-8.000
max1634.000-1642.000=-8.000
mean0.536-0.536=0.001
σ0.052-0.057=-0.005
min0.496-0.500=-0.004
max0.625-0.636=-0.011
name=nested_use.art
mean2.360-2.360=0.001
σ0.002-0.002=0.000
min2.359
max2.363
mean1634.000-1642.000=-8.000
σ0.000
min1634.000-1642.000=-8.000
max1634.000-1642.000=-8.000
mean0.870-0.846=0.024
σ0.060-0.040=0.020
min0.817-0.817=0.000
max0.962-0.912=0.050

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.115=-0.000
σ0.033-0.034=-0.000
min964.086-964.085=0.000
max964.169-964.170=-0.001
mean1634.000-1642.000=-8.000
σ0.000
min1634.000-1642.000=-8.000
max1634.000-1642.000=-8.000
mean0.804-0.856=-0.052
σ0.029-0.006=0.023
min0.769-0.847=-0.079
max0.848-0.864=-0.015
name=cdr_enhanced_4k_loc.art
mean884.711-884.712=-0.001
σ0.007-0.008=-0.001
min884.705-884.705=0.000
max884.721-884.723=-0.001
mean1634.000-1642.000=-8.000
σ0.000
min1634.000-1642.000=-8.000
max1634.000-1642.000=-8.000
mean0.722-0.702=0.020
σ0.031-0.034=-0.003
min0.667-0.658=0.009
max0.744-0.736=0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=0.000
min7.714
max7.720-7.718=0.002
mean1634.000-1642.000=-8.000
σ0.000
min1634.000-1642.000=-8.000
max1634.000-1642.000=-8.000
mean4.205-4.288=-0.083
σ0.086-0.081=0.005
min4.044-4.141=-0.096
max4.542-4.600=-0.058
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=-0.000
min7.662
max7.666
mean1634.000-1642.000=-8.000
σ0.000
min1634.000-1642.000=-8.000
max1634.000-1642.000=-8.000
mean4.006-4.271=-0.265
σ0.306-0.074=0.232
min3.399-4.131=-0.733
max4.566-4.541=0.025
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1634.000-1642.000=-8.000
σ0.000
min1634.000-1642.000=-8.000
max1634.000-1642.000=-8.000
mean0.728-0.741=-0.013
σ0.024-0.016=0.007
min0.674-0.710=-0.036
max0.833-0.835=-0.002
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1634.000-1642.000=-8.000
σ0.000
min1634.000-1642.000=-8.000
max1634.000-1642.000=-8.000
mean0.692-0.703=-0.011
σ0.020-0.023=-0.003
min0.662-0.561=0.102
max0.846-0.788=0.058

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.179-296.127=0.052
σ0.274-0.219=0.055
min296.035-295.949=0.086
max296.937-296.714=0.223
mean1900.000-1908.000=-8.000
σ0.000
min1900.000-1908.000=-8.000
max1900.000-1908.000=-8.000
mean0.581-0.576=0.005
σ0.040-0.031=0.008
min0.548-0.506=0.042
max0.686-0.614=0.072

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.694-284.692=0.002
σ0.034-0.036=-0.001
min284.649-284.640=0.009
max284.730-284.729=0.002
mean1634.000-1642.000=-8.000
σ0.000
min1634.000-1642.000=-8.000
max1634.000-1642.000=-8.000
mean0.395-0.401=-0.006
σ0.010-0.013=-0.002
min0.382-0.386=-0.004
max0.403-0.419=-0.016
iters=5
new-facts=1
prior-facts=6402
mean1295.088-1295.049=0.039
σ0.128-0.108=0.020
min1294.954-1294.950=0.004
max1295.262-1295.222=0.040
mean1634.000-1642.000=-8.000
σ0.000
min1634.000-1642.000=-8.000
max1634.000-1642.000=-8.000
mean1.871-1.953=-0.083
σ0.067-0.177=-0.110
min1.790-1.803=-0.014
max1.936-2.243=-0.307
iters=5
new-facts=6402
prior-facts=1
mean1539.182-1539.203=-0.021
σ6.834-6.837=-0.002
min1535.930-1535.990=-0.059
max1551.405-1551.431=-0.026
mean1634.000-1642.000=-8.000
σ0.000
min1634.000-1642.000=-8.000
max1634.000-1642.000=-8.000
mean2.239-2.196=0.043
σ0.251-0.142=0.109
min2.045-2.049=-0.005
max2.645-2.364=0.282
iters=5
new-facts=6402
prior-facts=6402
mean1856.977-1856.986=-0.009
σ0.060-0.057=0.003
min1856.903-1856.926=-0.024
max1857.062-1857.066=-0.004
mean1767.800-1776.400=-8.600
σ129.947-130.803=-0.856
min1634.000-1642.000=-8.000
max1900.000-1908.000=-8.000
mean3.008-3.059=-0.050
σ0.287-0.229=0.058
min2.762-2.874=-0.113
max3.491-3.454=0.037

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.190-1.208=-0.017
σ0.289-0.320=-0.031
min0.926-0.932=-0.007
max1.668-1.741=-0.072

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.786=-0.001
σ581.213-581.212=0.000
min157.176-157.178=-0.002
max1319.605-1319.605=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1634.000-1642.000=-8.000
σ0.000
min1634.000-1642.000=-8.000
max1634.000-1642.000=-8.000
mean0.528-0.539=-0.011
σ0.541-0.551=-0.010
min0.257-0.259=-0.002
max1.339-1.365=-0.026
policies=20
mean1572.103-1572.101=0.002
σ0.361-0.349=0.012
min1571.866-1571.863=0.003
max1572.641-1572.619=0.022
mean920.000
σ0.000
min920.000
max920.000
mean1634.000-1642.000=-8.000
σ0.000
min1634.000-1642.000=-8.000
max1634.000-1642.000=-8.000
mean2.638-2.634=0.005
σ0.011-0.009=0.002
min2.623-2.623=0.000
max2.647-2.644=0.003
policies=200
mean15729.087-15729.084=0.004
σ0.066-0.120=-0.054
min15729.037-15728.992=0.045
max15729.184-15729.257=-0.073
mean9200.000
σ0.000
min9200.000
max9200.000
mean1634.000-1642.000=-8.000
σ0.000
min1634.000-1642.000=-8.000
max1634.000-1642.000=-8.000
mean26.480-26.607=-0.127
σ0.199-0.095=0.104
min26.269-26.529=-0.259
max26.749-26.744=0.005