Compare commits

Home / Compare 60590533 .. cad92f58

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.056=0.000
σ0.368-0.369=-0.002
min53.914-53.906=0.009
max55.102-55.106=-0.004
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.140-0.139=0.001
σ0.004-0.007=-0.003
min0.136-0.130=0.005
max0.146-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.007-0.007=0.000
min43.379-43.384=-0.005
max43.405-43.403=0.001
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.120-0.121=-0.001
σ0.005-0.005=-0.001
min0.116-0.115=0.001
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.981-1006.982=-0.000
σ0.872-0.850=0.022
min1006.481-1006.475=0.006
max1010.591-1010.482=0.109
mean1043.350-1055.250=-11.900
σ302.522-307.466=-4.944
min572.000-580.000=-8.000
max1631.000-1653.000=-22.000
mean1.537-1.525=0.011
σ0.084-0.054=0.029
min1.455-1.462=-0.008
max1.824-1.657=0.168

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1631.000-1653.000=-22.000
σ0.000
min1631.000-1653.000=-22.000
max1631.000-1653.000=-22.000
mean0.436-0.416=0.020
σ0.178-0.139=0.039
min0.345-0.320=0.025
max0.753-0.661=0.092
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1631.000-1653.000=-22.000
σ0.000
min1631.000-1653.000=-22.000
max1631.000-1653.000=-22.000
mean0.920-0.874=0.047
σ0.147-0.091=0.056
min0.845-0.814=0.031
max1.182-1.031=0.151
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1631.000-1653.000=-22.000
σ0.000
min1631.000-1653.000=-22.000
max1631.000-1653.000=-22.000
mean0.533-0.531=0.002
σ0.057-0.043=0.014
min0.483-0.492=-0.009
max0.627-0.601=0.026
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1631.000-1653.000=-22.000
σ0.000
min1631.000-1653.000=-22.000
max1631.000-1653.000=-22.000
mean0.842-0.846=-0.004
σ0.040-0.037=0.003
min0.812-0.811=0.001
max0.911-0.908=0.003

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.831=-0.000
σ0.024-0.023=0.001
min964.806-964.807=-0.001
max964.861-964.860=0.000
mean1631.000-1653.000=-22.000
σ0.000
min1631.000-1653.000=-22.000
max1631.000-1653.000=-22.000
mean0.756-0.842=-0.086
σ0.035-0.033=0.002
min0.717-0.784=-0.067
max0.796-0.861=-0.066
name=cdr_enhanced_4k_loc.art
mean885.513-885.513=0.000
σ0.006-0.004=0.001
min885.504-885.505=-0.001
max885.518-885.516=0.001
mean1631.000-1653.000=-22.000
σ0.000
min1631.000-1653.000=-22.000
max1631.000-1653.000=-22.000
mean0.731-0.719=0.011
σ0.009-0.038=-0.030
min0.721-0.656=0.065
max0.740-0.751=-0.011

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.722=-0.003
mean1631.000-1653.000=-22.000
σ0.000
min1631.000-1653.000=-22.000
max1631.000-1653.000=-22.000
mean4.225-4.280=-0.054
σ0.093-0.110=-0.017
min4.084-4.069=0.015
max4.550-4.824=-0.274
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1631.000-1653.000=-22.000
σ0.000
min1631.000-1653.000=-22.000
max1631.000-1653.000=-22.000
mean4.245-4.233=0.012
σ0.103-0.080=0.023
min4.066-4.055=0.011
max4.614-4.521=0.094
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1631.000-1653.000=-22.000
σ0.000
min1631.000-1653.000=-22.000
max1631.000-1653.000=-22.000
mean0.732-0.641=0.091
σ0.029-0.102=-0.073
min0.703-0.513=0.190
max0.913-0.843=0.070
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1631.000-1653.000=-22.000
σ0.000
min1631.000-1653.000=-22.000
max1631.000-1653.000=-22.000
mean0.513-0.502=0.011
σ0.048-0.012=0.037
min0.479-0.475=0.004
max0.806-0.549=0.257

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.415-295.713=-0.298
σ0.205-0.220=-0.015
min295.192-295.573=-0.381
max295.873-296.317=-0.444
mean1907.000-1933.000=-26.000
σ0.000
min1907.000-1933.000=-26.000
max1907.000-1933.000=-26.000
mean0.579-0.562=0.017
σ0.051-0.036=0.016
min0.497-0.506=-0.009
max0.675-0.631=0.043

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.409-285.411=-0.003
σ0.031-0.034=-0.003
min285.367-285.365=0.002
max285.451-285.444=0.007
mean1631.000-1653.000=-22.000
σ0.000
min1631.000-1653.000=-22.000
max1631.000-1653.000=-22.000
mean0.389-0.389=-0.000
σ0.005-0.009=-0.004
min0.383-0.380=0.003
max0.396-0.399=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.807-1295.797=0.009
σ0.124-0.111=0.013
min1295.675-1295.676=-0.001
max1295.977-1295.927=0.049
mean1631.000-1653.000=-22.000
σ0.000
min1631.000-1653.000=-22.000
max1631.000-1653.000=-22.000
mean1.917-1.890=0.027
σ0.105-0.081=0.024
min1.795-1.798=-0.003
max2.043-1.969=0.074
iters=5
new-facts=6402
prior-facts=1
mean1539.916-1539.942=-0.026
σ6.853-6.887=-0.034
min1536.650-1536.646=0.004
max1552.172-1552.256=-0.085
mean1631.000-1653.000=-22.000
σ0.000
min1631.000-1653.000=-22.000
max1631.000-1653.000=-22.000
mean2.213-2.383=-0.170
σ0.226-0.191=0.035
min2.018-2.180=-0.161
max2.562-2.656=-0.094
iters=5
new-facts=6402
prior-facts=6402
mean1857.710-1857.716=-0.006
σ0.058-0.058=-0.000
min1857.640-1857.652=-0.011
max1857.783-1857.778=0.006
mean1771.000-1786.400=-15.400
σ132.575-140.776=-8.201
min1631.000-1653.000=-22.000
max1907.000-1933.000=-26.000
mean3.019-3.014=0.005
σ0.189-0.119=0.070
min2.848-2.887=-0.040
max3.312-3.147=0.165

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.406-1.401=0.005
σ0.267-0.285=-0.018
min1.101-1.120=-0.019
max1.713-1.860=-0.148

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-445.741=-0.001
σ580.935-580.934=0.000
min155.271-155.272=-0.001
max1317.141-1317.143=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1631.000-1653.000=-22.000
σ0.000
min1631.000-1653.000=-22.000
max1631.000-1653.000=-22.000
mean0.541-0.536=0.005
σ0.557-0.550=0.008
min0.258-0.257=0.002
max1.377-1.361=0.017
policies=20
mean1552.974-1552.990=-0.015
σ0.333-0.331=0.001
min1552.749-1552.760=-0.011
max1553.469-1553.482=-0.013
mean920.000
σ0.000
min920.000
max920.000
mean1631.000-1653.000=-22.000
σ0.000
min1631.000-1653.000=-22.000
max1631.000-1653.000=-22.000
mean2.589-2.587=0.002
σ0.016-0.009=0.007
min2.572-2.577=-0.005
max2.609-2.596=0.013
policies=200
mean15537.991-15537.969=0.022
σ0.150-0.120=0.031
min15537.788-15537.839=-0.051
max15538.114-15538.101=0.013
mean9200.000
σ0.000
min9200.000
max9200.000
mean1631.000-1653.000=-22.000
σ0.000
min1631.000-1653.000=-22.000
max1631.000-1653.000=-22.000
mean26.160-26.102=0.058
σ0.089-0.190=-0.101
min26.070-25.968=0.102
max26.267-26.379=-0.113