Compare commits

Home / Compare bbffbd20 .. cce4adc3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.055=0.001
σ0.370-0.368=0.002
min53.910-53.916=-0.006
max55.109-55.102=0.007
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.140-0.138=0.002
σ0.004-0.006=-0.002
min0.133-0.132=0.002
max0.147-0.148=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.396=-0.002
σ0.008-0.006=0.001
min43.385-43.386=-0.001
max43.407-43.405=0.002
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.120-0.122=-0.002
σ0.004-0.004=0.000
min0.115-0.119=-0.004
max0.127-0.130=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.957-1006.961=-0.004
σ0.892-0.887=0.004
min1006.490-1006.465=0.024
max1010.661-1010.641=0.020
mean1047.700-1045.400=2.300
σ317.556-303.010=14.546
min545.000-575.000=-30.000
max1648.000-1632.000=16.000
mean1.557-1.558=-0.001
σ0.094-0.092=0.002
min1.483-1.453=0.030
max1.821-1.818=0.003

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=0.001
σ0.003-0.002=0.000
min0.882
max0.887
mean1648.000-1632.000=16.000
σ0.000
min1648.000-1632.000=16.000
max1648.000-1632.000=16.000
mean0.449-0.411=0.038
σ0.218-0.132=0.085
min0.321-0.329=-0.008
max0.837-0.642=0.194
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.003=0.000
min2.337
max2.342
mean1648.000-1632.000=16.000
σ0.000
min1648.000-1632.000=16.000
max1648.000-1632.000=16.000
mean0.933-0.882=0.051
σ0.200-0.094=0.106
min0.831-0.809=0.022
max1.289-1.041=0.248
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002-0.001=0.001
min1.522
max1.526-1.525=0.001
mean1648.000-1632.000=16.000
σ0.000
min1648.000-1632.000=16.000
max1648.000-1632.000=16.000
mean0.539-0.533=0.006
σ0.058-0.050=0.008
min0.504-0.502=0.001
max0.641-0.617=0.023
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.002=-0.000
min2.360
max2.364
mean1648.000-1632.000=16.000
σ0.000
min1648.000-1632.000=16.000
max1648.000-1632.000=16.000
mean0.844-0.847=-0.003
σ0.048-0.040=0.008
min0.810-0.821=-0.011
max0.925-0.917=0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.837-964.837=-0.001
σ0.022-0.034=-0.012
min964.818-964.810=0.008
max964.874-964.894=-0.020
mean1648.000-1632.000=16.000
σ0.000
min1648.000-1632.000=16.000
max1648.000-1632.000=16.000
mean0.793-0.821=-0.028
σ0.075-0.033=0.042
min0.666-0.787=-0.120
max0.850-0.857=-0.007
name=cdr_enhanced_4k_loc.art
mean885.514-885.512=0.001
σ0.001-0.007=-0.006
min885.513-885.504=0.009
max885.516-885.521=-0.005
mean1648.000-1632.000=16.000
σ0.000
min1648.000-1632.000=16.000
max1648.000-1632.000=16.000
mean0.667-0.711=-0.043
σ0.087-0.023=0.065
min0.545-0.677=-0.132
max0.739-0.737=0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.002
mean1648.000-1632.000=16.000
σ0.000
min1648.000-1632.000=16.000
max1648.000-1632.000=16.000
mean3.508-3.530=-0.021
σ0.089-0.079=0.010
min3.328-3.395=-0.066
max4.096-3.808=0.289
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.668
mean1648.000-1632.000=16.000
σ0.000
min1648.000-1632.000=16.000
max1648.000-1632.000=16.000
mean3.496-3.512=-0.016
σ0.064-0.082=-0.018
min3.369-3.369=-0.000
max3.694-3.797=-0.104
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1648.000-1632.000=16.000
σ0.000
min1648.000-1632.000=16.000
max1648.000-1632.000=16.000
mean0.744-0.619=0.125
σ0.021-0.103=-0.082
min0.704-0.512=0.192
max0.858-0.854=0.004
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1648.000-1632.000=16.000
σ0.000
min1648.000-1632.000=16.000
max1648.000-1632.000=16.000
mean0.695-0.508=0.187
σ0.018-0.015=0.003
min0.644-0.473=0.171
max0.768-0.585=0.183

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.462-295.578=-0.116
σ0.214-0.223=-0.009
min295.340-295.401=-0.060
max296.060-296.200=-0.140
mean1900.000-2035.000=-135.000
σ0.000
min1900.000-2035.000=-135.000
max1900.000-2035.000=-135.000
mean0.570-0.543=0.028
σ0.040-0.038=0.002
min0.507-0.485=0.022
max0.625-0.575=0.050

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.394-285.390=0.003
σ0.036-0.036=0.000
min285.345-285.344=0.000
max285.430-285.428=0.002
mean1648.000-1632.000=16.000
σ0.000
min1648.000-1632.000=16.000
max1648.000-1632.000=16.000
mean0.387-0.384=0.003
σ0.007-0.007=-0.001
min0.380-0.380=-0.000
max0.397-0.398=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.779-1295.784=-0.005
σ0.111-0.114=-0.003
min1295.660-1295.659=0.001
max1295.915-1295.925=-0.010
mean1648.000-1632.000=16.000
σ0.000
min1648.000-1632.000=16.000
max1648.000-1632.000=16.000
mean1.886-1.855=0.031
σ0.087-0.062=0.025
min1.800-1.793=0.007
max1.985-1.933=0.051
iters=5
new-facts=6402
prior-facts=1
mean1539.928-1539.973=-0.045
σ6.870-6.813=0.056
min1536.595-1536.717=-0.123
max1552.210-1552.155=0.055
mean1648.000-1632.000=16.000
σ0.000
min1648.000-1632.000=16.000
max1648.000-1632.000=16.000
mean2.369-2.404=-0.036
σ0.208-0.286=-0.078
min2.041-2.155=-0.114
max2.588-2.898=-0.309
iters=5
new-facts=6402
prior-facts=6402
mean1857.684-1857.669=0.016
σ0.067-0.073=-0.006
min1857.604-1857.598=0.006
max1857.776-1857.766=0.010
mean1772.800-1782.000=-9.200
σ126.029-174.956=-48.927
min1648.000-1632.000=16.000
max1900.000-2035.000=-135.000
mean3.016-3.217=-0.201
σ0.302-0.379=-0.077
min2.652-2.659=-0.007
max3.478-3.618=-0.140

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.167-1.221=-0.054
σ0.338-0.334=0.004
min0.925-0.928=-0.003
max1.725-1.768=-0.043

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.707-445.708=-0.000
σ580.934-580.934=0.000
min155.239-155.239=0.000
max1317.108-1317.108=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1648.000-1632.000=16.000
σ0.000
min1648.000-1632.000=16.000
max1648.000-1632.000=16.000
mean0.542-0.523=0.019
σ0.561-0.527=0.034
min0.257-0.259=-0.002
max1.384-1.313=0.070
policies=20
mean1552.659-1552.660=-0.000
σ0.326-0.330=-0.004
min1552.434-1552.433=0.000
max1553.143-1553.150=-0.007
mean920.000
σ0.000
min920.000
max920.000
mean1648.000-1632.000=16.000
σ0.000
min1648.000-1632.000=16.000
max1648.000-1632.000=16.000
mean2.588-2.587=0.001
σ0.016-0.008=0.008
min2.571-2.577=-0.006
max2.608-2.597=0.011
policies=200
mean15534.739-15534.723=0.016
σ0.069-0.068=0.001
min15534.668-15534.678=-0.011
max15534.827-15534.824=0.003
mean9200.000
σ0.000
min9200.000
max9200.000
mean1648.000-1632.000=16.000
σ0.000
min1648.000-1632.000=16.000
max1648.000-1632.000=16.000
mean26.172-26.077=0.095
σ0.300-0.132=0.168
min25.955-25.968=-0.013
max26.614-26.267=0.347