Compare commits

Home / Compare 425e6c19 .. 7661b9cb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.014=0.000
σ0.371-0.369=0.001
min53.872-53.870=0.003
max55.068-55.065=0.003
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.135-0.140=-0.005
σ0.005-0.004=0.001
min0.129-0.137=-0.008
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=0.000
σ0.006-0.008=-0.002
min43.311-43.309=0.002
max43.334-43.338=-0.004
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.122-0.123=-0.001
σ0.004-0.004=0.000
min0.118-0.119=-0.001
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.310-1006.306=0.005
σ1.166-1.182=-0.017
min1005.751-1005.767=-0.016
max1011.190-1011.260=-0.069
mean1044.200-1043.700=0.500
σ312.612-311.595=1.017
min596.000
max1637.000-1631.000=6.000
mean1.539-1.575=-0.035
σ0.073-0.088=-0.016
min1.446-1.498=-0.053
max1.752-1.834=-0.082

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1637.000-1631.000=6.000
σ0.000
min1637.000-1631.000=6.000
max1637.000-1631.000=6.000
mean0.442-0.406=0.035
σ0.161-0.114=0.047
min0.322-0.347=-0.025
max0.721-0.610=0.111
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1637.000-1631.000=6.000
σ0.000
min1637.000-1631.000=6.000
max1637.000-1631.000=6.000
mean0.921-0.889=0.032
σ0.173-0.096=0.077
min0.826-0.828=-0.003
max1.229-1.056=0.173
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1637.000-1631.000=6.000
σ0.000
min1637.000-1631.000=6.000
max1637.000-1631.000=6.000
mean0.536-0.550=-0.014
σ0.051-0.054=-0.003
min0.496-0.502=-0.006
max0.625-0.643=-0.018
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1637.000-1631.000=6.000
σ0.000
min1637.000-1631.000=6.000
max1637.000-1631.000=6.000
mean0.834-0.850=-0.016
σ0.041-0.037=0.004
min0.808-0.818=-0.011
max0.903-0.911=-0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.115=-0.002
σ0.033-0.034=-0.001
min964.085-964.086=-0.001
max964.169-964.172=-0.003
mean1637.000-1631.000=6.000
σ0.000
min1637.000-1631.000=6.000
max1637.000-1631.000=6.000
mean0.813-0.809=0.005
σ0.021-0.066=-0.045
min0.793-0.736=0.058
max0.843-0.860=-0.017
name=cdr_enhanced_4k_loc.art
mean884.712-884.711=0.000
σ0.008-0.007=0.001
min884.703-884.705=-0.001
max884.722-884.722=0.000
mean1637.000-1631.000=6.000
σ0.000
min1637.000-1631.000=6.000
max1637.000-1631.000=6.000
mean0.690-0.706=-0.016
σ0.029-0.044=-0.015
min0.663-0.648=0.015
max0.732-0.741=-0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718
mean1637.000-1631.000=6.000
σ0.000
min1637.000-1631.000=6.000
max1637.000-1631.000=6.000
mean4.275-4.216=0.059
σ0.086-0.068=0.017
min4.127-4.105=0.022
max4.805-4.452=0.352
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.668-7.670=-0.002
mean1637.000-1631.000=6.000
σ0.000
min1637.000-1631.000=6.000
max1637.000-1631.000=6.000
mean4.266-4.204=0.062
σ0.073-0.064=0.009
min4.127-4.051=0.076
max4.510-4.375=0.135
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1637.000-1631.000=6.000
σ0.000
min1637.000-1631.000=6.000
max1637.000-1631.000=6.000
mean0.617-0.677=-0.060
σ0.110-0.098=0.012
min0.507-0.514=-0.008
max0.913-0.864=0.049
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1637.000-1631.000=6.000
σ0.000
min1637.000-1631.000=6.000
max1637.000-1631.000=6.000
mean0.504-0.501=0.002
σ0.012-0.012=-0.000
min0.483-0.476=0.007
max0.565-0.563=0.002

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.248-296.464=-0.216
σ0.202-0.220=-0.018
min296.079-296.324=-0.245
max296.792-297.048=-0.256
mean1915.000-1916.000=-1.000
σ0.000
min1915.000-1916.000=-1.000
max1915.000-1916.000=-1.000
mean0.571-0.576=-0.005
σ0.058-0.039=0.019
min0.504-0.517=-0.013
max0.699-0.659=0.040

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.700-284.697=0.003
σ0.034-0.035=-0.001
min284.656-284.652=0.004
max284.736-284.738=-0.002
mean1637.000-1631.000=6.000
σ0.000
min1637.000-1631.000=6.000
max1637.000-1631.000=6.000
mean0.399-0.398=0.001
σ0.008-0.010=-0.002
min0.387-0.385=0.002
max0.406-0.407=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.078-1295.081=-0.003
σ0.115-0.110=0.005
min1294.962-1294.961=0.001
max1295.218-1295.211=0.007
mean1637.000-1631.000=6.000
σ0.000
min1637.000-1631.000=6.000
max1637.000-1631.000=6.000
mean1.899-1.931=-0.032
σ0.086-0.096=-0.010
min1.807-1.829=-0.022
max1.990-2.023=-0.033
iters=5
new-facts=6402
prior-facts=1
mean1539.185-1539.191=-0.006
σ6.855-6.855=0.000
min1535.960-1535.925=0.035
max1551.445-1551.450=-0.005
mean1637.000-1631.000=6.000
σ0.000
min1637.000-1631.000=6.000
max1637.000-1631.000=6.000
mean2.201-2.260=-0.059
σ0.205-0.268=-0.063
min2.026-2.028=-0.002
max2.456-2.658=-0.203
iters=5
new-facts=6402
prior-facts=6402
mean1856.980-1856.987=-0.006
σ0.066-0.053=0.013
min1856.897-1856.930=-0.033
max1857.068-1857.061=0.007
mean1773.200-1771.400=1.800
σ137.252-140.030=-2.777
min1637.000-1631.000=6.000
max1915.000-1916.000=-1.000
mean3.029-3.101=-0.072
σ0.218-0.316=-0.098
min2.778-2.883=-0.105
max3.373-3.657=-0.284

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.197-1.213=-0.016
σ0.295-0.273=0.022
min0.938-0.954=-0.016
max1.684-1.652=0.032

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.783-447.786=-0.002
σ581.212-581.213=-0.001
min157.173-157.176=-0.003
max1319.601-1319.605=-0.003
mean96.250
σ8.500
min92.000
max109.000
mean1637.000-1631.000=6.000
σ0.000
min1637.000-1631.000=6.000
max1637.000-1631.000=6.000
mean0.561-0.532=0.029
σ0.592-0.538=0.054
min0.263-0.261=0.002
max1.448-1.339=0.110
policies=20
mean1572.085-1572.102=-0.016
σ0.351-0.353=-0.002
min1571.846-1571.868=-0.022
max1572.607-1572.626=-0.020
mean920.000
σ0.000
min920.000
max920.000
mean1637.000-1631.000=6.000
σ0.000
min1637.000-1631.000=6.000
max1637.000-1631.000=6.000
mean2.622-2.629=-0.007
σ0.011-0.018=-0.008
min2.611-2.607=0.004
max2.635-2.645=-0.010
policies=200
mean15729.010-15729.078=-0.067
σ0.142-0.107=0.035
min15728.887-15728.998=-0.111
max15729.174-15729.233=-0.059
mean9200.000
σ0.000
min9200.000
max9200.000
mean1637.000-1631.000=6.000
σ0.000
min1637.000-1631.000=6.000
max1637.000-1631.000=6.000
mean26.458-26.545=-0.087
σ0.106-0.033=0.073
min26.377-26.513=-0.136
max26.607-26.581=0.026