Compare commits

Home / Compare d42803d2 .. 28ec592b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.015=-0.000
σ0.371-0.371=-0.000
min53.868-53.872=-0.004
max55.069-55.070=-0.001
mean415.700-415.000=0.700
σ0.483-0.000=0.483
min415.000
max416.000-415.000=1.000
mean0.137-0.138=-0.000
σ0.006-0.004=0.001
min0.129-0.131=-0.002
max0.148-0.145=0.003
cache=y
dps=1
iters=10
policies=100
mean43.322-43.324=-0.002
σ0.005-0.007=-0.002
min43.315-43.309=0.005
max43.330-43.333=-0.003
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.122-0.123=-0.001
σ0.004-0.010=-0.006
min0.118-0.114=0.004
max0.129-0.141=-0.013

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.312-1006.308=0.004
σ1.164-1.185=-0.021
min1005.744-1005.768=-0.024
max1011.181-1011.269=-0.088
mean1049.350-1045.000=4.350
σ303.784-311.721=-7.936
min597.000
max1640.000-1634.000=6.000
mean1.556-1.549=0.006
σ0.091-0.086=0.005
min1.454-1.469=-0.015
max1.837-1.762=0.075

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.414-0.429=-0.015
σ0.166-0.150=0.016
min0.311-0.329=-0.018
max0.706-0.688=0.018
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.924-0.910=0.014
σ0.164-0.166=-0.001
min0.831-0.822=0.010
max1.217-1.204=0.013
name=heavy_item.art
mean1.523-1.523=0.000
σ0.002-0.002=-0.000
min1.522
max1.526
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.534-0.544=-0.011
σ0.049-0.060=-0.012
min0.489-0.496=-0.007
max0.613-0.648=-0.035
name=nested_use.art
mean2.361-2.360=0.001
σ0.003-0.002=0.001
min2.359
max2.365-2.363=0.002
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.844-0.844=0.000
σ0.033-0.039=-0.006
min0.816-0.815=0.001
max0.897-0.909=-0.013

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.112-964.111=0.001
σ0.022-0.023=-0.001
min964.090-964.090=-0.000
max964.145-964.146=-0.001
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.810-0.817=-0.007
σ0.043-0.041=0.002
min0.739-0.750=-0.011
max0.850-0.859=-0.010
name=cdr_enhanced_4k_loc.art
mean884.713-884.714=-0.001
σ0.001-0.002=-0.001
min884.712-884.712=-0.000
max884.714-884.717=-0.003
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.708-0.725=-0.017
σ0.036-0.029=0.007
min0.666-0.680=-0.014
max0.739-0.745=-0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715
σ0.002
min7.714
max7.719
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean4.277-4.301=-0.024
σ0.090-0.096=-0.006
min4.134-4.160=-0.026
max4.695-4.937=-0.241
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=-0.000
min7.662
max7.666-7.669=-0.003
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean4.246-4.280=-0.035
σ0.071-0.119=-0.047
min4.133-3.586=0.547
max4.539-4.531=0.008
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.732-0.735=-0.003
σ0.017-0.017=0.000
min0.705-0.705=-0.000
max0.834-0.840=-0.006
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.691-0.699=-0.008
σ0.017-0.014=0.003
min0.649-0.669=-0.020
max0.780-0.781=-0.001

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.193-296.382=-0.189
σ0.190-0.224=-0.034
min296.010-296.228=-0.218
max296.705-297.006=-0.301
mean1906.000-1902.000=4.000
σ0.000
min1906.000-1902.000=4.000
max1906.000-1902.000=4.000
mean0.594-0.576=0.018
σ0.035-0.044=-0.009
min0.550-0.513=0.037
max0.680-0.657=0.023

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.693-284.696=-0.003
σ0.038-0.040=-0.002
min284.642-284.644=-0.002
max284.736-284.742=-0.006
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.395-0.407=-0.011
σ0.011-0.003=0.008
min0.383-0.404=-0.021
max0.407-0.411=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.074-1295.079=-0.005
σ0.109-0.111=-0.002
min1294.963-1294.958=0.004
max1295.207-1295.220=-0.013
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean1.915-1.918=-0.003
σ0.100-0.108=-0.008
min1.798-1.799=-0.001
max2.020-2.015=0.005
iters=5
new-facts=6402
prior-facts=1
mean1539.186-1539.190=-0.003
σ6.840-6.859=-0.019
min1535.924-1535.926=-0.002
max1551.419-1551.456=-0.037
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean2.240-2.257=-0.017
σ0.263-0.275=-0.013
min2.040-2.034=0.005
max2.666-2.686=-0.019
iters=5
new-facts=6402
prior-facts=6402
mean1856.980-1856.984=-0.003
σ0.063-0.056=0.007
min1856.907-1856.928=-0.021
max1857.069-1857.065=0.005
mean1773.200-1771.000=2.200
σ130.433-130.832=-0.399
min1640.000-1634.000=6.000
max1906.000-1902.000=4.000
mean3.061-3.051=0.009
σ0.289-0.244=0.044
min2.851-2.866=-0.015
max3.566-3.469=0.097

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.137-1.123=0.015
σ0.254-0.214=0.040
min0.936-0.936=-0.001
max1.526-1.421=0.105

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.787=-0.002
σ581.212-581.212=-0.000
min157.177-157.179=-0.001
max1319.603-1319.605=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean0.535-0.547=-0.012
σ0.549-0.571=-0.022
min0.258-0.259=-0.001
max1.359-1.404=-0.045
policies=20
mean1572.103-1572.103=-0.000
σ0.355-0.354=0.001
min1571.867-1571.863=0.004
max1572.631-1572.629=0.002
mean920.000
σ0.000
min920.000
max920.000
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean2.629-2.630=-0.002
σ0.024-0.009=0.015
min2.607-2.624=-0.017
max2.655-2.644=0.011
policies=200
mean15728.972-15729.098=-0.126
σ0.076-0.109=-0.032
min15728.902-15729.028=-0.126
max15729.050-15729.259=-0.209
mean9200.000
σ0.000
min9200.000
max9200.000
mean1640.000-1634.000=6.000
σ0.000
min1640.000-1634.000=6.000
max1640.000-1634.000=6.000
mean26.535-26.472=0.063
σ0.082-0.016=0.066
min26.470-26.448=0.022
max26.654-26.481=0.173