Compare commits

Home / Compare ec20e036 .. c6eb5318

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.014=0.001
σ0.371-0.370=0.001
min53.872-53.871=0.002
max55.069-55.066=0.003
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.137-0.137=-0.000
σ0.004-0.006=-0.001
min0.131-0.129=0.002
max0.143-0.144=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=0.001
σ0.007-0.008=-0.001
min43.310-43.309=0.001
max43.336-43.334=0.002
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.120-0.118=0.002
σ0.005-0.010=-0.005
min0.115-0.093=0.022
max0.128-0.128=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.308-1006.305=0.003
σ1.166-1.178=-0.012
min1005.767-1005.772=-0.005
max1011.189-1011.228=-0.039
mean1042.550-1057.250=-14.700
σ312.125-316.171=-4.046
min594.000-569.000=25.000
max1632.000-1621.000=11.000
mean1.568-1.555=0.012
σ0.092-0.082=0.010
min1.483-1.464=0.018
max1.800-1.784=0.016

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1632.000-1621.000=11.000
σ0.000
min1632.000-1621.000=11.000
max1632.000-1621.000=11.000
mean0.399-0.399=0.001
σ0.129-0.132=-0.003
min0.319-0.309=0.010
max0.628-0.630=-0.003
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1632.000-1621.000=11.000
σ0.000
min1632.000-1621.000=11.000
max1632.000-1621.000=11.000
mean0.865-0.868=-0.003
σ0.094-0.091=0.004
min0.804-0.815=-0.010
max1.030-1.029=0.002
name=heavy_item.art
mean1.524-1.523=0.000
σ0.002-0.002=0.000
min1.522
max1.526
mean1632.000-1621.000=11.000
σ0.000
min1632.000-1621.000=11.000
max1632.000-1621.000=11.000
mean0.535-0.540=-0.005
σ0.044-0.050=-0.006
min0.503-0.498=0.005
max0.611-0.626=-0.014
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1632.000-1621.000=11.000
σ0.000
min1632.000-1621.000=11.000
max1632.000-1621.000=11.000
mean0.820-0.842=-0.021
σ0.038-0.031=0.007
min0.784-0.816=-0.033
max0.877-0.892=-0.015

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.115=-0.000
σ0.034-0.035=-0.001
min964.086-964.085=0.001
max964.170-964.171=-0.001
mean1632.000-1621.000=11.000
σ0.000
min1632.000-1621.000=11.000
max1632.000-1621.000=11.000
mean0.819-0.828=-0.010
σ0.050-0.051=-0.001
min0.763-0.745=0.017
max0.859-0.868=-0.008
name=cdr_enhanced_4k_loc.art
mean884.711-884.711=-0.000
σ0.007-0.007=-0.000
min884.705-884.703=0.001
max884.720-884.721=-0.000
mean1632.000-1621.000=11.000
σ0.000
min1632.000-1621.000=11.000
max1632.000-1621.000=11.000
mean0.712-0.633=0.079
σ0.023-0.073=-0.050
min0.688-0.535=0.153
max0.740-0.697=0.043

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.714=0.000
σ0.002-0.002=0.000
min7.714
max7.718
mean1632.000-1621.000=11.000
σ0.000
min1632.000-1621.000=11.000
max1632.000-1621.000=11.000
mean4.227-3.516=0.712
σ0.085-0.094=-0.009
min4.066-3.359=0.707
max4.586-3.861=0.725
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666-7.667=-0.001
mean1632.000-1621.000=11.000
σ0.000
min1632.000-1621.000=11.000
max1632.000-1621.000=11.000
mean4.235-3.476=0.759
σ0.100-0.075=0.026
min4.084-3.343=0.741
max4.555-3.798=0.757
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1632.000-1621.000=11.000
σ0.000
min1632.000-1621.000=11.000
max1632.000-1621.000=11.000
mean0.731-0.528=0.203
σ0.018-0.013=0.004
min0.692-0.504=0.188
max0.845-0.609=0.236
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1632.000-1621.000=11.000
σ0.000
min1632.000-1621.000=11.000
max1632.000-1621.000=11.000
mean0.689-0.503=0.186
σ0.022-0.011=0.011
min0.570-0.479=0.090
max0.743-0.552=0.192

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.266-296.210=0.056
σ0.234-0.251=-0.017
min296.072-295.981=0.091
max296.913-296.878=0.035
mean1901.000-1908.000=-7.000
σ0.000
min1901.000-1908.000=-7.000
max1901.000-1908.000=-7.000
mean0.570-0.569=0.001
σ0.052-0.055=-0.002
min0.501-0.510=-0.008
max0.702-0.659=0.043

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.695-284.692=0.003
σ0.039-0.037=0.002
min284.643-284.645=-0.002
max284.742-284.734=0.009
mean1632.000-1621.000=11.000
σ0.000
min1632.000-1621.000=11.000
max1632.000-1621.000=11.000
mean0.401-0.397=0.004
σ0.013-0.014=-0.001
min0.387-0.382=0.006
max0.416-0.412=0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.084-1295.081=0.003
σ0.115-0.108=0.006
min1294.962-1294.961=0.002
max1295.224-1295.212=0.012
mean1632.000-1621.000=11.000
σ0.000
min1632.000-1621.000=11.000
max1632.000-1621.000=11.000
mean1.882-1.903=-0.021
σ0.084-0.091=-0.007
min1.785-1.805=-0.020
max1.986-1.995=-0.010
iters=5
new-facts=6402
prior-facts=1
mean1539.191-1539.184=0.007
σ6.845-6.840=0.005
min1535.945-1535.940=0.006
max1551.431-1551.416=0.015
mean1632.000-1621.000=11.000
σ0.000
min1632.000-1621.000=11.000
max1632.000-1621.000=11.000
mean2.335-2.229=0.106
σ0.133-0.189=-0.057
min2.175-2.046=0.129
max2.479-2.506=-0.027
iters=5
new-facts=6402
prior-facts=6402
mean1856.985-1856.980=0.006
σ0.059-0.061=-0.002
min1856.929-1856.898=0.031
max1857.071-1857.062=0.008
mean1767.200-1771.400=-4.200
σ131.454-135.786=-4.332
min1632.000-1621.000=11.000
max1901.000-1908.000=-7.000
mean2.992-3.030=-0.037
σ0.242-0.274=-0.032
min2.683-2.849=-0.166
max3.355-3.513=-0.157

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.198-1.243=-0.045
σ0.368-0.346=0.022
min0.934-0.939=-0.006
max1.824-1.834=-0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.784-447.785=-0.001
σ581.213-581.213=-0.000
min157.174-157.177=-0.003
max1319.602-1319.604=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1632.000-1621.000=11.000
σ0.000
min1632.000-1621.000=11.000
max1632.000-1621.000=11.000
mean0.514-0.559=-0.045
σ0.505-0.593=-0.088
min0.261-0.260=0.002
max1.271-1.448=-0.176
policies=20
mean1572.087-1572.088=-0.001
σ0.351-0.362=-0.012
min1571.848-1571.845=0.002
max1572.609-1572.627=-0.018
mean920.000
σ0.000
min920.000
max920.000
mean1632.000-1621.000=11.000
σ0.000
min1632.000-1621.000=11.000
max1632.000-1621.000=11.000
mean2.618-2.635=-0.017
σ0.011-0.048=-0.037
min2.608-2.600=0.008
max2.630-2.706=-0.076
policies=200
mean15729.008-15729.066=-0.058
σ0.108-0.126=-0.018
min15728.852-15728.956=-0.104
max15729.095-15729.245=-0.150
mean9200.000
σ0.000
min9200.000
max9200.000
mean1632.000-1621.000=11.000
σ0.000
min1632.000-1621.000=11.000
max1632.000-1621.000=11.000
mean26.499-26.538=-0.039
σ0.035-0.058=-0.023
min26.454-26.468=-0.014
max26.537-26.595=-0.058