Compare commits

Home / Compare c137ac9e .. f2c45a17

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.056=0.000
σ0.369-0.368=0.001
min53.910-53.912=-0.002
max55.105-55.101=0.004
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.140-0.137=0.003
σ0.005-0.006=-0.001
min0.135-0.129=0.006
max0.149-0.146=0.003
cache=y
dps=1
iters=10
policies=100
mean43.394-43.395=-0.002
σ0.007-0.006=0.001
min43.384-43.387=-0.003
max43.406-43.406=0.000
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.121-0.120=0.001
σ0.005-0.004=0.000
min0.114-0.114=0.000
max0.128-0.126=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.963-1006.963=0.000
σ0.867-0.927=-0.060
min1006.466-1006.497=-0.031
max1010.547-1010.813=-0.266
mean1039.450-1051.500=-12.050
σ301.261-309.832=-8.572
min549.000-556.000=-7.000
max1586.000-1644.000=-58.000
mean1.548-1.585=-0.038
σ0.068-0.144=-0.075
min1.490-1.487=0.003
max1.773-2.048=-0.276

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.000
σ0.003-0.003=0.001
min0.882
max0.889-0.887=0.002
mean1586.000-1644.000=-58.000
σ0.000
min1586.000-1644.000=-58.000
max1586.000-1644.000=-58.000
mean0.421-0.423=-0.002
σ0.147-0.148=-0.001
min0.325-0.342=-0.016
max0.679-0.685=-0.006
name=error_case.art
mean2.339-2.339=0.001
σ0.003-0.003=0.001
min2.337
max2.344-2.342=0.002
mean1586.000-1644.000=-58.000
σ0.000
min1586.000-1644.000=-58.000
max1586.000-1644.000=-58.000
mean0.908-0.901=0.006
σ0.095-0.117=-0.022
min0.847-0.834=0.012
max1.074-1.110=-0.037
name=heavy_item.art
mean1.524-1.524=0.000
σ0.002-0.002=0.000
min1.522
max1.527-1.526=0.000
mean1586.000-1644.000=-58.000
σ0.000
min1586.000-1644.000=-58.000
max1586.000-1644.000=-58.000
mean0.545-0.571=-0.026
σ0.050-0.060=-0.010
min0.510-0.517=-0.007
max0.630-0.643=-0.013
name=nested_use.art
mean2.361-2.361=0.000
σ0.002-0.002=0.001
min2.360
max2.366-2.364=0.002
mean1586.000-1644.000=-58.000
σ0.000
min1586.000-1644.000=-58.000
max1586.000-1644.000=-58.000
mean0.849-0.853=-0.005
σ0.046-0.052=-0.006
min0.804-0.817=-0.013
max0.922-0.935=-0.013

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.832-964.840=-0.008
σ0.028-0.035=-0.007
min964.802-964.812=-0.010
max964.870-964.897=-0.027
mean1586.000-1644.000=-58.000
σ0.000
min1586.000-1644.000=-58.000
max1586.000-1644.000=-58.000
mean0.843-0.817=0.026
σ0.029-0.057=-0.028
min0.794-0.727=0.067
max0.869-0.860=0.009
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.007-0.007=0.000
min885.504-885.505=-0.001
max885.521-885.522=-0.001
mean1586.000-1644.000=-58.000
σ0.000
min1586.000-1644.000=-58.000
max1586.000-1644.000=-58.000
mean0.673-0.726=-0.053
σ0.053-0.031=0.022
min0.619-0.670=-0.052
max0.738-0.744=-0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.719=0.003
mean1586.000-1644.000=-58.000
σ0.000
min1586.000-1644.000=-58.000
max1586.000-1644.000=-58.000
mean4.277-4.228=0.049
σ0.095-0.079=0.016
min4.124-4.101=0.023
max4.551-4.682=-0.131
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1586.000-1644.000=-58.000
σ0.000
min1586.000-1644.000=-58.000
max1586.000-1644.000=-58.000
mean4.237-4.275=-0.038
σ0.071-0.092=-0.022
min4.122-4.107=0.015
max4.506-4.617=-0.111
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1586.000-1644.000=-58.000
σ0.000
min1586.000-1644.000=-58.000
max1586.000-1644.000=-58.000
mean0.743-0.766=-0.023
σ0.019-0.036=-0.017
min0.700-0.619=0.080
max0.852-0.909=-0.057
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1586.000-1644.000=-58.000
σ0.000
min1586.000-1644.000=-58.000
max1586.000-1644.000=-58.000
mean0.706-0.695=0.011
σ0.015-0.017=-0.002
min0.673-0.670=0.003
max0.788-0.797=-0.008

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.669-295.806=-0.137
σ0.212-0.224=-0.012
min295.528-295.586=-0.058
max296.249-296.361=-0.112
mean1907.000-1904.000=3.000
σ0.000
min1907.000-1904.000=3.000
max1907.000-1904.000=3.000
mean0.582-0.586=-0.003
σ0.049-0.041=0.007
min0.517-0.526=-0.009
max0.656-0.687=-0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.399-285.400=-0.000
σ0.039-0.037=0.002
min285.347-285.351=-0.003
max285.441-285.439=0.003
mean1586.000-1644.000=-58.000
σ0.000
min1586.000-1644.000=-58.000
max1586.000-1644.000=-58.000
mean0.390-0.390=-0.001
σ0.009-0.008=0.001
min0.381-0.382=-0.001
max0.402-0.401=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.774-1295.774=-0.000
σ0.112-0.109=0.003
min1295.661-1295.663=-0.002
max1295.914-1295.904=0.010
mean1586.000-1644.000=-58.000
σ0.000
min1586.000-1644.000=-58.000
max1586.000-1644.000=-58.000
mean1.914-1.911=0.003
σ0.098-0.103=-0.005
min1.810-1.809=0.000
max2.039-2.045=-0.006
iters=5
new-facts=6402
prior-facts=1
mean1539.951-1539.905=0.045
σ6.838-6.888=-0.050
min1536.690-1536.609=0.081
max1552.178-1552.222=-0.045
mean1586.000-1644.000=-58.000
σ0.000
min1586.000-1644.000=-58.000
max1586.000-1644.000=-58.000
mean2.378-2.273=0.105
σ0.282-0.215=0.066
min2.024-2.048=-0.023
max2.751-2.495=0.256
iters=5
new-facts=6402
prior-facts=6402
mean1857.682-1857.684=-0.002
σ0.066-0.068=-0.002
min1857.605-1857.603=0.002
max1857.775-1857.777=-0.003
mean1763.600-1773.800=-10.200
σ143.930-125.917=18.012
min1586.000-1644.000=-58.000
max1907.000-1904.000=3.000
mean3.083-3.064=0.020
σ0.298-0.255=0.044
min2.868-2.819=0.049
max3.606-3.489=0.117

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.347-1.222=0.125
σ0.352-0.365=-0.012
min0.942-0.935=0.007
max1.737-1.793=-0.055

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.707-445.704=0.003
σ580.934-580.934=-0.000
min155.239-155.232=0.006
max1317.108-1317.105=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1586.000-1644.000=-58.000
σ0.000
min1586.000-1644.000=-58.000
max1586.000-1644.000=-58.000
mean0.537-0.538=-0.001
σ0.550-0.547=0.003
min0.255-0.263=-0.007
max1.362-1.359=0.003
policies=20
mean1552.656-1552.642=0.014
σ0.333-0.344=-0.011
min1552.423-1552.401=0.022
max1553.150-1553.152=-0.002
mean920.000
σ0.000
min920.000
max920.000
mean1586.000-1644.000=-58.000
σ0.000
min1586.000-1644.000=-58.000
max1586.000-1644.000=-58.000
mean2.593-2.600=-0.007
σ0.024-0.017=0.007
min2.572-2.583=-0.011
max2.626-2.622=0.004
policies=200
mean15534.642-15534.581=0.061
σ0.059-0.109=-0.049
min15534.582-15534.510=0.072
max15534.716-15534.743=-0.026
mean9200.000
σ0.000
min9200.000
max9200.000
mean1586.000-1644.000=-58.000
σ0.000
min1586.000-1644.000=-58.000
max1586.000-1644.000=-58.000
mean26.075-26.110=-0.035
σ0.033-0.052=-0.018
min26.041-26.058=-0.017
max26.113-26.176=-0.063