Compare commits

Home / Compare ba5cf57a .. 873d014a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.053-54.056=-0.003
σ0.371-0.370=0.001
min53.906-53.911=-0.005
max55.109-55.109=0.000
mean415.000-420.000=-5.000
σ0.000
min415.000-420.000=-5.000
max415.000-420.000=-5.000
mean0.140-0.140=-0.000
σ0.005-0.004=0.001
min0.134-0.132=0.002
max0.147-0.147=0.000
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.001
σ0.007-0.006=0.001
min43.384-43.384=-0.000
max43.407-43.402=0.005
mean415.000-420.000=-5.000
σ0.000
min415.000-420.000=-5.000
max415.000-420.000=-5.000
mean0.123-0.122=0.001
σ0.004-0.004=0.000
min0.120-0.119=0.001
max0.131-0.129=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1007.003=0.002
σ1.190-1.195=-0.005
min1006.432-1006.442=-0.010
max1011.991-1012.011=-0.020
mean1050.500-1055.950=-5.450
σ307.820-305.307=2.513
min576.000-582.000=-6.000
max1644.000-1649.000=-5.000
mean1.533-1.551=-0.017
σ0.077-0.084=-0.007
min1.454-1.466=-0.012
max1.761-1.766=-0.005

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean0.425-0.428=-0.003
σ0.146-0.147=-0.001
min0.339-0.341=-0.002
max0.684-0.689=-0.005
name=error_case.art
mean2.339-2.339=0.001
σ0.003-0.003=0.001
min2.337
max2.343-2.342=0.001
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean0.894-0.931=-0.036
σ0.096-0.184=-0.088
min0.833-0.824=0.009
max1.063-1.256=-0.193
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean0.534-0.536=-0.002
σ0.059-0.050=0.009
min0.491-0.493=-0.002
max0.637-0.623=0.015
name=nested_use.art
mean2.361-2.361=-0.001
σ0.002-0.002=-0.000
min2.360
max2.364
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean0.856-0.857=-0.001
σ0.037-0.039=-0.002
min0.832-0.827=0.005
max0.921-0.922=-0.001

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.838=-0.000
σ0.032-0.034=-0.003
min964.812-964.809=0.002
max964.890-964.894=-0.004
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean0.800-0.845=-0.045
σ0.041-0.011=0.030
min0.754-0.827=-0.073
max0.852-0.854=-0.003
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.008-0.007=0.001
min885.504-885.505=-0.001
max885.523-885.522=0.002
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean0.659-0.707=-0.048
σ0.049-0.041=0.007
min0.614-0.638=-0.024
max0.737-0.741=-0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.720=-0.001
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean3.494-3.533=-0.039
σ0.092-0.111=-0.018
min3.319-3.268=0.052
max4.069-4.171=-0.102
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean4.070-3.505=0.565
σ0.283-0.088=0.195
min3.421-3.368=0.053
max4.490-3.878=0.612
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean0.749-0.540=0.209
σ0.042-0.014=0.028
min0.535-0.520=0.015
max0.856-0.625=0.232
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean0.703-0.509=0.194
σ0.034-0.011=0.023
min0.524-0.490=0.034
max0.787-0.552=0.234

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.020-296.923=0.097
σ0.196-0.235=-0.039
min296.865-296.760=0.105
max297.541-297.575=-0.034
mean1990.000-1938.000=52.000
σ0.000
min1990.000-1938.000=52.000
max1990.000-1938.000=52.000
mean0.557-0.591=-0.035
σ0.039-0.017=0.022
min0.498-0.556=-0.058
max0.592-0.613=-0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.821-286.825=-0.003
σ0.036-0.041=-0.005
min286.773-286.770=0.004
max286.865-286.870=-0.005
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean0.396-0.396=0.000
σ0.006-0.008=-0.001
min0.389-0.386=0.003
max0.402-0.404=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1297.268-1297.233=0.035
σ0.089-0.058=0.031
min1297.167-1297.173=-0.006
max1297.394-1297.298=0.096
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean2.036-2.070=-0.035
σ0.064-0.066=-0.002
min1.958-1.998=-0.040
max2.109-2.137=-0.028
iters=5
new-facts=6402
prior-facts=1
mean1541.321-1541.351=-0.030
σ6.857-6.814=0.043
min1538.060-1538.165=-0.105
max1553.582-1553.537=0.044
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean2.266-2.319=-0.053
σ0.178-0.265=-0.087
min2.174-2.142=0.031
max2.584-2.761=-0.177
iters=5
new-facts=6402
prior-facts=6402
mean1859.105-1859.117=-0.011
σ0.080-0.085=-0.006
min1858.980-1858.999=-0.018
max1859.183-1859.210=-0.027
mean1755.800-1788.000=-32.200
σ152.634-145.022=7.612
min1644.000-1649.000=-5.000
max1990.000-1938.000=52.000
mean3.015-2.938=0.077
σ0.282-0.101=0.181
min2.823-2.796=0.027
max3.492-3.058=0.434

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.197-1.191=0.005
σ0.286-0.293=-0.007
min0.936-0.934=0.002
max1.661-1.648=0.013

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.820=0.000
σ581.372-581.372=0.000
min158.133-158.132=0.001
max1320.878-1320.878=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean0.558-0.549=0.008
σ0.585-0.605=-0.020
min0.260-0.225=0.034
max1.434-1.456=-0.021
policies=20
mean1581.614-1581.611=0.003
σ0.357-0.355=0.001
min1581.376-1581.370=0.006
max1582.145-1582.140=0.005
mean920.000
σ0.000
min920.000
max920.000
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean2.629-2.632=-0.003
σ0.016-0.013=0.004
min2.610-2.623=-0.013
max2.649-2.650=-0.001
policies=200
mean15824.181-15824.248=-0.067
σ0.106-0.119=-0.013
min15824.024-15824.132=-0.108
max15824.254-15824.401=-0.147
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000-1649.000=-5.000
σ0.000
min1644.000-1649.000=-5.000
max1644.000-1649.000=-5.000
mean26.573-26.537=0.036
σ0.068-0.113=-0.045
min26.509-26.372=0.137
max26.638-26.627=0.011