Compare commits

Home / Compare f4fc89e2 .. 762ffecf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.042-54.041=0.001
σ0.366-0.369=-0.003
min53.898-53.901=-0.003
max55.084-55.091=-0.007
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.138-0.140=-0.002
σ0.005-0.004=0.001
min0.131-0.137=-0.006
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.393-43.395=-0.002
σ0.006-0.007=-0.001
min43.384-43.384=-0.000
max43.400-43.407=-0.007
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.120-0.123=-0.003
σ0.004-0.004=0.001
min0.114-0.118=-0.004
max0.126-0.130=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.331-1006.331=0.000
σ0.890-0.888=0.002
min1005.833-1005.855=-0.022
max1010.019-1010.013=0.007
mean1046.600-1048.850=-2.250
σ307.672-310.793=-3.121
min571.000-552.000=19.000
max1647.000
mean1.555-1.550=0.005
σ0.077-0.090=-0.013
min1.470-1.462=0.009
max1.773-1.778=-0.005

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.003=-0.001
min0.881
max0.886-0.887=-0.002
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.421-0.419=0.001
σ0.136-0.140=-0.004
min0.345-0.332=0.014
max0.661-0.666=-0.005
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.883-0.892=-0.009
σ0.096-0.093=0.003
min0.811-0.821=-0.010
max1.048-1.052=-0.004
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.545-0.555=-0.009
σ0.056-0.077=-0.021
min0.495-0.506=-0.011
max0.638-0.689=-0.051
name=nested_use.art
mean2.355
σ0.002
min2.355
max2.358
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.851-0.848=0.003
σ0.045-0.040=0.005
min0.810-0.815=-0.006
max0.929-0.915=0.013

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.557-963.559=-0.002
σ0.031-0.035=-0.004
min963.532-963.531=0.001
max963.609-963.615=-0.006
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.808-0.803=0.005
σ0.062-0.049=0.014
min0.705-0.733=-0.028
max0.872-0.854=0.018
name=cdr_enhanced_4k_loc.art
mean884.856-884.856=0.000
σ0.006-0.006=-0.000
min884.847-884.848=-0.001
max884.861-884.863=-0.003
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.721-0.697=0.024
σ0.020-0.041=-0.021
min0.703-0.652=0.050
max0.753-0.744=0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=-0.000
min7.705
max7.709
mean1647.000
σ0.000
min1647.000
max1647.000
mean4.280-4.233=0.048
σ0.110-0.091=0.019
min4.117-4.051=0.066
max4.626-4.572=0.055
name=record_render_large_syntax_err.art
mean7.655-7.655=-0.000
σ0.002-0.002=-0.000
min7.654
max7.658-7.659=-0.001
mean1647.000
σ0.000
min1647.000
max1647.000
mean4.257-4.270=-0.013
σ0.078-0.079=-0.001
min4.107-4.102=0.005
max4.597-4.720=-0.123
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.752-0.741=0.011
σ0.016-0.018=-0.001
min0.727-0.711=0.017
max0.866-0.857=0.009
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.718-0.703=0.014
σ0.017-0.015=0.003
min0.678-0.672=0.006
max0.796-0.773=0.022

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.697-295.563=0.135
σ0.197-0.264=-0.068
min295.420-295.363=0.057
max296.168-296.272=-0.104
mean1893.000-1922.000=-29.000
σ0.000
min1893.000-1922.000=-29.000
max1893.000-1922.000=-29.000
mean0.591-0.563=0.027
σ0.052-0.049=0.003
min0.499-0.498=0.001
max0.702-0.630=0.073

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.251-285.250=0.001
σ0.037-0.037=-0.001
min285.209-285.198=0.011
max285.293-285.291=0.002
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.396-0.397=-0.001
σ0.012-0.015=-0.003
min0.386-0.379=0.007
max0.412-0.415=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1295.198-1295.199=-0.001
σ0.110-0.108=0.002
min1295.079-1295.083=-0.004
max1295.330-1295.333=-0.003
mean1647.000
σ0.000
min1647.000
max1647.000
mean1.920-1.919=0.002
σ0.108-0.098=0.011
min1.803-1.808=-0.006
max2.024-2.009=0.015
iters=5
new-facts=6402
prior-facts=1
mean1539.364-1539.355=0.010
σ6.883-6.867=0.016
min1536.081-1536.028=0.052
max1551.672-1551.634=0.039
mean1647.000
σ0.000
min1647.000
max1647.000
mean2.262-2.281=-0.019
σ0.135-0.243=-0.109
min2.108-2.052=0.056
max2.442-2.642=-0.199
iters=5
new-facts=6402
prior-facts=6402
mean1857.107-1857.111=-0.004
σ0.055-0.054=0.001
min1857.051-1857.053=-0.002
max1857.179-1857.182=-0.003
mean1765.400-1784.600=-19.200
σ121.593-137.500=-15.907
min1647.000
max1893.000-1922.000=-29.000
mean3.063-3.064=-0.001
σ0.234-0.252=-0.018
min2.846-2.856=-0.010
max3.447-3.490=-0.042

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.318-1.306=0.012
σ0.291-0.275=0.016
min1.111-1.104=0.008
max1.818-1.777=0.041

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.291-445.290=0.001
σ580.424-580.424=-0.000
min155.077-155.075=0.002
max1315.926-1315.926=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.542-0.535=0.007
σ0.556-0.553=0.003
min0.263-0.256=0.006
max1.375-1.363=0.012
policies=20
mean1551.045-1551.043=0.002
σ0.330-0.323=0.007
min1550.820-1550.820=0.000
max1551.535-1551.523=0.012
mean920.000
σ0.000
min920.000
max920.000
mean1647.000
σ0.000
min1647.000
max1647.000
mean2.588-2.582=0.007
σ0.012-0.015=-0.003
min2.577-2.567=0.011
max2.606-2.599=0.007
policies=200
mean15518.452-15518.591=-0.139
σ0.086-0.064=0.022
min15518.332-15518.516=-0.184
max15518.520-15518.672=-0.152
mean9200.000
σ0.000
min9200.000
max9200.000
mean1647.000
σ0.000
min1647.000
max1647.000
mean26.194-26.158=0.035
σ0.180-0.117=0.063
min26.082-26.071=0.011
max26.462-26.320=0.143