Compare commits

Home / Compare 512d9a02 .. 70164736

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.053-54.055=-0.002
σ0.368-0.368=-0.000
min53.913-53.914=-0.001
max55.099-55.102=-0.002
mean414.000-419.000=-5.000
σ0.000
min414.000-419.000=-5.000
max414.000-419.000=-5.000
mean0.138-0.139=-0.001
σ0.005-0.005=0.000
min0.131-0.133=-0.001
max0.146-0.149=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.392-43.395=-0.003
σ0.008-0.004=0.004
min43.384-43.389=-0.005
max43.408-43.403=0.005
mean414.000-419.000=-5.000
σ0.000
min414.000-419.000=-5.000
max414.000-419.000=-5.000
mean0.118-0.121=-0.004
σ0.008-0.005=0.003
min0.114-0.113=0.000
max0.141-0.130=0.010

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.006-1007.008=-0.001
σ1.188-1.183=0.004
min1006.434-1006.434=0.000
max1011.984-1011.962=0.022
mean1048.100-1055.650=-7.550
σ307.199-307.722=-0.524
min586.000-581.000=5.000
max1647.000
mean1.516-1.538=-0.021
σ0.051-0.083=-0.032
min1.442-1.468=-0.026
max1.619-1.745=-0.126

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.423-0.418=0.005
σ0.149-0.141=0.008
min0.331-0.332=-0.001
max0.687-0.667=0.021
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.929-0.871=0.058
σ0.102-0.092=0.010
min0.853-0.817=0.036
max1.081-1.034=0.047
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.529-0.542=-0.013
σ0.061-0.054=0.007
min0.478-0.505=-0.027
max0.631-0.636=-0.005
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.846-0.848=-0.002
σ0.027-0.041=-0.014
min0.818-0.822=-0.004
max0.891-0.922=-0.031

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.839=0.001
σ0.035-0.034=0.000
min964.811
max964.896-964.895=0.001
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.798-0.823=-0.025
σ0.065-0.043=0.022
min0.705-0.760=-0.055
max0.855-0.865=-0.009
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.008-0.008=0.000
min885.504
max885.523-885.522=0.001
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.705-0.728=-0.023
σ0.033-0.016=0.017
min0.669-0.705=-0.036
max0.744-0.748=-0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.720=-0.001
mean1647.000
σ0.000
min1647.000
max1647.000
mean4.289-4.217=0.072
σ0.082-0.093=-0.011
min4.135-4.080=0.055
max4.628-4.601=0.027
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1647.000
σ0.000
min1647.000
max1647.000
mean4.276-4.196=0.080
σ0.077-0.069=0.008
min4.134-4.083=0.051
max4.531-4.478=0.053
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.755-0.670=0.085
σ0.018-0.104=-0.086
min0.708-0.520=0.187
max0.861-0.867=-0.007
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.619-0.514=0.105
σ0.103-0.017=0.086
min0.487-0.395=0.092
max0.779-0.584=0.195

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.954-296.947=0.006
σ0.221-0.272=-0.052
min296.745-296.756=-0.011
max297.541-297.689=-0.148
mean2078.000-1939.000=139.000
σ0.000
min2078.000-1939.000=139.000
max2078.000-1939.000=139.000
mean0.549-0.569=-0.020
σ0.029-0.038=-0.009
min0.512-0.505=0.006
max0.583-0.621=-0.038

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.821-286.818=0.003
σ0.036-0.038=-0.002
min286.774-286.768=0.006
max286.857-286.858=-0.002
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.395-0.396=-0.001
σ0.007-0.008=-0.001
min0.389-0.387=0.002
max0.405-0.404=0.001
iters=5
new-facts=1
prior-facts=6402
mean1297.258-1297.266=-0.008
σ0.081-0.056=0.025
min1297.174-1297.202=-0.028
max1297.374-1297.316=0.058
mean1647.000
σ0.000
min1647.000
max1647.000
mean2.135-2.147=-0.012
σ0.201-0.076=0.125
min1.994-2.028=-0.034
max2.450-2.215=0.234
iters=5
new-facts=6402
prior-facts=1
mean1541.310-1541.295=0.015
σ6.838-6.846=-0.008
min1538.053-1538.034=0.019
max1553.538-1553.538=0.001
mean1647.000
σ0.000
min1647.000
max1647.000
mean2.195-2.184=0.011
σ0.119-0.120=-0.000
min2.094-2.080=0.013
max2.389-2.387=0.002
iters=5
new-facts=6402
prior-facts=6402
mean1859.112-1859.117=-0.005
σ0.079-0.083=-0.004
min1858.985-1858.999=-0.014
max1859.179-1859.205=-0.026
mean1785.600-1790.000=-4.400
σ180.966-145.931=35.035
min1647.000
max2078.000-1939.000=139.000
mean2.944-3.024=-0.080
σ0.162-0.185=-0.023
min2.681-2.856=-0.175
max3.111-3.297=-0.186

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.233-1.228=0.004
σ0.231-0.299=-0.068
min1.059-0.932=0.127
max1.621-1.716=-0.095

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.820=-0.000
σ581.372-581.372=0.000
min158.132-158.133=-0.001
max1320.878-1320.878=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.564-0.548=0.015
σ0.603-0.559=0.043
min0.261-0.265=-0.004
max1.468-1.387=0.080
policies=20
mean1581.607-1581.613=-0.005
σ0.351-0.362=-0.011
min1581.369-1581.370=-0.001
max1582.128-1582.151=-0.022
mean920.000
σ0.000
min920.000
max920.000
mean1647.000
σ0.000
min1647.000
max1647.000
mean2.634-2.648=-0.013
σ0.016-0.009=0.006
min2.615-2.635=-0.019
max2.653-2.657=-0.003
policies=200
mean15824.202-15824.183=0.019
σ0.147-0.098=0.049
min15824.025-15824.051=-0.026
max15824.379-15824.280=0.099
mean9200.000
σ0.000
min9200.000
max9200.000
mean1647.000
σ0.000
min1647.000
max1647.000
mean26.638-26.588=0.050
σ0.060-0.095=-0.036
min26.573-26.516=0.057
max26.715-26.726=-0.012