Compare commits

Home / Compare 8127c802 .. 697cc0b1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.056=0.000
σ0.372-0.368=0.004
min53.908-53.911=-0.003
max55.114-55.102=0.012
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.143-0.143=-0.000
σ0.004-0.004=0.000
min0.138-0.140=-0.001
max0.149-0.148=0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=0.000
σ0.008-0.007=0.001
min43.380-43.384=-0.004
max43.409-43.406=0.003
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.126-0.123=0.003
σ0.007-0.006=0.001
min0.119-0.117=0.002
max0.135-0.138=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.003-1007.003=-0.000
σ1.205-1.197=0.008
min1006.436-1006.441=-0.006
max1012.059-1012.024=0.035
mean1058.250-1054.700=3.550
σ316.620-307.776=8.844
min588.000-580.000=8.000
max1635.000-1646.000=-11.000
mean1.542-1.558=-0.016
σ0.058-0.090=-0.032
min1.415-1.473=-0.058
max1.666-1.795=-0.128

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.416-0.412=0.004
σ0.134-0.123=0.011
min0.331-0.344=-0.013
max0.654-0.631=0.023
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.874-0.873=0.000
σ0.093-0.091=0.002
min0.807-0.799=0.008
max1.034-1.028=0.006
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.531-0.529=0.002
σ0.053-0.049=0.003
min0.484-0.494=-0.010
max0.614-0.611=0.003
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.853-0.845=0.009
σ0.045-0.049=-0.003
min0.821-0.799=0.022
max0.928-0.920=0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.838=-0.000
σ0.035-0.035=-0.000
min964.809
max964.896-964.896=-0.000
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.823-0.827=-0.003
σ0.054-0.026=0.028
min0.727-0.792=-0.065
max0.851-0.853=-0.002
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.008-0.007=0.000
min885.504-885.505=-0.001
max885.523-885.523=-0.000
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.732-0.739=-0.007
σ0.014-0.011=0.003
min0.707-0.721=-0.014
max0.742-0.751=-0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.719
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean3.532-4.247=-0.715
σ0.088-0.126=-0.038
min3.367-4.096=-0.728
max4.035-5.077=-1.042
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean3.532-4.222=-0.690
σ0.070-0.106=-0.036
min3.407-4.061=-0.654
max3.797-4.575=-0.778
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.743-0.740=0.003
σ0.028-0.016=0.011
min0.702-0.712=-0.010
max0.914-0.851=0.063
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.708-0.700=0.008
σ0.017-0.029=-0.012
min0.668-0.671=-0.003
max0.793-0.931=-0.138

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.992-296.876=0.116
σ0.270-0.237=0.032
min296.764-296.678=0.086
max297.722-297.509=0.213
mean1896.000-2032.000=-136.000
σ0.000
min1896.000-2032.000=-136.000
max1896.000-2032.000=-136.000
mean0.576-0.565=0.012
σ0.029-0.032=-0.003
min0.515-0.507=0.008
max0.606-0.601=0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.829-286.818=0.011
σ0.039-0.039=-0.000
min286.781-286.772=0.009
max286.869-286.863=0.006
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.394-0.394=-0.000
σ0.005-0.007=-0.002
min0.387-0.385=0.002
max0.399-0.401=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1297.258-1297.290=-0.031
σ0.047-0.075=-0.028
min1297.205-1297.202=0.003
max1297.333-1297.398=-0.065
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean2.142-2.258=-0.116
σ0.141-0.069=0.073
min2.040-2.179=-0.139
max2.386-2.356=0.030
iters=5
new-facts=6402
prior-facts=1
mean1541.337-1541.340=-0.003
σ6.829-6.815=0.015
min1538.112-1538.120=-0.008
max1553.550-1553.527=0.023
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean2.287-2.207=0.081
σ0.205-0.081=0.124
min2.086-2.133=-0.047
max2.555-2.325=0.230
iters=5
new-facts=6402
prior-facts=6402
mean1859.119-1859.129=-0.010
σ0.083-0.061=0.021
min1858.997-1859.041=-0.044
max1859.199-1859.196=0.003
mean1777.400-1784.200=-6.800
σ124.112-167.819=-43.707
min1635.000-1646.000=-11.000
max1896.000-2032.000=-136.000
mean3.060-2.903=0.157
σ0.163-0.033=0.130
min2.866-2.874=-0.009
max3.286-2.941=0.346

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.233-1.214=0.019
σ0.339-0.335=0.004
min0.932-0.926=0.006
max1.801-1.769=0.032

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.818-448.821=-0.003
σ581.372-581.372=0.000
min158.131-158.134=-0.003
max1320.876-1320.879=-0.003
mean96.250
σ8.500
min92.000
max109.000
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean0.549-0.556=-0.007
σ0.565-0.563=0.002
min0.259-0.264=-0.005
max1.396-1.400=-0.004
policies=20
mean1581.597-1581.623=-0.026
σ0.360-0.361=-0.001
min1581.355-1581.383=-0.028
max1582.133-1582.160=-0.028
mean920.000
σ0.000
min920.000
max920.000
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean2.633-2.633=-0.001
σ0.020-0.013=0.007
min2.608-2.619=-0.011
max2.656-2.647=0.009
policies=200
mean15824.119-15824.224=-0.105
σ0.198-0.081=0.116
min15823.907-15824.144=-0.237
max15824.380-15824.332=0.048
mean9200.000
σ0.000
min9200.000
max9200.000
mean1635.000-1646.000=-11.000
σ0.000
min1635.000-1646.000=-11.000
max1635.000-1646.000=-11.000
mean26.542-26.585=-0.042
σ0.070-0.053=0.017
min26.441-26.526=-0.085
max26.604-26.631=-0.027