Compare commits

Home / Compare 77f61a89 .. 9a8d6118

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.702-70.702=0.001
σ0.047-0.046=0.002
min70.668-70.676=-0.008
max70.833-70.829=0.004
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.160-0.160=0.000
σ0.002-0.004=-0.002
min0.157-0.154=0.003
max0.164-0.169=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.408-21.409=-0.000
σ0.003-0.002=0.001
min21.405-21.407=-0.001
max21.415-21.413=0.002
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.066-0.067=-0.001
σ0.003-0.002=0.001
min0.063-0.065=-0.002
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.930-1754.931=-0.000
σ0.362-0.359=0.002
min1754.363-1754.366=-0.003
max1755.514-1755.516=-0.003
mean1645.250-1651.400=-6.150
σ632.234-640.607=-8.373
min622.000-637.000=-15.000
max2770.000-2853.000=-83.000
mean2.799-2.786=0.013
σ0.213-0.250=-0.038
min2.336-2.180=0.156
max3.124-3.214=-0.090

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean3.819
σ0.000
min3.819
max3.819
mean2770.000-2853.000=-83.000
σ0.000
min2770.000-2853.000=-83.000
max2770.000-2853.000=-83.000
mean0.817-1.106=-0.289
σ0.000
min0.817-1.106=-0.289
max0.817-1.106=-0.289
name=error_case.art
mean10.998
σ0.000
min10.998
max10.998
mean2770.000-2853.000=-83.000
σ0.000
min2770.000-2853.000=-83.000
max2770.000-2853.000=-83.000
mean4.383-5.278=-0.895
σ0.000
min4.383-5.278=-0.895
max4.383-5.278=-0.895
name=heavy_item.art
mean7.432
σ0.000
min7.432
max7.432
mean2770.000-2853.000=-83.000
σ0.000
min2770.000-2853.000=-83.000
max2770.000-2853.000=-83.000
mean2.441-3.463=-1.023
σ0.000
min2.441-3.463=-1.023
max2.441-3.463=-1.023
name=nested_use.art
mean11.073
σ0.000
min11.073
max11.073
mean2770.000-2853.000=-83.000
σ0.000
min2770.000-2853.000=-83.000
max2770.000-2853.000=-83.000
mean4.378-5.252=-0.874
σ0.000
min4.378-5.252=-0.874
max4.378-5.252=-0.874

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean4668.614-4668.621=-0.007
σ0.000
min4668.614-4668.621=-0.007
max4668.614-4668.621=-0.007
mean2770.000-2853.000=-83.000
σ0.000
min2770.000-2853.000=-83.000
max2770.000-2853.000=-83.000
mean2.282-2.868=-0.586
σ0.000
min2.282-2.868=-0.586
max2.282-2.868=-0.586
name=cdr_enhanced_4k_loc.art
mean4303.813-4303.819=-0.005
σ0.000
min4303.813-4303.819=-0.005
max4303.813-4303.819=-0.005
mean2770.000-2853.000=-83.000
σ0.000
min2770.000-2853.000=-83.000
max2770.000-2853.000=-83.000
mean2.105-2.467=-0.362
σ0.000
min2.105-2.467=-0.362
max2.105-2.467=-0.362

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean752.155-752.155=0.000
σ0.000
min752.155-752.155=0.000
max752.155-752.155=0.000
mean2770.000-2853.000=-83.000
σ0.000
min2770.000-2853.000=-83.000
max2770.000-2853.000=-83.000
mean344.811-435.439=-90.628
σ0.000
min344.811-435.439=-90.628
max344.811-435.439=-90.628
name=record_render_large_syntax_err.art
mean747.274-747.275=-0.001
σ0.000
min747.274-747.275=-0.001
max747.274-747.275=-0.001
mean2770.000-2853.000=-83.000
σ0.000
min2770.000-2853.000=-83.000
max2770.000-2853.000=-83.000
mean342.802-431.410=-88.608
σ0.000
min342.802-431.410=-88.608
max342.802-431.410=-88.608
name=record_render_success.art
mean222.487-222.488=-0.001
σ0.000
min222.487-222.488=-0.001
max222.487-222.488=-0.001
mean2770.000-2853.000=-83.000
σ0.000
min2770.000-2853.000=-83.000
max2770.000-2853.000=-83.000
mean99.762-119.403=-19.640
σ0.000
min99.762-119.403=-19.640
max99.762-119.403=-19.640
name=record_render_syntax_err.art
mean210.255
σ0.000
min210.255
max210.255
mean2770.000-2853.000=-83.000
σ0.000
min2770.000-2853.000=-83.000
max2770.000-2853.000=-83.000
mean91.778-113.215=-21.437
σ0.000
min91.778-113.215=-21.437
max91.778-113.215=-21.437

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.791-272.753=0.037
σ0.007-0.008=-0.001
min272.781-272.744=0.037
max272.800-272.761=0.038
mean2770.000-2853.000=-83.000
σ0.000
min2770.000-2853.000=-83.000
max2770.000-2853.000=-83.000
mean0.377-0.379=-0.001
σ0.001-0.001=0.000
min0.376-0.377=-0.001
max0.379-0.380=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.219-1933.163=0.056
σ0.013-0.005=0.008
min1933.198-1933.156=0.042
max1933.234-1933.168=0.066
mean2770.000-2853.000=-83.000
σ0.000
min2770.000-2853.000=-83.000
max2770.000-2853.000=-83.000
mean3.084-3.010=0.075
σ0.086-0.152=-0.066
min3.020-2.778=0.242
max3.233-3.165=0.068
iters=5
new-facts=6402
prior-facts=1
mean4756.957-4756.840=0.117
σ7.623-7.661=-0.038
min4753.473-4752.927=0.547
max4770.593-4770.534=0.059
mean2770.000-2853.000=-83.000
σ0.000
min2770.000-2853.000=-83.000
max2770.000-2853.000=-83.000
mean8.572-8.383=0.189
σ0.370-0.472=-0.102
min7.966-7.873=0.093
max8.891-8.924=-0.032
iters=5
new-facts=6402
prior-facts=6402
mean4944.457-4944.318=0.140
σ0.024-0.164=-0.140
min4944.427-4944.024=0.403
max4944.484-4944.405=0.079
mean3033.200-3066.200=-33.000
σ289.247-265.810=23.437
min2770.000-2853.000=-83.000
max3430.000-3462.000=-32.000
mean8.485-8.553=-0.068
σ0.123-0.172=-0.049
min8.376-8.427=-0.051
max8.695-8.837=-0.143

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.029-1.074=-0.046
σ0.125-0.223=-0.098
min0.916-0.913=0.004
max1.225-1.455=-0.230

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.303-468.321=-0.018
σ574.236-574.260=-0.024
min181.183-181.190=-0.007
max1329.657-1329.711=-0.054
mean88.250
σ8.500
min84.000
max101.000
mean2770.000-2853.000=-83.000
σ0.000
min2770.000-2853.000=-83.000
max2770.000-2853.000=-83.000
mean0.566-0.445=0.122
σ0.560-0.304=0.256
min0.282-0.284=-0.002
max1.405-0.900=0.505
policies=20
mean1812.151-1812.204=-0.053
σ0.396-0.409=-0.013
min1811.883-1811.912=-0.029
max1812.736-1812.802=-0.066
mean840.000
σ0.000
min840.000
max840.000
mean2770.000-2853.000=-83.000
σ0.000
min2770.000-2853.000=-83.000
max2770.000-2853.000=-83.000
mean2.812-2.890=-0.078
σ0.011-0.007=0.003
min2.803-2.882=-0.079
max2.823-2.898=-0.075
policies=200
mean18128.977-18129.062=-0.085
σ0.551-0.497=0.055
min18128.499-18128.738=-0.240
max18129.767-18129.802=-0.036
mean8400.000
σ0.000
min8400.000
max8400.000
mean2770.000-2853.000=-83.000
σ0.000
min2770.000-2853.000=-83.000
max2770.000-2853.000=-83.000
mean28.432-28.471=-0.040
σ0.095-0.228=-0.133
min28.323-28.297=0.026
max28.536-28.799=-0.263