Compare commits

Home / Compare aedcf4f1 .. 77f61a89

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.702-70.702=-0.001
σ0.046-0.046=-0.000
min70.676-70.673=0.003
max70.829-70.829=-0.000
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.160-0.161=-0.000
σ0.004-0.003=0.001
min0.154-0.158=-0.004
max0.169-0.166=0.002
cache=y
dps=1
iters=10
policies=100
mean21.409-21.409=-0.000
σ0.002-0.003=-0.001
min21.407-21.406=0.001
max21.413-21.415=-0.002
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.067-0.066=0.000
σ0.002-0.003=-0.000
min0.065-0.064=0.001
max0.073-0.074=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.928=0.003
σ0.359-0.360=-0.001
min1754.366-1754.354=0.012
max1755.516-1755.495=0.021
mean1651.400-1665.950=-14.550
σ640.607-625.126=15.481
min637.000-622.000=15.000
max2853.000-2521.000=332.000
mean2.786-2.822=-0.036
σ0.250-0.160=0.090
min2.180-2.370=-0.191
max3.214-3.037=0.178

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean3.819-3.815=0.004
σ0.000
min3.819-3.815=0.004
max3.819-3.815=0.004
mean2853.000-2521.000=332.000
σ0.000
min2853.000-2521.000=332.000
max2853.000-2521.000=332.000
mean1.106-1.169=-0.063
σ0.000
min1.106-1.169=-0.063
max1.106-1.169=-0.063
name=error_case.art
mean10.998-10.999=-0.001
σ0.000
min10.998-10.999=-0.001
max10.998-10.999=-0.001
mean2853.000-2521.000=332.000
σ0.000
min2853.000-2521.000=332.000
max2853.000-2521.000=332.000
mean5.278-5.830=-0.552
σ0.000
min5.278-5.830=-0.552
max5.278-5.830=-0.552
name=heavy_item.art
mean7.432
σ0.000
min7.432
max7.432
mean2853.000-2521.000=332.000
σ0.000
min2853.000-2521.000=332.000
max2853.000-2521.000=332.000
mean3.463-3.463=0.000
σ0.000
min3.463-3.463=0.000
max3.463-3.463=0.000
name=nested_use.art
mean11.073-11.074=-0.002
σ0.000
min11.073-11.074=-0.002
max11.073-11.074=-0.002
mean2853.000-2521.000=332.000
σ0.000
min2853.000-2521.000=332.000
max2853.000-2521.000=332.000
mean5.252-6.098=-0.846
σ0.000
min5.252-6.098=-0.846
max5.252-6.098=-0.846

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean4668.621-4668.605=0.016
σ0.000
min4668.621-4668.605=0.016
max4668.621-4668.605=0.016
mean2853.000-2521.000=332.000
σ0.000
min2853.000-2521.000=332.000
max2853.000-2521.000=332.000
mean2.868-3.804=-0.936
σ0.000
min2.868-3.804=-0.936
max2.868-3.804=-0.936
name=cdr_enhanced_4k_loc.art
mean4303.819-4303.767=0.051
σ0.000
min4303.819-4303.767=0.051
max4303.819-4303.767=0.051
mean2853.000-2521.000=332.000
σ0.000
min2853.000-2521.000=332.000
max2853.000-2521.000=332.000
mean2.467-3.364=-0.897
σ0.000
min2.467-3.364=-0.897
max2.467-3.364=-0.897

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean752.155-752.207=-0.051
σ0.000
min752.155-752.207=-0.051
max752.155-752.207=-0.051
mean2853.000-2521.000=332.000
σ0.000
min2853.000-2521.000=332.000
max2853.000-2521.000=332.000
mean435.439-569.339=-133.900
σ0.000
min435.439-569.339=-133.900
max435.439-569.339=-133.900
name=record_render_large_syntax_err.art
mean747.275-747.274=0.001
σ0.000
min747.275-747.274=0.001
max747.275-747.274=0.001
mean2853.000-2521.000=332.000
σ0.000
min2853.000-2521.000=332.000
max2853.000-2521.000=332.000
mean431.410-549.431=-118.021
σ0.000
min431.410-549.431=-118.021
max431.410-549.431=-118.021
name=record_render_success.art
mean222.488-222.494=-0.006
σ0.000
min222.488-222.494=-0.006
max222.488-222.494=-0.006
mean2853.000-2521.000=332.000
σ0.000
min2853.000-2521.000=332.000
max2853.000-2521.000=332.000
mean119.403-137.005=-17.603
σ0.000
min119.403-137.005=-17.603
max119.403-137.005=-17.603
name=record_render_syntax_err.art
mean210.255
σ0.000
min210.255
max210.255
mean2853.000-2521.000=332.000
σ0.000
min2853.000-2521.000=332.000
max2853.000-2521.000=332.000
mean113.215-127.139=-13.923
σ0.000
min113.215-127.139=-13.923
max113.215-127.139=-13.923

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.753-272.757=-0.003
σ0.008-0.009=-0.001
min272.744-272.748=-0.004
max272.761-272.768=-0.006
mean2853.000-2521.000=332.000
σ0.000
min2853.000-2521.000=332.000
max2853.000-2521.000=332.000
mean0.379-0.378=0.000
σ0.001-0.001=0.000
min0.377-0.377=0.001
max0.380-0.379=0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.163-1933.168=-0.005
σ0.005-0.011=-0.006
min1933.156-1933.156=0.000
max1933.168-1933.179=-0.011
mean2853.000-2521.000=332.000
σ0.000
min2853.000-2521.000=332.000
max2853.000-2521.000=332.000
mean3.010-3.105=-0.095
σ0.152-0.069=0.082
min2.778-3.045=-0.267
max3.165-3.213=-0.047
iters=5
new-facts=6402
prior-facts=1
mean4756.840-4756.991=-0.151
σ7.661-7.629=0.032
min4752.927-4753.367=-0.441
max4770.534-4770.635=-0.101
mean2853.000-2521.000=332.000
σ0.000
min2853.000-2521.000=332.000
max2853.000-2521.000=332.000
mean8.383-8.365=0.018
σ0.472-0.518=-0.046
min7.873-7.890=-0.017
max8.924-9.222=-0.298
iters=5
new-facts=6402
prior-facts=6402
mean4944.318-4944.393=-0.076
σ0.164-0.023=0.142
min4944.024-4944.369=-0.344
max4944.405-4944.416=-0.010
mean3066.200-2942.800=123.400
σ265.810-393.509=-127.700
min2853.000-2521.000=332.000
max3462.000-3468.000=-6.000
mean8.553-8.494=0.059
σ0.172-0.152=0.021
min8.427-8.346=0.080
max8.837-8.751=0.086

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.074-1.582=-0.508
σ0.223-0.271=-0.048
min0.913-1.148=-0.235
max1.455-1.810=-0.355

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.321-468.316=0.005
σ574.260-574.255=0.005
min181.190-181.184=0.006
max1329.711-1329.698=0.013
mean88.250
σ8.500
min84.000
max101.000
mean2853.000-2521.000=332.000
σ0.000
min2853.000-2521.000=332.000
max2853.000-2521.000=332.000
mean0.445-0.580=-0.135
σ0.304-0.583=-0.279
min0.284-0.287=-0.003
max0.900-1.454=-0.554
policies=20
mean1812.204-1812.162=0.041
σ0.409-0.394=0.016
min1811.912-1811.901=0.011
max1812.802-1812.745=0.057
mean840.000
σ0.000
min840.000
max840.000
mean2853.000-2521.000=332.000
σ0.000
min2853.000-2521.000=332.000
max2853.000-2521.000=332.000
mean2.890-2.803=0.087
σ0.007-0.027=-0.020
min2.882-2.763=0.118
max2.898-2.823=0.076
policies=200
mean18129.062-18129.059=0.003
σ0.497-0.443=0.054
min18128.738-18128.737=0.001
max18129.802-18129.712=0.090
mean8400.000
σ0.000
min8400.000
max8400.000
mean2853.000-2521.000=332.000
σ0.000
min2853.000-2521.000=332.000
max2853.000-2521.000=332.000
mean28.471-28.397=0.074
σ0.228-0.195=0.032
min28.297-28.162=0.135
max28.799-28.624=0.176