Compare commits

Home / Compare d43a32b1 .. ab70d010

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.013-54.016=-0.003
σ0.367-0.369=-0.002
min53.874-53.868=0.006
max55.057-55.065=-0.007
mean413.000-419.000=-6.000
σ0.000
min413.000-419.000=-6.000
max413.000-419.000=-6.000
mean0.137-0.138=-0.001
σ0.003-0.005=-0.001
min0.134-0.132=0.003
max0.144-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=0.001
σ0.007-0.005=0.002
min43.315-43.314=0.001
max43.334-43.329=0.005
mean413.000-419.000=-6.000
σ0.000
min413.000-419.000=-6.000
max413.000-419.000=-6.000
mean0.120-0.122=-0.001
σ0.004-0.004=-0.000
min0.115-0.118=-0.004
max0.128-0.130=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.305-1006.306=-0.001
σ1.194-1.218=-0.025
min1005.770-1005.765=0.005
max1011.304-1011.405=-0.100
mean1035.800-1051.050=-15.250
σ310.381-313.560=-3.179
min545.000-601.000=-56.000
max1503.000-1649.000=-146.000
mean1.556-1.707=-0.152
σ0.084-0.078=0.006
min1.461-1.604=-0.143
max1.772-1.941=-0.169

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1503.000
σ0.000
min1503.000
max1503.000
mean0.411
σ0.117
min0.342
max0.617
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1503.000
σ0.000
min1503.000
max1503.000
mean0.884
σ0.091
min0.821
max1.041
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1503.000
σ0.000
min1503.000
max1503.000
mean0.539
σ0.056
min0.493
max0.635
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1503.000
σ0.000
min1503.000
max1503.000
mean0.848
σ0.036
min0.816
max0.908

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.102
σ0.034
min964.077
max964.163
mean1503.000
σ0.000
min1503.000
max1503.000
mean0.823
σ0.026
min0.789
max0.851
name=cdr_enhanced_4k_loc.art
mean884.710
σ0.006
min884.703
max884.717
mean1503.000
σ0.000
min1503.000
max1503.000
mean0.700
σ0.048
min0.633
max0.745

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715
σ0.002
min7.714
max7.720
mean1503.000
σ0.000
min1503.000
max1503.000
mean3.679
σ0.323
min3.361
max4.531
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1503.000
σ0.000
min1503.000
max1503.000
mean4.241
σ0.094
min4.091
max4.521
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1503.000
σ0.000
min1503.000
max1503.000
mean0.726
σ0.015
min0.697
max0.823
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1503.000
σ0.000
min1503.000
max1503.000
mean0.694
σ0.014
min0.667
max0.777

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.267-296.152=0.116
σ0.157-0.243=-0.086
min296.116-295.964=0.152
max296.657-296.827=-0.169
mean1955.000-1901.000=54.000
σ0.000
min1955.000-1901.000=54.000
max1955.000-1901.000=54.000
mean0.574-0.562=0.012
σ0.037-0.035=0.001
min0.525-0.504=0.022
max0.646-0.600=0.046

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.694-284.684=0.010
σ0.045-0.037=0.008
min284.630-284.633=-0.004
max284.741-284.722=0.019
mean1503.000-1649.000=-146.000
σ0.000
min1503.000-1649.000=-146.000
max1503.000-1649.000=-146.000
mean0.387-0.387=0.000
σ0.018-0.009=0.010
min0.358-0.379=-0.021
max0.403-0.397=0.006
iters=5
new-facts=1
prior-facts=6402
mean1295.107-1295.078=0.029
σ0.098-0.102=-0.004
min1294.997-1294.962=0.035
max1295.244-1295.217=0.027
mean1503.000-1649.000=-146.000
σ0.000
min1503.000-1649.000=-146.000
max1503.000-1649.000=-146.000
mean2.113-1.881=0.232
σ0.088-0.093=-0.005
min2.009-1.780=0.229
max2.199-2.001=0.198
iters=5
new-facts=6402
prior-facts=1
mean1539.257-1539.195=0.062
σ6.794-6.831=-0.037
min1536.111-1535.908=0.202
max1551.409-1551.409=-0.001
mean1503.000-1649.000=-146.000
σ0.000
min1503.000-1649.000=-146.000
max1503.000-1649.000=-146.000
mean2.448-2.220=0.228
σ0.172-0.173=-0.000
min2.264-2.075=0.189
max2.661-2.472=0.189
iters=5
new-facts=6402
prior-facts=6402
mean1856.986-1856.987=-0.001
σ0.065-0.054=0.011
min1856.912-1856.933=-0.021
max1857.062-1857.068=-0.006
mean1758.000-1771.800=-13.800
σ203.463-123.512=79.951
min1503.000-1649.000=-146.000
max1955.000-1901.000=54.000
mean2.967-3.037=-0.071
σ0.169-0.366=-0.197
min2.777-2.688=0.089
max3.205-3.631=-0.426

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.653-1.171=0.483
σ0.239-0.254=-0.015
min1.267-0.928=0.340
max1.876-1.575=0.300

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.783-447.804=-0.020
σ581.212-581.228=-0.015
min157.176-157.182=-0.006
max1319.602-1319.645=-0.044
mean96.250
σ8.500
min92.000
max109.000
mean1503.000-1649.000=-146.000
σ0.000
min1503.000-1649.000=-146.000
max1503.000-1649.000=-146.000
mean0.557-0.552=0.006
σ0.591-0.559=0.032
min0.260-0.269=-0.008
max1.444-1.390=0.054
policies=20
mean1572.081-1572.133=-0.052
σ0.355-0.368=-0.014
min1571.834-1571.931=-0.097
max1572.607-1572.685=-0.078
mean920.000
σ0.000
min920.000
max920.000
mean1503.000-1649.000=-146.000
σ0.000
min1503.000-1649.000=-146.000
max1503.000-1649.000=-146.000
mean2.625-2.687=-0.062
σ0.026-0.021=0.004
min2.608-2.655=-0.047
max2.663-2.701=-0.037
policies=200
mean15729.019-15728.905=0.114
σ0.164-0.114=0.050
min15728.867-15728.748=0.119
max15729.233-15729.009=0.225
mean9200.000
σ0.000
min9200.000
max9200.000
mean1503.000-1649.000=-146.000
σ0.000
min1503.000-1649.000=-146.000
max1503.000-1649.000=-146.000
mean26.563-27.170=-0.607
σ0.075-0.086=-0.011
min26.475-27.083=-0.609
max26.634-27.285=-0.651