Compare commits

Home / Compare 97622275 .. ffc2092c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.013-54.048=-0.035
σ0.370-0.368=0.002
min53.870-53.903=-0.033
max55.066-55.096=-0.031
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.135-0.138=-0.003
σ0.005-0.003=0.003
min0.129-0.135=-0.006
max0.142-0.143=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.322-43.342=-0.020
σ0.008-0.005=0.003
min43.313-43.334=-0.021
max43.333-43.351=-0.018
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.122-0.121=0.001
σ0.004-0.005=-0.001
min0.118-0.113=0.005
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1017.198=-10.889
σ1.169-1.186=-0.016
min1005.738-1016.643=-10.905
max1011.203-1022.171=-10.968
mean1060.450-1052.200=8.250
σ303.755-303.861=-0.105
min601.000-594.000=7.000
max1459.000-1640.000=-181.000
mean1.549-1.570=-0.022
σ0.070-0.097=-0.027
min1.461-1.477=-0.016
max1.719-1.790=-0.071

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1459.000
σ0.000
min1459.000
max1459.000
mean0.414
σ0.147
min0.335
max0.676
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1459.000
σ0.000
min1459.000
max1459.000
mean0.904
σ0.102
min0.841
max1.083
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1459.000
σ0.000
min1459.000
max1459.000
mean0.550
σ0.047
min0.512
max0.631
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1459.000
σ0.000
min1459.000
max1459.000
mean0.849
σ0.043
min0.809
max0.920

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.097
σ0.032
min964.077
max964.154
mean1459.000
σ0.000
min1459.000
max1459.000
mean0.819
σ0.024
min0.787
max0.846
name=cdr_enhanced_4k_loc.art
mean884.710
σ0.006
min884.703
max884.716
mean1459.000
σ0.000
min1459.000
max1459.000
mean0.656
σ0.048
min0.587
max0.720

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715
σ0.002
min7.714
max7.719
mean1459.000
σ0.000
min1459.000
max1459.000
mean4.269
σ0.091
min4.137
max4.554
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.667
mean1459.000
σ0.000
min1459.000
max1459.000
mean4.272
σ0.071
min4.153
max4.489
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1459.000
σ0.000
min1459.000
max1459.000
mean0.733
σ0.027
min0.702
max0.908
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1459.000
σ0.000
min1459.000
max1459.000
mean0.692
σ0.016
min0.659
max0.771

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.052-301.942=-5.890
σ0.218-0.195=0.024
min295.840-301.775=-5.935
max296.573-302.459=-5.886
mean1920.000-2025.000=-105.000
σ0.000
min1920.000-2025.000=-105.000
max1920.000-2025.000=-105.000
mean0.586-0.581=0.006
σ0.042-0.043=-0.001
min0.522-0.499=0.023
max0.681-0.609=0.072

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.690-303.782=-19.092
σ0.033-0.063=-0.029
min284.652-303.686=-19.034
max284.725-303.848=-19.123
mean1459.000-1640.000=-181.000
σ0.000
min1459.000-1640.000=-181.000
max1459.000-1640.000=-181.000
mean0.390-0.397=-0.007
σ0.007-0.015=-0.008
min0.384-0.389=-0.006
max0.402-0.424=-0.022
iters=5
new-facts=1
prior-facts=6402
mean1295.043-1326.325=-31.282
σ0.093-0.097=-0.004
min1294.951-1326.202=-31.251
max1295.189-1326.450=-31.261
mean1459.000-1640.000=-181.000
σ0.000
min1459.000-1640.000=-181.000
max1459.000-1640.000=-181.000
mean1.941-1.918=0.024
σ0.161-0.109=0.052
min1.806-1.810=-0.004
max2.208-2.085=0.123
iters=5
new-facts=6402
prior-facts=1
mean1539.288-1564.396=-25.107
σ6.774-6.922=-0.148
min1536.148-1561.110=-24.962
max1551.404-1576.774=-25.370
mean1459.000-1640.000=-181.000
σ0.000
min1459.000-1640.000=-181.000
max1459.000-1640.000=-181.000
mean2.405-2.333=0.072
σ0.299-0.307=-0.008
min2.074-2.061=0.013
max2.746-2.689=0.057
iters=5
new-facts=6402
prior-facts=6402
mean1856.989-1894.281=-37.292
σ0.050-0.068=-0.019
min1856.948-1894.159=-37.212
max1857.068-1894.324=-37.256
mean1759.400-1772.800=-13.400
σ176.453-162.116=14.337
min1508.000-1640.000=-132.000
max1920.000-2025.000=-105.000
mean3.072-3.030=0.042
σ0.380-0.260=0.121
min2.826-2.847=-0.021
max3.747-3.456=0.291

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.775-1.228=0.547
σ0.112-0.326=-0.214
min1.590-0.945=0.645
max1.871-1.774=0.096

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-448.344=-0.558
σ581.212-581.797=-0.585
min157.177-157.436=-0.259
max1319.604-1321.040=-1.436
mean96.250
σ8.500
min92.000
max109.000
mean1459.000-1640.000=-181.000
σ0.000
min1459.000-1640.000=-181.000
max1459.000-1640.000=-181.000
mean0.555-0.536=0.019
σ0.588-0.543=0.045
min0.257-0.265=-0.007
max1.437-1.351=0.087
policies=20
mean1572.094-1574.635=-2.541
σ0.356-0.332=0.025
min1571.853-1574.436=-2.583
max1572.623-1575.131=-2.507
mean920.000
σ0.000
min920.000
max920.000
mean1459.000-1640.000=-181.000
σ0.000
min1459.000-1640.000=-181.000
max1459.000-1640.000=-181.000
mean2.627-2.621=0.006
σ0.008-0.011=-0.003
min2.615-2.607=0.008
max2.635-2.633=0.002
policies=200
mean15729.077-15754.537=-25.460
σ0.069-0.091=-0.023
min15729.014-15754.433=-25.418
max15729.175-15754.647=-25.473
mean9200.000
σ0.000
min9200.000
max9200.000
mean1459.000-1640.000=-181.000
σ0.000
min1459.000-1640.000=-181.000
max1459.000-1640.000=-181.000
mean26.541-26.718=-0.177
σ0.122-0.134=-0.012
min26.433-26.584=-0.151
max26.711-26.892=-0.181