Compare commits

Home / Compare 087b3ad2 .. bdbd6fb3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.036-54.046=-0.010
σ0.368-0.368=0.000
min53.890-53.903=-0.013
max55.082-55.092=-0.010
mean413.000-415.800=-2.800
σ0.000-0.422=-0.422
min413.000-415.000=-2.000
max413.000-416.000=-3.000
mean0.149-0.138=0.011
σ0.009-0.005=0.004
min0.138-0.131=0.007
max0.162-0.146=0.016
cache=y
dps=1
iters=10
policies=100
mean43.384-43.385=-0.001
σ0.005-0.006=-0.000
min43.378-43.376=0.002
max43.396-43.394=0.003
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.123-0.122=0.001
σ0.004-0.005=-0.001
min0.120-0.116=0.004
max0.130-0.131=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.327-1006.983=-0.656
σ0.911-0.853=0.058
min1005.867-1006.482=-0.615
max1010.118-1010.495=-0.377
mean1053.800-1044.400=9.400
σ305.174-313.668=-8.493
min582.000-576.000=6.000
max1453.000-1638.000=-185.000
mean1.559-1.557=0.001
σ0.086-0.082=0.004
min1.477-1.485=-0.009
max1.759-1.822=-0.062

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.003=-0.001
min0.881-0.882=-0.000
max0.886-0.888=-0.003
mean1453.000-1638.000=-185.000
σ0.000
min1453.000-1638.000=-185.000
max1453.000-1638.000=-185.000
mean0.443-0.419=0.023
σ0.181-0.146=0.035
min0.352-0.338=0.014
max0.766-0.678=0.088
name=error_case.art
mean2.333-2.340=-0.006
σ0.003-0.003=-0.000
min2.332-2.337=-0.005
max2.337-2.344=-0.007
mean1453.000-1638.000=-185.000
σ0.000
min1453.000-1638.000=-185.000
max1453.000-1638.000=-185.000
mean0.920-0.875=0.045
σ0.174-0.086=0.088
min0.818-0.819=-0.000
max1.228-1.025=0.203
name=heavy_item.art
mean1.521-1.523=-0.002
σ0.002-0.001=0.001
min1.520-1.522=-0.002
max1.524-1.525=-0.001
mean1453.000-1638.000=-185.000
σ0.000
min1453.000-1638.000=-185.000
max1453.000-1638.000=-185.000
mean0.540-0.535=0.005
σ0.047-0.052=-0.004
min0.499-0.495=0.003
max0.616-0.624=-0.008
name=nested_use.art
mean2.355-2.362=-0.006
σ0.002-0.002=-0.000
min2.355-2.360=-0.005
max2.358-2.364=-0.005
mean1453.000-1638.000=-185.000
σ0.000
min1453.000-1638.000=-185.000
max1453.000-1638.000=-185.000
mean0.846-0.836=0.010
σ0.037-0.040=-0.003
min0.800-0.809=-0.009
max0.902-0.907=-0.004

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.543-964.829=-1.285
σ0.025-0.024=0.001
min963.523-964.802=-1.279
max963.585-964.862=-1.277
mean1453.000-1638.000=-185.000
σ0.000
min1453.000-1638.000=-185.000
max1453.000-1638.000=-185.000
mean0.812-0.805=0.008
σ0.044-0.054=-0.010
min0.766-0.727=0.040
max0.858-0.856=0.002
name=cdr_enhanced_4k_loc.art
mean884.853-885.514=-0.661
σ0.005-0.006=-0.001
min884.847-885.505=-0.659
max884.861-885.519=-0.659
mean1453.000-1638.000=-185.000
σ0.000
min1453.000-1638.000=-185.000
max1453.000-1638.000=-185.000
mean0.726-0.687=0.040
σ0.027-0.052=-0.025
min0.679-0.609=0.070
max0.744-0.734=0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.716=-0.010
σ0.002-0.002=0.000
min7.705-7.715=-0.010
max7.711-7.719=-0.008
mean1453.000-1638.000=-185.000
σ0.000
min1453.000-1638.000=-185.000
max1453.000-1638.000=-185.000
mean4.249-3.484=0.765
σ0.073-0.072=0.001
min4.116-3.367=0.749
max4.550-3.851=0.699
name=record_render_large_syntax_err.art
mean7.655-7.665=-0.010
σ0.002-0.002=-0.000
min7.654-7.664=-0.010
max7.658-7.669=-0.011
mean1453.000-1638.000=-185.000
σ0.000
min1453.000-1638.000=-185.000
max1453.000-1638.000=-185.000
mean4.057-3.486=0.571
σ0.312-0.061=0.251
min3.382-3.369=0.013
max4.352-3.690=0.662
name=record_render_success.art
mean2.288-2.291=-0.003
σ0.002
min2.287-2.290=-0.003
max2.291-2.294=-0.003
mean1453.000-1638.000=-185.000
σ0.000
min1453.000-1638.000=-185.000
max1453.000-1638.000=-185.000
mean0.748-0.733=0.015
σ0.026-0.022=0.004
min0.667-0.670=-0.003
max0.937-0.836=0.101
name=record_render_syntax_err.art
mean2.163-2.166=-0.002
σ0.002
min2.163-2.165=-0.002
max2.166-2.169=-0.002
mean1453.000-1638.000=-185.000
σ0.000
min1453.000-1638.000=-185.000
max1453.000-1638.000=-185.000
mean0.708-0.698=0.010
σ0.017-0.017=-0.000
min0.681-0.657=0.024
max0.819-0.780=0.039

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.573-295.471=0.102
σ0.203-0.233=-0.030
min295.441-295.314=0.128
max296.116-296.075=0.041
mean1912.000-1904.000=8.000
σ0.000
min1912.000-1904.000=8.000
max1912.000-1904.000=8.000
mean0.588-0.585=0.002
σ0.028-0.041=-0.012
min0.518-0.507=0.010
max0.616-0.641=-0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.245-285.413=-0.169
σ0.040-0.036=0.003
min285.193-285.368=-0.175
max285.286-285.453=-0.166
mean1453.000-1638.000=-185.000
σ0.000
min1453.000-1638.000=-185.000
max1453.000-1638.000=-185.000
mean0.392-0.389=0.004
σ0.011-0.012=-0.000
min0.380-0.379=0.000
max0.404-0.406=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.155-1295.798=-0.643
σ0.112-0.112=0.000
min1295.074-1295.671=-0.598
max1295.342-1295.930=-0.588
mean1453.000-1638.000=-185.000
σ0.000
min1453.000-1638.000=-185.000
max1453.000-1638.000=-185.000
mean1.973-1.966=0.006
σ0.219-0.190=0.029
min1.797-1.817=-0.021
max2.337-2.282=0.055
iters=5
new-facts=6402
prior-facts=1
mean1538.138-1539.931=-1.793
σ3.973-6.852=-2.879
min1536.239-1536.655=-0.416
max1545.242-1552.182=-6.940
mean1453.000-1638.000=-185.000
σ0.000
min1453.000-1638.000=-185.000
max1453.000-1638.000=-185.000
mean2.334-2.300=0.035
σ0.276-0.243=0.033
min2.077-2.034=0.044
max2.761-2.590=0.171
iters=5
new-facts=6402
prior-facts=6402
mean1857.101-1857.704=-0.603
σ0.054-0.054=-0.000
min1857.049-1857.649=-0.600
max1857.176-1857.779=-0.603
mean1749.000-1772.800=-23.800
σ176.634-130.325=46.308
min1499.000-1638.000=-139.000
max1912.000-1904.000=8.000
mean3.054-3.046=0.008
σ0.274-0.241=0.033
min2.863-2.851=0.012
max3.529-3.453=0.077

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.756-1.352=0.404
σ0.179-0.274=-0.094
min1.445-1.103=0.341
max1.906-1.822=0.085

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.611-445.739=-2.128
σ577.065-580.935=-3.870
min155.077-155.269=-0.192
max1309.208-1317.141=-7.933
mean96.250
σ8.500
min92.000
max109.000
mean1453.000-1638.000=-185.000
σ0.000
min1453.000-1638.000=-185.000
max1453.000-1638.000=-185.000
mean0.539-0.542=-0.003
σ0.560-0.568=-0.008
min0.257-0.257=0.000
max1.379-1.393=-0.014
policies=20
mean1551.052-1552.977=-1.925
σ0.342-0.319=0.022
min1550.820-1552.749=-1.929
max1551.560-1553.450=-1.890
mean920.000
σ0.000
min920.000
max920.000
mean1453.000-1638.000=-185.000
σ0.000
min1453.000-1638.000=-185.000
max1453.000-1638.000=-185.000
mean2.608-2.577=0.032
σ0.040-0.016=0.024
min2.580-2.565=0.015
max2.667-2.600=0.067
policies=200
mean15518.511-15537.936=-19.425
σ0.070-0.067=0.002
min15518.449-15537.845=-19.396
max15518.606-15538.000=-19.394
mean9200.000
σ0.000
min9200.000
max9200.000
mean1453.000-1638.000=-185.000
σ0.000
min1453.000-1638.000=-185.000
max1453.000-1638.000=-185.000
mean26.174-26.085=0.089
σ0.125-0.115=0.010
min26.042-25.967=0.074
max26.287-26.219=0.069