Compare commits

Home / Compare 29f3c9ec .. 43eb7e69

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.036-54.030=0.006
σ0.368-0.367=0.001
min53.890-53.884=0.005
max55.082-55.074=0.008
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.149-0.135=0.014
σ0.009-0.005=0.004
min0.138-0.129=0.009
max0.162-0.142=0.020
cache=y
dps=1
iters=10
policies=100
mean43.384-43.384=0.000
σ0.005-0.005=0.000
min43.378-43.377=0.001
max43.396-43.393=0.003
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.123-0.121=0.002
σ0.004-0.004=0.000
min0.120-0.114=0.005
max0.130-0.128=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.327-1006.332=-0.005
σ0.911-0.882=0.028
min1005.867-1005.851=0.016
max1010.118-1009.989=0.129
mean1053.800-1051.250=2.550
σ305.174-310.062=-4.888
min582.000-554.000=28.000
max1453.000-1644.000=-191.000
mean1.559-1.567=-0.008
σ0.086-0.102=-0.015
min1.477-1.479=-0.002
max1.759-1.848=-0.089

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.002=-0.000
min0.881
max0.886-0.886=-0.000
mean1453.000-1644.000=-191.000
σ0.000
min1453.000-1644.000=-191.000
max1453.000-1644.000=-191.000
mean0.443-0.440=0.003
σ0.181-0.124=0.057
min0.352-0.363=-0.011
max0.766-0.656=0.110
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1453.000-1644.000=-191.000
σ0.000
min1453.000-1644.000=-191.000
max1453.000-1644.000=-191.000
mean0.920-0.878=0.042
σ0.174-0.078=0.096
min0.818-0.822=-0.004
max1.228-1.013=0.214
name=heavy_item.art
mean1.521
σ0.002
min1.520
max1.524
mean1453.000-1644.000=-191.000
σ0.000
min1453.000-1644.000=-191.000
max1453.000-1644.000=-191.000
mean0.540-0.546=-0.006
σ0.047-0.056=-0.008
min0.499-0.504=-0.005
max0.616-0.642=-0.026
name=nested_use.art
mean2.355-2.356=-0.001
σ0.002-0.002=0.000
min2.355
max2.358
mean1453.000-1644.000=-191.000
σ0.000
min1453.000-1644.000=-191.000
max1453.000-1644.000=-191.000
mean0.846-0.842=0.004
σ0.037-0.033=0.004
min0.800-0.807=-0.007
max0.902-0.893=0.009

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.543-963.559=-0.015
σ0.025-0.034=-0.009
min963.523-963.532=-0.009
max963.585-963.617=-0.032
mean1453.000-1644.000=-191.000
σ0.000
min1453.000-1644.000=-191.000
max1453.000-1644.000=-191.000
mean0.812-0.818=-0.006
σ0.044-0.030=0.014
min0.766-0.778=-0.012
max0.858-0.862=-0.004
name=cdr_enhanced_4k_loc.art
mean884.853-884.856=-0.002
σ0.005-0.006=-0.001
min884.847-884.848=-0.001
max884.861-884.863=-0.003
mean1453.000-1644.000=-191.000
σ0.000
min1453.000-1644.000=-191.000
max1453.000-1644.000=-191.000
mean0.726-0.718=0.009
σ0.027-0.021=0.006
min0.679-0.687=-0.008
max0.744-0.738=0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.711-7.709=0.002
mean1453.000-1644.000=-191.000
σ0.000
min1453.000-1644.000=-191.000
max1453.000-1644.000=-191.000
mean4.249-3.574=0.675
σ0.073-0.088=-0.015
min4.116-3.440=0.676
max4.550-3.888=0.661
name=record_render_large_syntax_err.art
mean7.655-7.655=-0.000
σ0.002-0.002=-0.000
min7.654
max7.658-7.659=-0.001
mean1453.000-1644.000=-191.000
σ0.000
min1453.000-1644.000=-191.000
max1453.000-1644.000=-191.000
mean4.057-3.532=0.525
σ0.312-0.072=0.240
min3.382-3.420=-0.038
max4.352-3.795=0.557
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1453.000-1644.000=-191.000
σ0.000
min1453.000-1644.000=-191.000
max1453.000-1644.000=-191.000
mean0.748-0.535=0.214
σ0.026-0.015=0.011
min0.667-0.509=0.158
max0.937-0.627=0.310
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1453.000-1644.000=-191.000
σ0.000
min1453.000-1644.000=-191.000
max1453.000-1644.000=-191.000
mean0.708-0.493=0.214
σ0.017-0.053=-0.037
min0.681-0.283=0.398
max0.819-0.548=0.271

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.573-295.536=0.037
σ0.203-0.188=0.015
min295.441-295.301=0.140
max296.116-296.021=0.095
mean1912.000
σ0.000
min1912.000
max1912.000
mean0.588-0.561=0.026
σ0.028-0.054=-0.025
min0.518-0.498=0.019
max0.616-0.650=-0.034

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.245-285.250=-0.006
σ0.040-0.035=0.005
min285.193-285.206=-0.013
max285.286-285.286=0.001
mean1453.000-1644.000=-191.000
σ0.000
min1453.000-1644.000=-191.000
max1453.000-1644.000=-191.000
mean0.392-0.389=0.004
σ0.011-0.011=0.000
min0.380-0.381=-0.001
max0.404-0.409=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.155-1295.195=-0.040
σ0.112-0.107=0.005
min1295.074-1295.081=-0.007
max1295.342-1295.325=0.017
mean1453.000-1644.000=-191.000
σ0.000
min1453.000-1644.000=-191.000
max1453.000-1644.000=-191.000
mean1.973-1.914=0.059
σ0.219-0.119=0.100
min1.797-1.783=0.013
max2.337-2.087=0.250
iters=5
new-facts=6402
prior-facts=1
mean1538.138-1538.075=0.063
σ3.973-4.009=-0.036
min1536.239-1536.042=0.197
max1545.242-1545.237=0.005
mean1453.000-1644.000=-191.000
σ0.000
min1453.000-1644.000=-191.000
max1453.000-1644.000=-191.000
mean2.334-2.276=0.058
σ0.276-0.212=0.064
min2.077-2.036=0.042
max2.761-2.516=0.245
iters=5
new-facts=6402
prior-facts=6402
mean1857.101-1857.108=-0.007
σ0.054-0.057=-0.003
min1857.049-1857.056=-0.007
max1857.176-1857.189=-0.013
mean1749.000-1779.600=-30.600
σ176.634-131.563=45.071
min1499.000-1644.000=-145.000
max1912.000
mean3.054-3.012=0.043
σ0.274-0.174=0.100
min2.863-2.846=0.017
max3.529-3.302=0.227

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.756-1.272=0.484
σ0.179-0.232=-0.053
min1.445-1.099=0.346
max1.906-1.663=0.243

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.611-443.608=0.003
σ577.065-577.065=0.000
min155.077-155.074=0.003
max1309.208-1309.205=0.003
mean96.250
σ8.500
min92.000
max109.000
mean1453.000-1644.000=-191.000
σ0.000
min1453.000-1644.000=-191.000
max1453.000-1644.000=-191.000
mean0.539-0.537=0.002
σ0.560-0.555=0.005
min0.257-0.257=0.001
max1.379-1.369=0.010
policies=20
mean1551.052-1551.028=0.025
σ0.342-0.351=-0.010
min1550.820-1550.792=0.028
max1551.560-1551.550=0.010
mean920.000
σ0.000
min920.000
max920.000
mean1453.000-1644.000=-191.000
σ0.000
min1453.000-1644.000=-191.000
max1453.000-1644.000=-191.000
mean2.608-2.622=-0.013
σ0.040-0.056=-0.016
min2.580-2.589=-0.009
max2.667-2.705=-0.038
policies=200
mean15518.511-15518.516=-0.005
σ0.070-0.160=-0.090
min15518.449-15518.352=0.097
max15518.606-15518.694=-0.088
mean9200.000
σ0.000
min9200.000
max9200.000
mean1453.000-1644.000=-191.000
σ0.000
min1453.000-1644.000=-191.000
max1453.000-1644.000=-191.000
mean26.174-26.185=-0.011
σ0.125-0.106=0.019
min26.042-26.090=-0.048
max26.287-26.335=-0.048