Compare commits

Home / Compare 3f8e9fcd .. 820b698d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015
σ0.369-0.370=-0.001
min53.867-53.872=-0.005
max55.064-55.067=-0.002
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.139-0.141=-0.002
σ0.003-0.004=-0.002
min0.136-0.136=-0.000
max0.145-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.323-43.321=0.001
σ0.007-0.006=0.001
min43.313-43.313=0.000
max43.335-43.335=0.000
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.124-0.122=0.002
σ0.004-0.004=0.000
min0.120-0.119=0.001
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.305-1006.306=-0.002
σ1.198-1.223=-0.025
min1005.771-1005.777=-0.005
max1011.336-1011.440=-0.104
mean1047.550-1047.700=-0.150
σ305.266-305.196=0.070
min587.000-593.000=-6.000
max1638.000-1640.000=-2.000
mean1.558-1.572=-0.014
σ0.070-0.111=-0.040
min1.492-1.504=-0.012
max1.746-1.986=-0.240

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1638.000-1640.000=-2.000
σ0.000
min1638.000-1640.000=-2.000
max1638.000-1640.000=-2.000
mean0.396-0.411=-0.015
σ0.103-0.144=-0.041
min0.337-0.325=0.013
max0.578-0.666=-0.088
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1638.000-1640.000=-2.000
σ0.000
min1638.000-1640.000=-2.000
max1638.000-1640.000=-2.000
mean0.893-0.893=0.000
σ0.086-0.094=-0.008
min0.837-0.823=0.014
max1.045-1.057=-0.013
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1638.000-1640.000=-2.000
σ0.000
min1638.000-1640.000=-2.000
max1638.000-1640.000=-2.000
mean0.545-0.543=0.003
σ0.047-0.057=-0.010
min0.504-0.500=0.004
max0.621-0.640=-0.019
name=nested_use.art
mean2.360-2.360=-0.000
σ0.002-0.002=0.000
min2.359
max2.363
mean1638.000-1640.000=-2.000
σ0.000
min1638.000-1640.000=-2.000
max1638.000-1640.000=-2.000
mean0.849-0.849=0.000
σ0.036-0.049=-0.013
min0.825-0.797=0.028
max0.912-0.923=-0.011

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.115=-0.000
σ0.032-0.033=-0.001
min964.087-964.087=0.000
max964.167-964.170=-0.003
mean1638.000-1640.000=-2.000
σ0.000
min1638.000-1640.000=-2.000
max1638.000-1640.000=-2.000
mean0.838-0.818=0.021
σ0.027-0.059=-0.032
min0.791-0.728=0.064
max0.858-0.862=-0.004
name=cdr_enhanced_4k_loc.art
mean884.711-884.712=-0.001
σ0.007-0.008=-0.001
min884.705-884.705=-0.000
max884.721-884.723=-0.002
mean1638.000-1640.000=-2.000
σ0.000
min1638.000-1640.000=-2.000
max1638.000-1640.000=-2.000
mean0.706-0.710=-0.004
σ0.042-0.035=0.007
min0.663-0.653=0.010
max0.759-0.738=0.021

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.722-7.718=0.004
mean1638.000-1640.000=-2.000
σ0.000
min1638.000-1640.000=-2.000
max1638.000-1640.000=-2.000
mean4.246-4.213=0.033
σ0.090-0.086=0.004
min4.117-4.058=0.059
max4.611-4.737=-0.126
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666
mean1638.000-1640.000=-2.000
σ0.000
min1638.000-1640.000=-2.000
max1638.000-1640.000=-2.000
mean4.244-4.194=0.050
σ0.077-0.075=0.003
min4.132-4.067=0.065
max4.525-4.449=0.076
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1638.000-1640.000=-2.000
σ0.000
min1638.000-1640.000=-2.000
max1638.000-1640.000=-2.000
mean0.743-0.731=0.012
σ0.027-0.018=0.009
min0.533-0.704=-0.171
max0.824-0.852=-0.028
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1638.000-1640.000=-2.000
σ0.000
min1638.000-1640.000=-2.000
max1638.000-1640.000=-2.000
mean0.698-0.700=-0.003
σ0.014-0.015=-0.000
min0.670-0.672=-0.003
max0.784-0.788=-0.004

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.273-296.180=0.093
σ0.220-0.217=0.003
min296.125-296.051=0.073
max296.875-296.778=0.098
mean1907.000-1901.000=6.000
σ0.000
min1907.000-1901.000=6.000
max1907.000-1901.000=6.000
mean0.597-0.588=0.009
σ0.024-0.042=-0.018
min0.563-0.513=0.050
max0.654-0.673=-0.019

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.697-284.689=0.008
σ0.035-0.035=0.000
min284.656-284.641=0.014
max284.738-284.728=0.010
mean1638.000-1640.000=-2.000
σ0.000
min1638.000-1640.000=-2.000
max1638.000-1640.000=-2.000
mean0.396-0.396=0.000
σ0.011-0.011=0.000
min0.384-0.383=0.001
max0.405-0.404=0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.080-1295.077=0.003
σ0.109-0.110=-0.001
min1294.961-1294.960=0.001
max1295.214-1295.215=-0.001
mean1638.000-1640.000=-2.000
σ0.000
min1638.000-1640.000=-2.000
max1638.000-1640.000=-2.000
mean1.909-1.918=-0.009
σ0.083-0.100=-0.017
min1.816-1.812=0.004
max2.002-2.039=-0.037
iters=5
new-facts=6402
prior-facts=1
mean1539.190-1539.187=0.002
σ6.865-6.848=0.017
min1535.936-1535.941=-0.005
max1551.466-1551.435=0.031
mean1638.000-1640.000=-2.000
σ0.000
min1638.000-1640.000=-2.000
max1638.000-1640.000=-2.000
mean2.274-2.252=0.022
σ0.247-0.255=-0.008
min2.027-2.045=-0.018
max2.542-2.621=-0.079
iters=5
new-facts=6402
prior-facts=6402
mean1856.991-1856.988=0.003
σ0.056-0.051=0.005
min1856.925-1856.944=-0.018
max1857.067-1857.068=-0.001
mean1775.200-1769.600=5.600
σ131.336-128.910=2.426
min1638.000-1640.000=-2.000
max1907.000-1901.000=6.000
mean3.093-3.056=0.037
σ0.423-0.276=0.147
min2.763-2.837=-0.073
max3.826-3.538=0.288

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.241-1.191=0.051
σ0.326-0.285=0.040
min0.931-0.934=-0.003
max1.717-1.659=0.058

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.784=0.002
σ581.212-581.212=0.000
min157.178-157.177=0.001
max1319.605-1319.603=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1638.000-1640.000=-2.000
σ0.000
min1638.000-1640.000=-2.000
max1638.000-1640.000=-2.000
mean0.540-0.536=0.004
σ0.556-0.560=-0.003
min0.259-0.253=0.006
max1.374-1.375=-0.001
policies=20
mean1572.088-1572.083=0.005
σ0.342-0.356=-0.015
min1571.867-1571.844=0.023
max1572.598-1572.613=-0.015
mean920.000
σ0.000
min920.000
max920.000
mean1638.000-1640.000=-2.000
σ0.000
min1638.000-1640.000=-2.000
max1638.000-1640.000=-2.000
mean2.627-2.629=-0.002
σ0.022-0.025=-0.003
min2.611-2.601=0.010
max2.658-2.661=-0.003
policies=200
mean15728.995-15728.982=0.013
σ0.189-0.141=0.048
min15728.834-15728.829=0.004
max15729.260-15729.169=0.091
mean9200.000
σ0.000
min9200.000
max9200.000
mean1638.000-1640.000=-2.000
σ0.000
min1638.000-1640.000=-2.000
max1638.000-1640.000=-2.000
mean26.452-26.537=-0.085
σ0.011-0.027=-0.017
min26.440-26.497=-0.058
max26.465-26.559=-0.094