Compare commits

Home / Compare 9423f85f .. 076c1d7a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.017=-0.003
σ0.370-0.371=-0.001
min53.867-53.878=-0.011
max55.067-55.073=-0.006
mean419.000-418.000=1.000
σ0.000
min419.000-418.000=1.000
max419.000-418.000=1.000
mean0.135-0.151=-0.016
σ0.006-0.012=-0.006
min0.129-0.133=-0.004
max0.145-0.171=-0.026
cache=y
dps=1
iters=10
policies=100
mean43.322-43.326=-0.004
σ0.006-0.007=-0.000
min43.312-43.318=-0.006
max43.335-43.336=-0.001
mean419.000-418.000=1.000
σ0.000
min419.000-418.000=1.000
max419.000-418.000=1.000
mean0.121-0.134=-0.012
σ0.004-0.011=-0.007
min0.116-0.115=0.001
max0.128-0.146=-0.018

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1006.310=-0.002
σ1.194-1.202=-0.008
min1005.771-1005.778=-0.007
max1011.314-1011.341=-0.027
mean1054.950-1048.100=6.850
σ307.284-312.147=-4.863
min588.000-600.000=-12.000
max1647.000-1636.000=11.000
mean1.571-1.597=-0.026
σ0.085-0.099=-0.014
min1.492-1.504=-0.012
max1.771-1.814=-0.043

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1647.000-1636.000=11.000
σ0.000
min1647.000-1636.000=11.000
max1647.000-1636.000=11.000
mean0.422-0.407=0.015
σ0.119-0.133=-0.014
min0.331-0.334=-0.003
max0.621-0.644=-0.023
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1647.000-1636.000=11.000
σ0.000
min1647.000-1636.000=11.000
max1647.000-1636.000=11.000
mean0.873-0.878=-0.005
σ0.098-0.092=0.006
min0.814-0.821=-0.008
max1.046-1.040=0.005
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1647.000-1636.000=11.000
σ0.000
min1647.000-1636.000=11.000
max1647.000-1636.000=11.000
mean0.535-0.543=-0.008
σ0.057-0.056=0.002
min0.496-0.498=-0.002
max0.628-0.639=-0.011
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1647.000-1636.000=11.000
σ0.000
min1647.000-1636.000=11.000
max1647.000-1636.000=11.000
mean0.824-0.841=-0.017
σ0.048-0.035=0.013
min0.777-0.812=-0.034
max0.900-0.898=0.003

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.115=-0.001
σ0.020-0.033=-0.012
min964.094-964.088=0.006
max964.146-964.168=-0.023
mean1647.000-1636.000=11.000
σ0.000
min1647.000-1636.000=11.000
max1647.000-1636.000=11.000
mean0.849-0.818=0.031
σ0.012-0.032=-0.020
min0.834-0.783=0.051
max0.858-0.852=0.006
name=cdr_enhanced_4k_loc.art
mean884.711-884.711=-0.001
σ0.007-0.008=-0.001
min884.703
max884.718-884.722=-0.004
mean1647.000-1636.000=11.000
σ0.000
min1647.000-1636.000=11.000
max1647.000-1636.000=11.000
mean0.663-0.715=-0.052
σ0.006-0.030=-0.024
min0.654-0.676=-0.021
max0.671-0.743=-0.072

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.714-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.718=-0.000
mean1647.000-1636.000=11.000
σ0.000
min1647.000-1636.000=11.000
max1647.000-1636.000=11.000
mean3.480-4.242=-0.762
σ0.082-0.081=0.001
min3.344-4.120=-0.775
max3.751-4.581=-0.829
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.669-7.666=0.003
mean1647.000-1636.000=11.000
σ0.000
min1647.000-1636.000=11.000
max1647.000-1636.000=11.000
mean4.152-4.230=-0.078
σ0.257-0.071=0.186
min3.370-4.102=-0.732
max5.462-4.464=0.999
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1647.000-1636.000=11.000
σ0.000
min1647.000-1636.000=11.000
max1647.000-1636.000=11.000
mean0.735-0.738=-0.003
σ0.023-0.018=0.005
min0.701-0.709=-0.008
max0.877-0.855=0.022
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1647.000-1636.000=11.000
σ0.000
min1647.000-1636.000=11.000
max1647.000-1636.000=11.000
mean0.692-0.694=-0.002
σ0.022-0.016=0.005
min0.651-0.668=-0.018
max0.799-0.775=0.024

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.000-296.325=-0.325
σ0.228-0.197=0.031
min295.755-296.132=-0.376
max296.546-296.840=-0.294
mean1908.000-1904.000=4.000
σ0.000
min1908.000-1904.000=4.000
max1908.000-1904.000=4.000
mean0.578-0.593=-0.015
σ0.052-0.045=0.007
min0.495-0.508=-0.014
max0.699-0.692=0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.697-284.694=0.004
σ0.037-0.036=0.001
min284.645-284.644=0.000
max284.734-284.734=-0.000
mean1647.000-1636.000=11.000
σ0.000
min1647.000-1636.000=11.000
max1647.000-1636.000=11.000
mean0.394-0.396=-0.001
σ0.008-0.010=-0.001
min0.387-0.384=0.003
max0.408-0.404=0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.094-1295.083=0.010
σ0.122-0.112=0.010
min1294.966-1294.960=0.006
max1295.257-1295.223=0.034
mean1647.000-1636.000=11.000
σ0.000
min1647.000-1636.000=11.000
max1647.000-1636.000=11.000
mean1.873-1.900=-0.027
σ0.055-0.065=-0.010
min1.823-1.818=0.005
max1.951-1.970=-0.019
iters=5
new-facts=6402
prior-facts=1
mean1539.183-1539.185=-0.002
σ6.839-6.838=0.001
min1535.931-1535.966=-0.035
max1551.414-1551.414=0.000
mean1647.000-1636.000=11.000
σ0.000
min1647.000-1636.000=11.000
max1647.000-1636.000=11.000
mean2.241-2.201=0.040
σ0.222-0.149=0.072
min2.027-2.040=-0.013
max2.543-2.366=0.177
iters=5
new-facts=6402
prior-facts=6402
mean1856.982-1856.989=-0.007
σ0.069-0.054=0.015
min1856.896-1856.934=-0.039
max1857.071-1857.064=0.007
mean1777.200-1771.600=5.600
σ129.540-130.234=-0.693
min1647.000-1636.000=11.000
max1908.000-1904.000=4.000
mean3.061-3.068=-0.007
σ0.265-0.291=-0.026
min2.851-2.824=0.026
max3.519-3.564=-0.045

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.148-1.228=-0.080
σ0.253-0.323=-0.070
min0.941-0.942=-0.001
max1.545-1.768=-0.223

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.787-447.786=0.000
σ581.212-581.212=0.000
min157.179-157.179=0.000
max1319.605-1319.604=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1647.000-1636.000=11.000
σ0.000
min1647.000-1636.000=11.000
max1647.000-1636.000=11.000
mean0.574-0.553=0.021
σ0.625-0.580=0.046
min0.260-0.260=0.000
max1.512-1.422=0.089
policies=20
mean1572.107-1572.106=0.001
σ0.358-0.356=0.003
min1571.865
max1572.640-1572.635=0.005
mean920.000
σ0.000
min920.000
max920.000
mean1647.000-1636.000=11.000
σ0.000
min1647.000-1636.000=11.000
max1647.000-1636.000=11.000
mean2.630-2.632=-0.002
σ0.012-0.014=-0.002
min2.617-2.620=-0.003
max2.645-2.650=-0.005
policies=200
mean15729.018-15729.083=-0.065
σ0.037-0.081=-0.044
min15728.976-15729.016=-0.040
max15729.067-15729.193=-0.126
mean9200.000
σ0.000
min9200.000
max9200.000
mean1647.000-1636.000=11.000
σ0.000
min1647.000-1636.000=11.000
max1647.000-1636.000=11.000
mean26.620-26.640=-0.020
σ0.240-0.088=0.151
min26.466-26.568=-0.102
max26.973-26.768=0.205