Compare commits

Home / Compare 96093aa8 .. bde172c1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.055=0.001
σ0.368-0.368=-0.001
min53.914-53.912=0.002
max55.101-55.102=-0.001
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.140-0.141=-0.001
σ0.004-0.004=0.000
min0.137-0.138=-0.001
max0.147-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.392-43.394=-0.002
σ0.006-0.006=0.000
min43.383-43.386=-0.004
max43.404-43.403=0.001
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.118-0.122=-0.004
σ0.005-0.005=0.000
min0.113-0.116=-0.003
max0.130-0.129=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.001-1007.011=-0.009
σ1.193-1.172=0.021
min1006.461-1006.434=0.027
max1012.005-1011.907=0.099
mean1052.200-1057.000=-4.800
σ319.623-306.994=12.629
min590.000-579.000=11.000
max1619.000-1622.000=-3.000
mean1.535-1.525=0.010
σ0.098-0.073=0.025
min1.404-1.402=0.002
max1.856-1.735=0.121

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean0.424-0.422=0.002
σ0.138-0.119=0.019
min0.336-0.352=-0.015
max0.670-0.633=0.037
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean0.933-0.889=0.044
σ0.207-0.089=0.118
min0.820-0.816=0.003
max1.300-1.042=0.258
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean0.535-0.536=-0.000
σ0.044-0.054=-0.010
min0.489-0.484=0.005
max0.604-0.621=-0.017
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean0.851-0.853=-0.002
σ0.032-0.049=-0.016
min0.831-0.814=0.017
max0.908-0.935=-0.027

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.840=-0.000
σ0.034-0.034=0.000
min964.811-964.811=-0.000
max964.895-964.895=-0.000
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean0.798-0.848=-0.050
σ0.029-0.017=0.013
min0.767-0.821=-0.054
max0.836-0.864=-0.028
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.007-0.007=0.000
min885.504
max885.522-885.522=0.000
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean0.741-0.714=0.027
σ0.009-0.026=-0.017
min0.729-0.673=0.056
max0.752-0.738=0.014

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.720=-0.001
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean4.139-4.274=-0.135
σ0.267-0.090=0.177
min3.480-4.141=-0.662
max4.526-4.550=-0.024
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean3.840-4.244=-0.404
σ0.385-0.084=0.301
min3.401-4.110=-0.709
max4.740-4.506=0.234
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean0.743-0.749=-0.006
σ0.018-0.020=-0.002
min0.713-0.664=0.049
max0.862-0.848=0.013
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean0.704-0.705=-0.001
σ0.017-0.015=0.002
min0.662-0.679=-0.018
max0.790-0.788=0.003

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.178-296.854=0.325
σ0.224-0.206=0.018
min297.007-296.649=0.358
max297.780-297.400=0.379
mean2030.000-2031.000=-1.000
σ0.000
min2030.000-2031.000=-1.000
max2030.000-2031.000=-1.000
mean0.549-0.559=-0.010
σ0.034-0.026=0.007
min0.503-0.515=-0.012
max0.601-0.590=0.011

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.815-286.820=-0.005
σ0.042-0.038=0.004
min286.763-286.768=-0.004
max286.860-286.857=0.002
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean0.402-0.398=0.005
σ0.011-0.007=0.005
min0.389-0.389=-0.000
max0.421-0.404=0.017
iters=5
new-facts=1
prior-facts=6402
mean1297.284-1297.237=0.046
σ0.085-0.051=0.034
min1297.191-1297.191=-0.000
max1297.406-1297.294=0.111
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean2.235-2.090=0.144
σ0.076-0.066=0.010
min2.131-2.036=0.095
max2.335-2.201=0.134
iters=5
new-facts=6402
prior-facts=1
mean1541.324-1541.349=-0.025
σ6.839-6.815=0.024
min1538.089-1538.155=-0.067
max1553.555-1553.537=0.018
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean2.187-2.277=-0.090
σ0.140-0.261=-0.122
min2.032-2.067=-0.035
max2.379-2.719=-0.340
iters=5
new-facts=6402
prior-facts=6402
mean1859.119-1859.110=0.008
σ0.060-0.084=-0.025
min1859.033-1858.978=0.054
max1859.186-1859.181=0.005
mean1770.000-1776.200=-6.200
σ177.881-176.893=0.987
min1619.000-1622.000=-3.000
max2030.000-2031.000=-1.000
mean2.922-3.042=-0.119
σ0.070-0.281=-0.211
min2.869-2.804=0.064
max3.041-3.510=-0.469

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.248-1.235=0.013
σ0.362-0.372=-0.010
min0.940-0.938=0.002
max1.860-1.849=0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.822=-0.002
σ581.372-581.372=-0.000
min158.132-158.135=-0.002
max1320.878-1320.880=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean0.559-0.553=0.006
σ0.583-0.573=0.010
min0.261-0.260=0.001
max1.433-1.412=0.021
policies=20
mean1581.616-1581.615=0.002
σ0.373-0.355=0.018
min1581.368-1581.375=-0.007
max1582.171-1582.143=0.028
mean920.000
σ0.000
min920.000
max920.000
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean2.653-2.629=0.023
σ0.047-0.015=0.033
min2.607-2.618=-0.011
max2.717-2.651=0.067
policies=200
mean15824.237-15824.274=-0.037
σ0.140-0.139=0.002
min15824.122-15824.141=-0.019
max15824.414-15824.458=-0.044
mean9200.000
σ0.000
min9200.000
max9200.000
mean1619.000-1622.000=-3.000
σ0.000
min1619.000-1622.000=-3.000
max1619.000-1622.000=-3.000
mean26.555-26.583=-0.027
σ0.053-0.111=-0.058
min26.521-26.492=0.028
max26.632-26.724=-0.091