Compare commits

Home / Compare 1a3b5b53 .. 4cdeda2a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.015=0.000
σ0.370-0.368=0.002
min53.873-53.866=0.007
max55.068-55.063=0.005
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.139-0.139=-0.001
σ0.004-0.004=0.001
min0.132-0.135=-0.003
max0.146-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=0.000
σ0.005-0.006=-0.001
min43.315-43.315=0.001
max43.333-43.331=0.002
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.121-0.121=-0.000
σ0.003-0.004=-0.001
min0.115-0.115=-0.000
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.305-1006.310=-0.005
σ1.181-1.192=-0.011
min1005.768-1005.771=-0.004
max1011.255-1011.302=-0.047
mean1046.150-1047.850=-1.700
σ313.448-315.273=-1.825
min597.000-549.000=48.000
max1644.000-1529.000=115.000
mean1.558-1.573=-0.015
σ0.079-0.089=-0.011
min1.485-1.482=0.004
max1.801-1.813=-0.012

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1644.000-1529.000=115.000
σ0.000
min1644.000-1529.000=115.000
max1644.000-1529.000=115.000
mean0.405-0.409=-0.004
σ0.137-0.131=0.006
min0.320-0.328=-0.008
max0.647-0.640=0.008
name=error_case.art
mean2.337-2.339=-0.001
σ0.003-0.003=-0.001
min2.336
max2.341-2.343=-0.002
mean1644.000-1529.000=115.000
σ0.000
min1644.000-1529.000=115.000
max1644.000-1529.000=115.000
mean0.890-0.881=0.009
σ0.086-0.092=-0.005
min0.831-0.818=0.012
max1.040-1.042=-0.002
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1644.000-1529.000=115.000
σ0.000
min1644.000-1529.000=115.000
max1644.000-1529.000=115.000
mean0.549-0.542=0.007
σ0.045-0.056=-0.011
min0.509-0.497=0.012
max0.622-0.635=-0.013
name=nested_use.art
mean2.360-2.361=-0.001
σ0.002-0.002=-0.001
min2.359
max2.363-2.365=-0.002
mean1644.000-1529.000=115.000
σ0.000
min1644.000-1529.000=115.000
max1644.000-1529.000=115.000
mean0.846-0.847=-0.001
σ0.032-0.033=-0.001
min0.814-0.823=-0.010
max0.894-0.901=-0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.102=0.013
σ0.034-0.034=0.000
min964.086-964.077=0.008
max964.170-964.162=0.009
mean1644.000-1529.000=115.000
σ0.000
min1644.000-1529.000=115.000
max1644.000-1529.000=115.000
mean0.849-0.838=0.011
σ0.005-0.024=-0.019
min0.845-0.811=0.034
max0.857-0.859=-0.002
name=cdr_enhanced_4k_loc.art
mean884.712-884.710=0.002
σ0.008-0.006=0.002
min884.703
max884.722-884.717=0.005
mean1644.000-1529.000=115.000
σ0.000
min1644.000-1529.000=115.000
max1644.000-1529.000=115.000
mean0.702-0.706=-0.004
σ0.036-0.032=0.004
min0.663-0.666=-0.003
max0.736-0.740=-0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=-0.000
min7.714
max7.719-7.720=-0.002
mean1644.000-1529.000=115.000
σ0.000
min1644.000-1529.000=115.000
max1644.000-1529.000=115.000
mean3.505-4.238=-0.733
σ0.092-0.081=0.011
min3.351-4.036=-0.685
max3.808-4.462=-0.654
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1644.000-1529.000=115.000
σ0.000
min1644.000-1529.000=115.000
max1644.000-1529.000=115.000
mean3.784-3.580=0.204
σ0.378-0.159=0.219
min3.298-3.345=-0.048
max4.557-4.289=0.268
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1644.000-1529.000=115.000
σ0.000
min1644.000-1529.000=115.000
max1644.000-1529.000=115.000
mean0.598-0.734=-0.136
σ0.106-0.016=0.090
min0.508-0.701=-0.193
max0.920-0.835=0.085
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1644.000-1529.000=115.000
σ0.000
min1644.000-1529.000=115.000
max1644.000-1529.000=115.000
mean0.496-0.698=-0.203
σ0.012-0.016=-0.003
min0.472-0.669=-0.197
max0.563-0.771=-0.208

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.288-296.238=0.051
σ0.264-0.225=0.039
min296.052-296.059=-0.007
max296.990-296.822=0.168
mean1975.000-1922.000=53.000
σ0.000
min1975.000-1922.000=53.000
max1975.000-1922.000=53.000
mean0.579-0.572=0.008
σ0.047-0.056=-0.010
min0.510-0.500=0.010
max0.666-0.688=-0.022

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.695-284.701=-0.006
σ0.031-0.025=0.007
min284.652-284.671=-0.019
max284.726-284.727=-0.001
mean1644.000-1529.000=115.000
σ0.000
min1644.000-1529.000=115.000
max1644.000-1529.000=115.000
mean0.403-0.396=0.007
σ0.004-0.010=-0.006
min0.396-0.385=0.011
max0.406-0.405=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.055-1295.092=-0.037
σ0.079-0.121=-0.043
min1294.955-1294.963=-0.007
max1295.135-1295.258=-0.123
mean1644.000-1529.000=115.000
σ0.000
min1644.000-1529.000=115.000
max1644.000-1529.000=115.000
mean1.975-1.893=0.082
σ0.278-0.081=0.197
min1.806-1.810=-0.004
max2.463-1.993=0.470
iters=5
new-facts=6402
prior-facts=1
mean1539.212-1539.183=0.029
σ6.866-6.837=0.029
min1535.918-1535.863=0.055
max1551.491-1551.407=0.083
mean1644.000-1529.000=115.000
σ0.000
min1644.000-1529.000=115.000
max1644.000-1529.000=115.000
mean2.230-2.270=-0.040
σ0.181-0.209=-0.028
min2.105-2.030=0.075
max2.550-2.515=0.035
iters=5
new-facts=6402
prior-facts=6402
mean1856.986-1856.985=0.001
σ0.060-0.059=0.001
min1856.930-1856.929=0.001
max1857.068-1857.069=-0.001
mean1800.400-1756.800=43.600
σ166.746-171.522=-4.776
min1644.000-1529.000=115.000
max1975.000-1922.000=53.000
mean2.969-3.059=-0.091
σ0.112-0.306=-0.193
min2.856-2.834=0.022
max3.131-3.594=-0.462

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.214-1.629=-0.415
σ0.401-0.265=0.137
min0.935-1.261=-0.325
max1.892-1.911=-0.018

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.785=0.001
σ581.212-581.213=-0.000
min157.179-157.175=0.003
max1319.605-1319.604=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1644.000-1529.000=115.000
σ0.000
min1644.000-1529.000=115.000
max1644.000-1529.000=115.000
mean0.532-0.529=0.003
σ0.543-0.538=0.005
min0.259-0.258=0.002
max1.347-1.337=0.010
policies=20
mean1572.102-1572.107=-0.005
σ0.352-0.364=-0.012
min1571.864-1571.859=0.006
max1572.625-1572.648=-0.023
mean920.000
σ0.000
min920.000
max920.000
mean1644.000-1529.000=115.000
σ0.000
min1644.000-1529.000=115.000
max1644.000-1529.000=115.000
mean2.625-2.641=-0.016
σ0.018-0.036=-0.018
min2.599-2.610=-0.011
max2.638-2.680=-0.042
policies=200
mean15729.056-15729.022=0.034
σ0.086-0.070=0.017
min15728.998-15728.960=0.038
max15729.184-15729.122=0.062
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000-1529.000=115.000
σ0.000
min1644.000-1529.000=115.000
max1644.000-1529.000=115.000
mean26.553-26.444=0.109
σ0.110-0.076=0.034
min26.450-26.334=0.116
max26.706-26.505=0.201