Compare commits

Home / Compare 6542d56e .. 86ad7fe7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.015=-0.000
σ0.370-0.368=0.002
min53.872-53.866=0.006
max55.067-55.063=0.004
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.141-0.139=0.001
σ0.004-0.004=0.001
min0.136-0.135=0.001
max0.146-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.321-43.322=-0.001
σ0.006-0.006=0.000
min43.313-43.315=-0.001
max43.335-43.331=0.004
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.122-0.121=0.002
σ0.004-0.004=-0.000
min0.119-0.115=0.004
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.306-1006.310=-0.003
σ1.223-1.192=0.031
min1005.777-1005.771=0.005
max1011.440-1011.302=0.138
mean1047.700-1047.850=-0.150
σ305.196-315.273=-10.077
min593.000-549.000=44.000
max1640.000-1529.000=111.000
mean1.572-1.573=-0.000
σ0.111-0.089=0.021
min1.504-1.482=0.022
max1.986-1.813=0.173

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1640.000-1529.000=111.000
σ0.000
min1640.000-1529.000=111.000
max1640.000-1529.000=111.000
mean0.411-0.409=0.003
σ0.144-0.131=0.013
min0.325-0.328=-0.004
max0.666-0.640=0.026
name=error_case.art
mean2.337-2.339=-0.001
σ0.003-0.003=-0.001
min2.336
max2.341-2.343=-0.002
mean1640.000-1529.000=111.000
σ0.000
min1640.000-1529.000=111.000
max1640.000-1529.000=111.000
mean0.893-0.881=0.012
σ0.094-0.092=0.003
min0.823-0.818=0.005
max1.057-1.042=0.015
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1640.000-1529.000=111.000
σ0.000
min1640.000-1529.000=111.000
max1640.000-1529.000=111.000
mean0.543-0.542=0.001
σ0.057-0.056=0.001
min0.500-0.497=0.003
max0.640-0.635=0.005
name=nested_use.art
mean2.360-2.361=-0.001
σ0.002-0.002=-0.001
min2.359
max2.363-2.365=-0.002
mean1640.000-1529.000=111.000
σ0.000
min1640.000-1529.000=111.000
max1640.000-1529.000=111.000
mean0.849-0.847=0.001
σ0.049-0.033=0.016
min0.797-0.823=-0.027
max0.923-0.901=0.022

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.102=0.013
σ0.033-0.034=-0.001
min964.087-964.077=0.010
max964.170-964.162=0.008
mean1640.000-1529.000=111.000
σ0.000
min1640.000-1529.000=111.000
max1640.000-1529.000=111.000
mean0.818-0.838=-0.020
σ0.059-0.024=0.035
min0.728-0.811=-0.083
max0.862-0.859=0.003
name=cdr_enhanced_4k_loc.art
mean884.712-884.710=0.002
σ0.008-0.006=0.002
min884.705-884.703=0.001
max884.723-884.717=0.006
mean1640.000-1529.000=111.000
σ0.000
min1640.000-1529.000=111.000
max1640.000-1529.000=111.000
mean0.710-0.706=0.004
σ0.035-0.032=0.003
min0.653-0.666=-0.012
max0.738-0.740=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.720=-0.003
mean1640.000-1529.000=111.000
σ0.000
min1640.000-1529.000=111.000
max1640.000-1529.000=111.000
mean4.213-4.238=-0.026
σ0.086-0.081=0.005
min4.058-4.036=0.022
max4.737-4.462=0.275
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.666
mean1640.000-1529.000=111.000
σ0.000
min1640.000-1529.000=111.000
max1640.000-1529.000=111.000
mean4.194-3.580=0.615
σ0.075-0.159=-0.084
min4.067-3.345=0.722
max4.449-4.289=0.160
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1640.000-1529.000=111.000
σ0.000
min1640.000-1529.000=111.000
max1640.000-1529.000=111.000
mean0.731-0.734=-0.003
σ0.018-0.016=0.003
min0.704-0.701=0.003
max0.852-0.835=0.017
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1640.000-1529.000=111.000
σ0.000
min1640.000-1529.000=111.000
max1640.000-1529.000=111.000
mean0.700-0.698=0.002
σ0.015-0.016=-0.001
min0.672-0.669=0.003
max0.788-0.771=0.017

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.180-296.238=-0.058
σ0.217-0.225=-0.008
min296.051-296.059=-0.007
max296.778-296.822=-0.044
mean1901.000-1922.000=-21.000
σ0.000
min1901.000-1922.000=-21.000
max1901.000-1922.000=-21.000
mean0.588-0.572=0.016
σ0.042-0.056=-0.015
min0.513-0.500=0.013
max0.673-0.688=-0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.689-284.701=-0.011
σ0.035-0.025=0.011
min284.641-284.671=-0.030
max284.728-284.727=0.000
mean1640.000-1529.000=111.000
σ0.000
min1640.000-1529.000=111.000
max1640.000-1529.000=111.000
mean0.396-0.396=-0.000
σ0.011-0.010=0.001
min0.383-0.385=-0.002
max0.404-0.405=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.077-1295.092=-0.016
σ0.110-0.121=-0.012
min1294.960-1294.963=-0.003
max1295.215-1295.258=-0.043
mean1640.000-1529.000=111.000
σ0.000
min1640.000-1529.000=111.000
max1640.000-1529.000=111.000
mean1.918-1.893=0.025
σ0.100-0.081=0.019
min1.812-1.810=0.002
max2.039-1.993=0.045
iters=5
new-facts=6402
prior-facts=1
mean1539.187-1539.183=0.004
σ6.848-6.837=0.012
min1535.941-1535.863=0.078
max1551.435-1551.407=0.027
mean1640.000-1529.000=111.000
σ0.000
min1640.000-1529.000=111.000
max1640.000-1529.000=111.000
mean2.252-2.270=-0.018
σ0.255-0.209=0.046
min2.045-2.030=0.015
max2.621-2.515=0.105
iters=5
new-facts=6402
prior-facts=6402
mean1856.988-1856.985=0.002
σ0.051-0.059=-0.008
min1856.944-1856.929=0.015
max1857.068-1857.069=-0.001
mean1769.600-1756.800=12.800
σ128.910-171.522=-42.612
min1640.000-1529.000=111.000
max1901.000-1922.000=-21.000
mean3.056-3.059=-0.003
σ0.276-0.306=-0.029
min2.837-2.834=0.002
max3.538-3.594=-0.056

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.191-1.629=-0.439
σ0.285-0.265=0.020
min0.934-1.261=-0.326
max1.659-1.911=-0.251

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.784-447.785=-0.001
σ581.212-581.213=-0.000
min157.177-157.175=0.002
max1319.603-1319.604=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1640.000-1529.000=111.000
σ0.000
min1640.000-1529.000=111.000
max1640.000-1529.000=111.000
mean0.536-0.529=0.006
σ0.560-0.538=0.021
min0.253-0.258=-0.005
max1.375-1.337=0.038
policies=20
mean1572.083-1572.107=-0.024
σ0.356-0.364=-0.008
min1571.844-1571.859=-0.015
max1572.613-1572.648=-0.035
mean920.000
σ0.000
min920.000
max920.000
mean1640.000-1529.000=111.000
σ0.000
min1640.000-1529.000=111.000
max1640.000-1529.000=111.000
mean2.629-2.641=-0.013
σ0.025-0.036=-0.012
min2.601-2.610=-0.009
max2.661-2.680=-0.018
policies=200
mean15728.982-15729.022=-0.040
σ0.141-0.070=0.071
min15728.829-15728.960=-0.131
max15729.169-15729.122=0.047
mean9200.000
σ0.000
min9200.000
max9200.000
mean1640.000-1529.000=111.000
σ0.000
min1640.000-1529.000=111.000
max1640.000-1529.000=111.000
mean26.537-26.444=0.093
σ0.027-0.076=-0.048
min26.497-26.334=0.164
max26.559-26.505=0.054