Compare commits

Home / Compare b25c2f38 .. 5c9ccdf0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.016=-0.001
σ0.370-0.369=0.001
min53.872-53.874=-0.001
max55.067-55.065=0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.141-0.141=-0.001
σ0.004-0.004=0.000
min0.136-0.137=-0.001
max0.146-0.148=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.321-43.322=-0.001
σ0.006-0.008=-0.001
min43.313-43.312=0.001
max43.335-43.338=-0.003
mean415.000
σ0.000
min415.000
max415.000
mean0.122-0.122=0.000
σ0.004-0.004=-0.000
min0.119-0.118=0.001
max0.128-0.130=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.306-1006.310=-0.004
σ1.223-1.175=0.047
min1005.777-1005.757=0.020
max1011.440-1011.236=0.204
mean1047.700-1046.750=0.950
σ305.196-313.149=-7.953
min593.000-596.000=-3.000
max1640.000-1643.000=-3.000
mean1.572-1.542=0.030
σ0.111-0.079=0.032
min1.504-1.463=0.041
max1.986-1.778=0.209

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1640.000-1643.000=-3.000
σ0.000
min1640.000-1643.000=-3.000
max1640.000-1643.000=-3.000
mean0.411-0.402=0.009
σ0.144-0.129=0.015
min0.325-0.321=0.003
max0.666-0.632=0.034
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1640.000-1643.000=-3.000
σ0.000
min1640.000-1643.000=-3.000
max1640.000-1643.000=-3.000
mean0.893-0.881=0.012
σ0.094-0.089=0.006
min0.823-0.820=0.004
max1.057-1.035=0.022
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1640.000-1643.000=-3.000
σ0.000
min1640.000-1643.000=-3.000
max1640.000-1643.000=-3.000
mean0.543-0.540=0.002
σ0.057-0.046=0.011
min0.500-0.502=-0.001
max0.640-0.618=0.022
name=nested_use.art
mean2.360-2.360=0.000
σ0.002-0.002=-0.000
min2.359
max2.363
mean1640.000-1643.000=-3.000
σ0.000
min1640.000-1643.000=-3.000
max1640.000-1643.000=-3.000
mean0.849-0.828=0.021
σ0.049-0.042=0.007
min0.797-0.787=0.010
max0.923-0.894=0.030

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.113=0.002
σ0.033-0.032=0.002
min964.087-964.086=0.001
max964.170-964.165=0.005
mean1640.000-1643.000=-3.000
σ0.000
min1640.000-1643.000=-3.000
max1640.000-1643.000=-3.000
mean0.818-0.843=-0.026
σ0.059-0.019=0.040
min0.728-0.812=-0.084
max0.862-0.857=0.005
name=cdr_enhanced_4k_loc.art
mean884.712-884.711=0.001
σ0.008-0.004=0.003
min884.705-884.705=0.000
max884.723-884.715=0.008
mean1640.000-1643.000=-3.000
σ0.000
min1640.000-1643.000=-3.000
max1640.000-1643.000=-3.000
mean0.710-0.706=0.004
σ0.035-0.041=-0.007
min0.653-0.659=-0.005
max0.738-0.738=-0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.721=-0.004
mean1640.000-1643.000=-3.000
σ0.000
min1640.000-1643.000=-3.000
max1640.000-1643.000=-3.000
mean4.213-4.243=-0.031
σ0.086-0.094=-0.008
min4.058-4.092=-0.034
max4.737-4.576=0.161
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.666
mean1640.000-1643.000=-3.000
σ0.000
min1640.000-1643.000=-3.000
max1640.000-1643.000=-3.000
mean4.194-4.224=-0.030
σ0.075-0.079=-0.004
min4.067-4.096=-0.029
max4.449-4.511=-0.061
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1640.000-1643.000=-3.000
σ0.000
min1640.000-1643.000=-3.000
max1640.000-1643.000=-3.000
mean0.731-0.730=0.000
σ0.018-0.018=0.000
min0.704-0.698=0.005
max0.852-0.851=0.001
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1640.000-1643.000=-3.000
σ0.000
min1640.000-1643.000=-3.000
max1640.000-1643.000=-3.000
mean0.700-0.694=0.006
σ0.015-0.017=-0.002
min0.672-0.665=0.007
max0.788-0.789=-0.001

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.180-296.237=-0.057
σ0.217-0.198=0.019
min296.051-296.000=0.051
max296.778-296.745=0.033
mean1901.000-1973.000=-72.000
σ0.000
min1901.000-1973.000=-72.000
max1901.000-1973.000=-72.000
mean0.588-0.588=0.000
σ0.042-0.051=-0.009
min0.513-0.511=0.002
max0.673-0.697=-0.023

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.689-284.700=-0.010
σ0.035-0.029=0.006
min284.641-284.666=-0.024
max284.728-284.736=-0.008
mean1640.000-1643.000=-3.000
σ0.000
min1640.000-1643.000=-3.000
max1640.000-1643.000=-3.000
mean0.396-0.397=-0.002
σ0.011-0.008=0.003
min0.383-0.387=-0.004
max0.404-0.403=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.077-1295.057=0.020
σ0.110-0.080=0.029
min1294.960-1294.951=0.009
max1295.215-1295.152=0.063
mean1640.000-1643.000=-3.000
σ0.000
min1640.000-1643.000=-3.000
max1640.000-1643.000=-3.000
mean1.918-1.965=-0.047
σ0.100-0.216=-0.115
min1.812-1.805=0.007
max2.039-2.322=-0.283
iters=5
new-facts=6402
prior-facts=1
mean1539.187-1539.186=0.001
σ6.848-6.846=0.003
min1535.941-1535.949=-0.008
max1551.435-1551.429=0.006
mean1640.000-1643.000=-3.000
σ0.000
min1640.000-1643.000=-3.000
max1640.000-1643.000=-3.000
mean2.252-2.308=-0.055
σ0.255-0.265=-0.009
min2.045-2.011=0.034
max2.621-2.651=-0.030
iters=5
new-facts=6402
prior-facts=6402
mean1856.988-1856.998=-0.011
σ0.051-0.065=-0.014
min1856.944-1856.922=0.022
max1857.068-1857.061=0.007
mean1769.600-1799.400=-29.800
σ128.910-166.117=-37.207
min1640.000-1643.000=-3.000
max1901.000-1973.000=-72.000
mean3.056-2.978=0.078
σ0.276-0.182=0.094
min2.837-2.831=0.006
max3.538-3.204=0.334

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.191-1.256=-0.066
σ0.285-0.324=-0.039
min0.934-1.050=-0.115
max1.659-1.808=-0.149

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.784-447.783=0.001
σ581.212-581.212=0.000
min157.177-157.176=0.001
max1319.603-1319.602=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1640.000-1643.000=-3.000
σ0.000
min1640.000-1643.000=-3.000
max1640.000-1643.000=-3.000
mean0.536-0.540=-0.004
σ0.560-0.559=0.000
min0.253-0.258=-0.005
max1.375-1.379=-0.004
policies=20
mean1572.083-1572.078=0.006
σ0.356-0.359=-0.003
min1571.844-1571.834=0.010
max1572.613-1572.611=0.002
mean920.000
σ0.000
min920.000
max920.000
mean1640.000-1643.000=-3.000
σ0.000
min1640.000-1643.000=-3.000
max1640.000-1643.000=-3.000
mean2.629-2.622=0.007
σ0.025-0.014=0.011
min2.601-2.605=-0.004
max2.661-2.635=0.027
policies=200
mean15728.982-15729.025=-0.042
σ0.141-0.163=-0.022
min15728.829-15728.892=-0.063
max15729.169-15729.253=-0.084
mean9200.000
σ0.000
min9200.000
max9200.000
mean1640.000-1643.000=-3.000
σ0.000
min1640.000-1643.000=-3.000
max1640.000-1643.000=-3.000
mean26.537-26.540=-0.003
σ0.027-0.047=-0.020
min26.497-26.482=0.016
max26.559-26.588=-0.028