Compare commits

Home / Compare 46278566 .. ac6305de

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.054=0.002
σ0.370-0.367=0.003
min53.916-53.916=0.000
max55.109-55.098=0.011
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.142-0.140=0.002
σ0.004-0.004=0.001
min0.138-0.137=0.002
max0.149-0.146=0.003
cache=y
dps=1
iters=10
policies=100
mean43.392-43.394=-0.002
σ0.006-0.008=-0.002
min43.385-43.385=-0.000
max43.402-43.411=-0.009
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.122-0.121=0.001
σ0.004-0.004=-0.000
min0.119-0.115=0.004
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.002-1007.004=-0.002
σ1.197-1.187=0.010
min1006.434-1006.435=-0.001
max1012.019-1011.980=0.039
mean1052.400-1052.250=0.150
σ307.906-305.556=2.349
min577.000-579.000=-2.000
max1645.000-1646.000=-1.000
mean1.551-1.550=0.001
σ0.076-0.094=-0.018
min1.465-1.385=0.080
max1.794-1.844=-0.050

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean0.426-0.433=-0.006
σ0.146-0.153=-0.007
min0.341-0.345=-0.004
max0.685-0.703=-0.017
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean0.889-0.899=-0.010
σ0.100-0.120=-0.020
min0.837-0.824=0.012
max1.067-1.109=-0.042
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean0.544-0.537=0.007
σ0.047-0.058=-0.010
min0.513-0.482=0.031
max0.626-0.629=-0.003
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean0.851-0.850=0.001
σ0.035-0.043=-0.008
min0.815-0.823=-0.007
max0.909-0.923=-0.014

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.837-964.835=0.002
σ0.031-0.032=-0.001
min964.813-964.802=0.011
max964.891-964.885=0.006
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean0.831-0.835=-0.004
σ0.033-0.039=-0.006
min0.786-0.775=0.011
max0.871-0.872=-0.001
name=cdr_enhanced_4k_loc.art
mean885.513-885.512=0.001
σ0.007-0.006=0.001
min885.505
max885.523-885.520=0.003
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean0.719-0.696=0.023
σ0.037-0.065=-0.028
min0.661-0.615=0.045
max0.756-0.753=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.722-7.723=-0.001
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean4.263-3.532=0.732
σ0.100-0.098=0.002
min4.094-3.413=0.681
max4.735-4.136=0.599
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean4.248-3.500=0.748
σ0.078-0.066=0.012
min4.087-3.382=0.705
max4.527-3.755=0.772
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean0.739-0.743=-0.004
σ0.028-0.018=0.010
min0.705-0.710=-0.005
max0.917-0.848=0.069
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean0.695-0.700=-0.005
σ0.015-0.033=-0.018
min0.662-0.522=0.139
max0.755-0.764=-0.009

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.008-296.845=0.163
σ0.181-0.223=-0.042
min296.863-296.636=0.227
max297.490-297.362=0.128
mean1932.000-1909.000=23.000
σ0.000
min1932.000-1909.000=23.000
max1932.000-1909.000=23.000
mean0.579-0.589=-0.010
σ0.048-0.041=0.007
min0.514-0.550=-0.036
max0.666-0.696=-0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.818-286.822=-0.004
σ0.037-0.036=0.001
min286.771-286.776=-0.005
max286.855-286.860=-0.005
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean0.397-0.398=-0.001
σ0.008-0.007=0.001
min0.388-0.390=-0.002
max0.404-0.405=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1297.164-1297.264=-0.100
σ0.073-0.087=-0.014
min1297.091-1297.150=-0.059
max1297.274-1297.375=-0.102
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean1.954-2.207=-0.253
σ0.150-0.033=0.117
min1.803-2.167=-0.364
max2.160-2.252=-0.092
iters=5
new-facts=6402
prior-facts=1
mean1541.355-1541.367=-0.012
σ6.803-6.818=-0.015
min1538.185-1538.194=-0.008
max1553.523-1553.561=-0.038
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean2.265-2.295=-0.030
σ0.253-0.193=0.059
min2.039-2.143=-0.103
max2.681-2.587=0.094
iters=5
new-facts=6402
prior-facts=6402
mean1859.113-1859.115=-0.002
σ0.066-0.065=0.002
min1859.058-1859.028=0.030
max1859.215-1859.190=0.025
mean1782.400-1774.600=7.800
σ144.147-128.893=15.254
min1645.000-1646.000=-1.000
max1932.000-1909.000=23.000
mean2.938-3.139=-0.201
σ0.178-0.321=-0.143
min2.692-2.855=-0.164
max3.156-3.621=-0.465

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.266-1.315=-0.049
σ0.335-0.303=0.032
min0.921-0.937=-0.016
max1.796-1.738=0.058

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.820=0.000
σ581.372-581.372=-0.000
min158.133-158.133=0.000
max1320.879-1320.879=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean0.528-0.561=-0.033
σ0.515-0.578=-0.063
min0.270-0.269=0.001
max1.301-1.428=-0.128
policies=20
mean1581.619-1581.613=0.006
σ0.369-0.362=0.007
min1581.369-1581.369=-0.000
max1582.168-1582.151=0.017
mean920.000
σ0.000
min920.000
max920.000
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean2.649-2.647=0.002
σ0.018-0.020=-0.002
min2.626-2.618=0.008
max2.668-2.664=0.004
policies=200
mean15824.255-15824.213=0.042
σ0.136-0.131=0.006
min15824.118-15824.061=0.058
max15824.404-15824.376=0.028
mean9200.000
σ0.000
min9200.000
max9200.000
mean1645.000-1646.000=-1.000
σ0.000
min1645.000-1646.000=-1.000
max1645.000-1646.000=-1.000
mean26.755-26.705=0.050
σ0.133-0.043=0.090
min26.659-26.645=0.014
max26.952-26.739=0.212