Compare commits

Home / Compare 7931e7f3 .. 5c586852

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=-0.001
σ0.369-0.369=0.000
min53.910-53.914=-0.004
max55.106-55.105=0.000
mean418.000
σ0.000
min418.000
max418.000
mean0.142-0.140=0.002
σ0.004-0.003=0.001
min0.138-0.137=0.001
max0.149-0.145=0.005
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=0.000
σ0.007-0.006=0.001
min43.383-43.385=-0.002
max43.406-43.403=0.002
mean418.000
σ0.000
min418.000
max418.000
mean0.123-0.119=0.004
σ0.004-0.003=0.001
min0.119-0.115=0.003
max0.131-0.121=0.009

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.000-1007.005=-0.005
σ1.211-1.198=0.013
min1006.442-1006.445=-0.003
max1012.080-1012.028=0.052
mean1053.300-1051.300=2.000
σ306.095-307.917=-1.821
min579.000-576.000=3.000
max1651.000-1644.000=7.000
mean1.551-1.534=0.017
σ0.086-0.083=0.003
min1.472-1.395=0.078
max1.778-1.777=0.000

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1651.000-1644.000=7.000
σ0.000
min1651.000-1644.000=7.000
max1651.000-1644.000=7.000
mean0.433-0.424=0.009
σ0.122-0.150=-0.028
min0.348-0.329=0.019
max0.647-0.690=-0.043
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1651.000-1644.000=7.000
σ0.000
min1651.000-1644.000=7.000
max1651.000-1644.000=7.000
mean0.894-0.895=-0.001
σ0.091-0.101=-0.010
min0.840-0.833=0.007
max1.055-1.071=-0.016
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1651.000-1644.000=7.000
σ0.000
min1651.000-1644.000=7.000
max1651.000-1644.000=7.000
mean0.534-0.528=0.006
σ0.058-0.052=0.006
min0.496-0.487=0.009
max0.635-0.617=0.017
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1651.000-1644.000=7.000
σ0.000
min1651.000-1644.000=7.000
max1651.000-1644.000=7.000
mean0.851-0.845=0.006
σ0.030-0.039=-0.009
min0.830-0.814=0.016
max0.903-0.910=-0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.839=-0.002
σ0.020-0.033=-0.013
min964.819-964.813=0.006
max964.872-964.894=-0.023
mean1651.000-1644.000=7.000
σ0.000
min1651.000-1644.000=7.000
max1651.000-1644.000=7.000
mean0.796-0.820=-0.024
σ0.028-0.064=-0.036
min0.769-0.708=0.061
max0.832-0.860=-0.028
name=cdr_enhanced_4k_loc.art
mean885.514-885.512=0.002
σ0.007-0.007=-0.000
min885.504-885.505=-0.001
max885.523-885.522=0.000
mean1651.000-1644.000=7.000
σ0.000
min1651.000-1644.000=7.000
max1651.000-1644.000=7.000
mean0.706-0.710=-0.004
σ0.040-0.044=-0.004
min0.653-0.634=0.020
max0.736-0.742=-0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.721=-0.001
mean1651.000-1644.000=7.000
σ0.000
min1651.000-1644.000=7.000
max1651.000-1644.000=7.000
mean4.217-4.256=-0.040
σ0.076-0.094=-0.018
min4.094-4.096=-0.002
max4.510-4.728=-0.217
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.669-7.668=0.001
mean1651.000-1644.000=7.000
σ0.000
min1651.000-1644.000=7.000
max1651.000-1644.000=7.000
mean4.198-4.238=-0.040
σ0.080-0.071=0.008
min4.062-4.080=-0.017
max4.564-4.420=0.144
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1651.000-1644.000=7.000
σ0.000
min1651.000-1644.000=7.000
max1651.000-1644.000=7.000
mean0.747-0.751=-0.004
σ0.017-0.019=-0.002
min0.716-0.715=0.002
max0.836-0.837=-0.001
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1651.000-1644.000=7.000
σ0.000
min1651.000-1644.000=7.000
max1651.000-1644.000=7.000
mean0.711-0.716=-0.005
σ0.016-0.018=-0.001
min0.681-0.680=0.002
max0.812-0.790=0.022

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.841-296.947=-0.106
σ0.221-0.224=-0.003
min296.621-296.816=-0.195
max297.399-297.561=-0.162
mean2024.000-1912.000=112.000
σ0.000
min2024.000-1912.000=112.000
max2024.000-1912.000=112.000
mean0.557-0.588=-0.030
σ0.031-0.028=0.003
min0.507-0.539=-0.032
max0.584-0.623=-0.038

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.821-286.819=0.001
σ0.038-0.037=0.001
min286.771-286.775=-0.004
max286.859-286.864=-0.005
mean1651.000-1644.000=7.000
σ0.000
min1651.000-1644.000=7.000
max1651.000-1644.000=7.000
mean0.395-0.397=-0.002
σ0.007-0.004=0.003
min0.388-0.391=-0.003
max0.403-0.402=0.001
iters=5
new-facts=1
prior-facts=6402
mean1297.228-1297.234=-0.006
σ0.075-0.075=-0.001
min1297.163-1297.142=0.020
max1297.328-1297.302=0.027
mean1651.000-1644.000=7.000
σ0.000
min1651.000-1644.000=7.000
max1651.000-1644.000=7.000
mean2.091-2.053=0.037
σ0.093-0.042=0.050
min2.001-2.006=-0.005
max2.209-2.117=0.092
iters=5
new-facts=6402
prior-facts=1
mean1541.352-1541.295=0.057
σ6.822-6.843=-0.021
min1538.164-1538.049=0.115
max1553.552-1553.531=0.022
mean1651.000-1644.000=7.000
σ0.000
min1651.000-1644.000=7.000
max1651.000-1644.000=7.000
mean2.308-2.138=0.171
σ0.249-0.121=0.128
min2.135-1.984=0.151
max2.714-2.288=0.426
iters=5
new-facts=6402
prior-facts=6402
mean1859.115-1859.113=0.003
σ0.074-0.086=-0.012
min1859.008-1858.991=0.018
max1859.187-1859.201=-0.015
mean1788.200-1773.200=15.000
σ161.863-134.226=27.637
min1651.000-1644.000=7.000
max2024.000-1912.000=112.000
mean2.999-3.105=-0.106
σ0.086-0.339=-0.253
min2.867-2.738=0.128
max3.082-3.602=-0.520

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.167-1.227=-0.060
σ0.324-0.348=-0.024
min0.935-0.934=0.001
max1.700-1.814=-0.114

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.819-448.822=-0.002
σ581.372-581.371=0.001
min158.130-158.135=-0.005
max1320.878-1320.879=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1651.000-1644.000=7.000
σ0.000
min1651.000-1644.000=7.000
max1651.000-1644.000=7.000
mean0.529-0.558=-0.029
σ0.530-0.578=-0.048
min0.261-0.268=-0.007
max1.324-1.425=-0.101
policies=20
mean1581.610-1581.633=-0.023
σ0.357-0.365=-0.008
min1581.371-1581.388=-0.018
max1582.142-1582.175=-0.034
mean920.000
σ0.000
min920.000
max920.000
mean1651.000-1644.000=7.000
σ0.000
min1651.000-1644.000=7.000
max1651.000-1644.000=7.000
mean2.630-2.650=-0.020
σ0.015-0.036=-0.022
min2.616-2.611=0.005
max2.648-2.699=-0.051
policies=200
mean15824.233-15824.222=0.012
σ0.122-0.049=0.073
min15824.134-15824.167=-0.033
max15824.398-15824.284=0.113
mean9200.000
σ0.000
min9200.000
max9200.000
mean1651.000-1644.000=7.000
σ0.000
min1651.000-1644.000=7.000
max1651.000-1644.000=7.000
mean26.654-26.626=0.028
σ0.063-0.075=-0.012
min26.592-26.549=0.043
max26.731-26.720=0.011