Compare commits

Home / Compare 8175cff7 .. 56195a1c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.966-53.964=0.002
σ0.369-0.369=-0.000
min53.818-53.825=-0.006
max55.014-55.013=0.001
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.138-0.139=-0.001
σ0.005-0.004=0.001
min0.131-0.135=-0.004
max0.146-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.321-43.322=-0.001
σ0.007-0.006=0.001
min43.314-43.311=0.003
max43.338-43.335=0.003
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.121-0.123=-0.003
σ0.004-0.004=-0.000
min0.114-0.119=-0.004
max0.128-0.130=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.517-1006.517=0.000
σ1.156-1.153=0.004
min1005.948-1005.950=-0.002
max1011.353-1011.333=0.020
mean1038.050-1049.600=-11.550
σ310.154-310.503=-0.349
min548.000-555.000=-7.000
max1505.000-1520.000=-15.000
mean1.513-1.529=-0.016
σ0.058-0.061=-0.002
min1.435-1.394=0.040
max1.628-1.666=-0.038

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1505.000-1520.000=-15.000
σ0.000
min1505.000-1520.000=-15.000
max1505.000-1520.000=-15.000
mean0.423-0.424=-0.001
σ0.145-0.138=0.007
min0.343-0.334=0.009
max0.681-0.667=0.015
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1505.000-1520.000=-15.000
σ0.000
min1505.000-1520.000=-15.000
max1505.000-1520.000=-15.000
mean0.889-0.881=0.008
σ0.111-0.092=0.019
min0.821-0.821=0.001
max1.084-1.042=0.043
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1505.000-1520.000=-15.000
σ0.000
min1505.000-1520.000=-15.000
max1505.000-1520.000=-15.000
mean0.533-0.535=-0.002
σ0.054-0.050=0.004
min0.496-0.493=0.003
max0.621-0.621=-0.000
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1505.000-1520.000=-15.000
σ0.000
min1505.000-1520.000=-15.000
max1505.000-1520.000=-15.000
mean0.848-0.849=-0.002
σ0.039-0.047=-0.008
min0.819-0.820=-0.001
max0.916-0.931=-0.015

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.826-964.831=-0.005
σ0.034-0.039=-0.005
min964.802-964.807=-0.005
max964.886-964.900=-0.014
mean1505.000-1520.000=-15.000
σ0.000
min1505.000-1520.000=-15.000
max1505.000-1520.000=-15.000
mean0.770-0.838=-0.069
σ0.099-0.034=0.064
min0.655-0.791=-0.137
max0.862-0.874=-0.013
name=cdr_enhanced_4k_loc.art
mean885.510-885.510=-0.001
σ0.006-0.005=0.001
min885.504
max885.516-885.517=-0.001
mean1505.000-1520.000=-15.000
σ0.000
min1505.000-1520.000=-15.000
max1505.000-1520.000=-15.000
mean0.684-0.677=0.007
σ0.083-0.043=0.039
min0.538-0.629=-0.090
max0.736-0.726=0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.721=-0.001
mean1505.000-1520.000=-15.000
σ0.000
min1505.000-1520.000=-15.000
max1505.000-1520.000=-15.000
mean4.228-3.566=0.662
σ0.093-0.083=0.010
min4.046-3.408=0.638
max4.614-3.972=0.642
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.668
mean1505.000-1520.000=-15.000
σ0.000
min1505.000-1520.000=-15.000
max1505.000-1520.000=-15.000
mean4.228-3.564=0.665
σ0.081-0.079=0.002
min4.119-3.384=0.735
max4.517-3.819=0.698
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1505.000-1520.000=-15.000
σ0.000
min1505.000-1520.000=-15.000
max1505.000-1520.000=-15.000
mean0.741-0.739=0.003
σ0.016-0.018=-0.002
min0.708-0.704=0.005
max0.823-0.839=-0.016
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1505.000-1520.000=-15.000
σ0.000
min1505.000-1520.000=-15.000
max1505.000-1520.000=-15.000
mean0.699-0.696=0.004
σ0.015-0.015=-0.000
min0.669-0.664=0.005
max0.781-0.773=0.008

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.210-296.383=-0.173
σ0.227-0.177=0.050
min296.047-296.168=-0.122
max296.830-296.727=0.103
mean1909.000-1915.000=-6.000
σ0.000
min1909.000-1915.000=-6.000
max1909.000-1915.000=-6.000
mean0.579-0.584=-0.006
σ0.044-0.054=-0.009
min0.514-0.510=0.003
max0.682-0.708=-0.026

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.035-285.032=0.004
σ0.035-0.037=-0.001
min284.989-284.981=0.008
max285.069-285.070=-0.001
mean1505.000-1520.000=-15.000
σ0.000
min1505.000-1520.000=-15.000
max1505.000-1520.000=-15.000
mean0.395-0.397=-0.002
σ0.008-0.006=0.001
min0.387-0.388=-0.001
max0.405-0.404=0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.411-1295.415=-0.004
σ0.115-0.105=0.009
min1295.296-1295.287=0.008
max1295.579-1295.550=0.029
mean1505.000-1520.000=-15.000
σ0.000
min1505.000-1520.000=-15.000
max1505.000-1520.000=-15.000
mean1.895-1.961=-0.066
σ0.078-0.142=-0.063
min1.805-1.834=-0.029
max1.995-2.159=-0.164
iters=5
new-facts=6402
prior-facts=1
mean1539.522-1539.505=0.017
σ6.853-6.838=0.015
min1536.233-1536.248=-0.015
max1551.775-1551.733=0.043
mean1505.000-1520.000=-15.000
σ0.000
min1505.000-1520.000=-15.000
max1505.000-1520.000=-15.000
mean2.268-2.223=0.045
σ0.202-0.131=0.071
min2.084-2.088=-0.004
max2.493-2.375=0.118
iters=5
new-facts=6402
prior-facts=6402
mean1857.315-1857.311=0.005
σ0.064-0.062=0.003
min1857.236-1857.263=-0.027
max1857.402-1857.404=-0.002
mean1748.000-1749.600=-1.600
σ171.613-172.034=-0.421
min1508.000-1520.000=-12.000
max1909.000-1915.000=-6.000
mean3.069-3.044=0.026
σ0.249-0.266=-0.017
min2.870-2.838=0.032
max3.492-3.507=-0.016

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.665-1.558=0.107
σ0.260-0.388=-0.128
min1.265-1.038=0.227
max1.869-1.948=-0.079

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.191-448.195=-0.004
σ581.331-581.341=-0.009
min157.523-157.524=-0.000
max1320.188-1320.206=-0.018
mean96.250
σ8.500
min92.000
max109.000
mean1505.000-1520.000=-15.000
σ0.000
min1505.000-1520.000=-15.000
max1505.000-1520.000=-15.000
mean0.549-0.541=0.008
σ0.573-0.556=0.017
min0.260-0.262=-0.002
max1.409-1.375=0.034
policies=20
mean1575.569-1575.575=-0.006
σ0.354-0.365=-0.012
min1575.331-1575.329=0.002
max1576.095-1576.118=-0.023
mean920.000
σ0.000
min920.000
max920.000
mean1505.000-1520.000=-15.000
σ0.000
min1505.000-1520.000=-15.000
max1505.000-1520.000=-15.000
mean2.622-2.648=-0.026
σ0.022-0.016=0.005
min2.606-2.632=-0.026
max2.653-2.669=-0.016
policies=200
mean15763.756-15763.680=0.076
σ0.098-0.023=0.075
min15763.676-15763.658=0.017
max15763.897-15763.712=0.185
mean9200.000
σ0.000
min9200.000
max9200.000
mean1505.000-1520.000=-15.000
σ0.000
min1505.000-1520.000=-15.000
max1505.000-1520.000=-15.000
mean26.464-26.572=-0.108
σ0.034-0.013=0.022
min26.418-26.560=-0.142
max26.491-26.586=-0.095