Compare commits

Home / Compare 2272ebd5 .. d782c772

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.054=-0.000
σ0.369-0.370=-0.000
min53.901-53.904=-0.003
max55.104-55.106=-0.002
mean416.000
σ0.000
min416.000
max416.000
mean0.140-0.138=0.002
σ0.005-0.005=-0.000
min0.136-0.132=0.005
max0.149-0.149=0.000
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=-0.000
σ0.006-0.007=-0.001
min43.386-43.384=0.002
max43.407-43.407=0.000
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.121-0.123=-0.002
σ0.003-0.004=-0.001
min0.118-0.118=0.000
max0.128-0.129=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.002-1007.002=-0.000
σ1.207-1.185=0.022
min1006.432-1006.433=-0.001
max1012.070-1011.971=0.099
mean1060.350-1043.700=16.650
σ316.653-305.592=11.061
min590.000-589.000=1.000
max1639.000-1630.000=9.000
mean1.518-1.549=-0.031
σ0.066-0.096=-0.030
min1.356-1.454=-0.098
max1.632-1.797=-0.165

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1639.000-1630.000=9.000
σ0.000
min1639.000-1630.000=9.000
max1639.000-1630.000=9.000
mean0.427-0.417=0.010
σ0.151-0.128=0.022
min0.334-0.350=-0.015
max0.695-0.645=0.050
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1639.000-1630.000=9.000
σ0.000
min1639.000-1630.000=9.000
max1639.000-1630.000=9.000
mean0.896-0.884=0.012
σ0.087-0.093=-0.006
min0.842-0.822=0.020
max1.050-1.048=0.002
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1639.000-1630.000=9.000
σ0.000
min1639.000-1630.000=9.000
max1639.000-1630.000=9.000
mean0.543-0.561=-0.018
σ0.052-0.066=-0.014
min0.499-0.495=0.004
max0.631-0.640=-0.009
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1639.000-1630.000=9.000
σ0.000
min1639.000-1630.000=9.000
max1639.000-1630.000=9.000
mean0.864-0.852=0.012
σ0.038-0.045=-0.007
min0.839-0.814=0.026
max0.931-0.926=0.005

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.840=-0.000
σ0.034-0.033=0.002
min964.811-964.812=-0.002
max964.896-964.894=0.002
mean1639.000-1630.000=9.000
σ0.000
min1639.000-1630.000=9.000
max1639.000-1630.000=9.000
mean0.808-0.823=-0.015
σ0.020-0.033=-0.013
min0.774-0.783=-0.008
max0.827-0.855=-0.028
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.001
σ0.007-0.007=-0.000
min885.504
max885.522-885.522=-0.000
mean1639.000-1630.000=9.000
σ0.000
min1639.000-1630.000=9.000
max1639.000-1630.000=9.000
mean0.705-0.733=-0.027
σ0.037-0.010=0.027
min0.642-0.718=-0.076
max0.736-0.743=-0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.721=-0.000
mean1639.000-1630.000=9.000
σ0.000
min1639.000-1630.000=9.000
max1639.000-1630.000=9.000
mean4.257-4.182=0.074
σ0.099-0.068=0.031
min4.074-4.063=0.011
max4.588-4.409=0.179
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1639.000-1630.000=9.000
σ0.000
min1639.000-1630.000=9.000
max1639.000-1630.000=9.000
mean4.200-4.178=0.022
σ0.054-0.123=-0.069
min4.069-3.296=0.773
max4.354-4.552=-0.199
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1639.000-1630.000=9.000
σ0.000
min1639.000-1630.000=9.000
max1639.000-1630.000=9.000
mean0.753-0.751=0.001
σ0.022-0.028=-0.006
min0.713-0.711=0.002
max0.876-0.935=-0.060
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1639.000-1630.000=9.000
σ0.000
min1639.000-1630.000=9.000
max1639.000-1630.000=9.000
mean0.714-0.710=0.003
σ0.014-0.028=-0.014
min0.687-0.507=0.181
max0.783-0.800=-0.016

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.048-296.744=0.304
σ0.207-0.206=0.001
min296.889-296.614=0.275
max297.601-297.317=0.284
mean2020.000-1956.000=64.000
σ0.000
min2020.000-1956.000=64.000
max2020.000-1956.000=64.000
mean0.529-0.582=-0.052
σ0.025-0.038=-0.013
min0.505-0.510=-0.005
max0.581-0.636=-0.055

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.816-286.819=-0.003
σ0.035-0.036=-0.001
min286.770-286.769=0.000
max286.854-286.855=-0.001
mean1639.000-1630.000=9.000
σ0.000
min1639.000-1630.000=9.000
max1639.000-1630.000=9.000
mean0.392-0.395=-0.003
σ0.006-0.006=-0.000
min0.388-0.388=0.000
max0.402-0.403=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1297.260-1297.253=0.008
σ0.083-0.079=0.004
min1297.167-1297.166=0.000
max1297.381-1297.343=0.037
mean1639.000-1630.000=9.000
σ0.000
min1639.000-1630.000=9.000
max1639.000-1630.000=9.000
mean2.058-2.102=-0.044
σ0.106-0.077=0.029
min1.978-2.004=-0.026
max2.242-2.195=0.047
iters=5
new-facts=6402
prior-facts=1
mean1541.310-1541.306=0.004
σ6.857-6.832=0.026
min1538.017-1538.072=-0.055
max1553.572-1553.523=0.050
mean1639.000-1630.000=9.000
σ0.000
min1639.000-1630.000=9.000
max1639.000-1630.000=9.000
mean2.248-2.162=0.085
σ0.172-0.071=0.101
min2.107-2.062=0.045
max2.503-2.248=0.255
iters=5
new-facts=6402
prior-facts=6402
mean1859.103-1859.111=-0.008
σ0.090-0.081=0.008
min1858.958-1858.989=-0.031
max1859.189-1859.185=0.004
mean1767.800-1789.400=-21.600
σ164.699-163.199=1.500
min1639.000-1630.000=9.000
max2020.000-1956.000=64.000
mean2.894-2.996=-0.103
σ0.206-0.113=0.093
min2.605-2.858=-0.254
max3.132-3.150=-0.018

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.236-1.251=-0.015
σ0.367-0.309=0.058
min0.936-1.060=-0.124
max1.835-1.785=0.050

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.821=-0.001
σ581.372-581.372=-0.001
min158.133-158.133=-0.000
max1320.878-1320.879=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1639.000-1630.000=9.000
σ0.000
min1639.000-1630.000=9.000
max1639.000-1630.000=9.000
mean0.557-0.556=0.001
σ0.581-0.584=-0.003
min0.265-0.261=0.005
max1.429-1.432=-0.003
policies=20
mean1581.614-1581.615=-0.001
σ0.362-0.355=0.007
min1581.372-1581.374=-0.002
max1582.153-1582.143=0.010
mean920.000
σ0.000
min920.000
max920.000
mean1639.000-1630.000=9.000
σ0.000
min1639.000-1630.000=9.000
max1639.000-1630.000=9.000
mean2.640-2.635=0.005
σ0.014-0.014=-0.000
min2.625-2.621=0.005
max2.658-2.653=0.005
policies=200
mean15824.212-15824.040=0.173
σ0.150-0.174=-0.024
min15824.042-15823.871=0.171
max15824.406-15824.283=0.123
mean9200.000
σ0.000
min9200.000
max9200.000
mean1639.000-1630.000=9.000
σ0.000
min1639.000-1630.000=9.000
max1639.000-1630.000=9.000
mean26.576-26.609=-0.032
σ0.051-0.057=-0.006
min26.521-26.554=-0.033
max26.627-26.658=-0.030