Compare commits

Home / Compare 087d80aa .. 6460cbfd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.015=-0.000
σ0.371-0.370=0.000
min53.872-53.869=0.003
max55.070-55.069=0.001
mean415.000
σ0.000
min415.000
max415.000
mean0.138-0.140=-0.002
σ0.004-0.004=0.001
min0.131-0.136=-0.005
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.324-43.323=0.001
σ0.007-0.006=0.001
min43.309-43.311=-0.002
max43.333-43.333=0.000
mean415.000
σ0.000
min415.000
max415.000
mean0.123-0.121=0.002
σ0.010-0.002=0.008
min0.114-0.119=-0.005
max0.141-0.126=0.015

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.308-1006.313=-0.005
σ1.185-1.153=0.032
min1005.768-1005.740=0.027
max1011.269-1011.135=0.134
mean1045.000-1053.150=-8.150
σ311.721-315.938=-4.218
min597.000-564.000=33.000
max1634.000-1613.000=21.000
mean1.549-1.508=0.042
σ0.086-0.057=0.029
min1.469-1.451=0.018
max1.762-1.648=0.114

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1634.000-1613.000=21.000
σ0.000
min1634.000-1613.000=21.000
max1634.000-1613.000=21.000
mean0.429-0.417=0.012
σ0.150-0.137=0.013
min0.329-0.325=0.004
max0.688-0.657=0.031
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1634.000-1613.000=21.000
σ0.000
min1634.000-1613.000=21.000
max1634.000-1613.000=21.000
mean0.910-0.895=0.015
σ0.166-0.106=0.059
min0.822-0.836=-0.014
max1.204-1.082=0.121
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1634.000-1613.000=21.000
σ0.000
min1634.000-1613.000=21.000
max1634.000-1613.000=21.000
mean0.544-0.559=-0.015
σ0.060-0.075=-0.015
min0.496-0.497=-0.001
max0.648-0.682=-0.035
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1634.000-1613.000=21.000
σ0.000
min1634.000-1613.000=21.000
max1634.000-1613.000=21.000
mean0.844-0.844=-0.001
σ0.039-0.043=-0.004
min0.815-0.801=0.014
max0.909-0.907=0.002

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.111-964.115=-0.004
σ0.023-0.034=-0.011
min964.090-964.086=0.004
max964.146-964.170=-0.024
mean1634.000-1613.000=21.000
σ0.000
min1634.000-1613.000=21.000
max1634.000-1613.000=21.000
mean0.817-0.815=0.002
σ0.041-0.035=0.007
min0.750-0.760=-0.010
max0.859-0.854=0.005
name=cdr_enhanced_4k_loc.art
mean884.714-884.711=0.003
σ0.002-0.008=-0.006
min884.712-884.705=0.008
max884.717-884.723=-0.006
mean1634.000-1613.000=21.000
σ0.000
min1634.000-1613.000=21.000
max1634.000-1613.000=21.000
mean0.725-0.719=0.006
σ0.029-0.033=-0.004
min0.680-0.666=0.014
max0.745-0.744=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.719
mean1634.000-1613.000=21.000
σ0.000
min1634.000-1613.000=21.000
max1634.000-1613.000=21.000
mean4.301-4.269=0.033
σ0.096-0.103=-0.007
min4.160-4.115=0.046
max4.937-4.775=0.162
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.669-7.666=0.003
mean1634.000-1613.000=21.000
σ0.000
min1634.000-1613.000=21.000
max1634.000-1613.000=21.000
mean4.280-4.254=0.026
σ0.119-0.075=0.044
min3.586-4.086=-0.500
max4.531-4.448=0.083
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1634.000-1613.000=21.000
σ0.000
min1634.000-1613.000=21.000
max1634.000-1613.000=21.000
mean0.735-0.731=0.005
σ0.017-0.017=-0.000
min0.705-0.704=0.001
max0.840-0.847=-0.007
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1634.000-1613.000=21.000
σ0.000
min1634.000-1613.000=21.000
max1634.000-1613.000=21.000
mean0.699-0.697=0.002
σ0.014-0.015=-0.001
min0.669-0.670=-0.001
max0.781-0.765=0.016

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.382-296.248=0.134
σ0.224-0.193=0.031
min296.228-296.047=0.181
max297.006-296.765=0.240
mean1902.000-1904.000=-2.000
σ0.000
min1902.000-1904.000=-2.000
max1902.000-1904.000=-2.000
mean0.576-0.583=-0.007
σ0.044-0.052=-0.008
min0.513-0.533=-0.019
max0.657-0.705=-0.048

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.696-284.697=-0.002
σ0.040-0.030=0.010
min284.644-284.664=-0.020
max284.742-284.732=0.010
mean1634.000-1613.000=21.000
σ0.000
min1634.000-1613.000=21.000
max1634.000-1613.000=21.000
mean0.407-0.399=0.008
σ0.003-0.012=-0.009
min0.404-0.384=0.020
max0.411-0.410=0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.079-1295.090=-0.011
σ0.111-0.130=-0.018
min1294.958-1294.960=-0.002
max1295.220-1295.268=-0.048
mean1634.000-1613.000=21.000
σ0.000
min1634.000-1613.000=21.000
max1634.000-1613.000=21.000
mean1.918-1.894=0.024
σ0.108-0.093=0.015
min1.799-1.786=0.013
max2.015-2.004=0.011
iters=5
new-facts=6402
prior-facts=1
mean1539.190-1539.178=0.012
σ6.859-6.846=0.013
min1535.926-1535.926=-0.000
max1551.456-1551.421=0.035
mean1634.000-1613.000=21.000
σ0.000
min1634.000-1613.000=21.000
max1634.000-1613.000=21.000
mean2.257-2.238=0.019
σ0.275-0.227=0.048
min2.034-2.018=0.017
max2.686-2.534=0.152
iters=5
new-facts=6402
prior-facts=6402
mean1856.984-1856.983=0.001
σ0.056-0.063=-0.007
min1856.928-1856.910=0.017
max1857.065-1857.069=-0.005
mean1771.000-1765.800=5.200
σ130.832-137.347=-6.515
min1634.000-1613.000=21.000
max1902.000-1904.000=-2.000
mean3.051-3.049=0.002
σ0.244-0.338=-0.094
min2.866-2.818=0.048
max3.469-3.648=-0.179

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.123-1.224=-0.101
σ0.214-0.348=-0.134
min0.936-0.932=0.004
max1.421-1.786=-0.364

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.787-447.786=0.000
σ581.212-581.212=-0.000
min157.179-157.179=0.000
max1319.605-1319.605=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1634.000-1613.000=21.000
σ0.000
min1634.000-1613.000=21.000
max1634.000-1613.000=21.000
mean0.547-0.536=0.011
σ0.571-0.555=0.016
min0.259-0.258=0.002
max1.404-1.368=0.036
policies=20
mean1572.103-1572.101=0.002
σ0.354-0.349=0.005
min1571.863-1571.866=-0.003
max1572.629-1572.620=0.008
mean920.000
σ0.000
min920.000
max920.000
mean1634.000-1613.000=21.000
σ0.000
min1634.000-1613.000=21.000
max1634.000-1613.000=21.000
mean2.630-2.616=0.014
σ0.009-0.018=-0.009
min2.624-2.598=0.025
max2.644-2.635=0.009
policies=200
mean15729.098-15728.967=0.130
σ0.109-0.117=-0.008
min15729.028-15728.817=0.211
max15729.259-15729.090=0.169
mean9200.000
σ0.000
min9200.000
max9200.000
mean1634.000-1613.000=21.000
σ0.000
min1634.000-1613.000=21.000
max1634.000-1613.000=21.000
mean26.472-26.418=0.054
σ0.016-0.153=-0.137
min26.448-26.289=0.159
max26.481-26.634=-0.152