Compare commits

Home / Compare db90b2c7 .. 83c257b5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.014=-0.001
σ0.370-0.371=-0.001
min53.874-53.878=-0.004
max55.065-55.069=-0.003
mean414.000-415.800=-1.800
σ0.000-0.422=-0.422
min414.000-415.000=-1.000
max414.000-416.000=-2.000
mean0.138-0.138=-0.000
σ0.004-0.005=-0.001
min0.131-0.132=-0.000
max0.146-0.146=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.323-43.321=0.002
σ0.007-0.006=0.001
min43.318-43.315=0.003
max43.341-43.335=0.007
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.129-0.121=0.008
σ0.010-0.004=0.006
min0.119-0.115=0.003
max0.148-0.127=0.021

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.308-1006.310=-0.002
σ1.177-1.166=0.010
min1005.764-1005.743=0.021
max1011.234-1011.191=0.043
mean1044.950-1051.800=-6.850
σ313.333-304.936=8.397
min594.000-596.000=-2.000
max1643.000-1645.000=-2.000
mean1.552-1.561=-0.008
σ0.071-0.089=-0.018
min1.462-1.491=-0.029
max1.733-1.884=-0.151

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean0.438-0.418=0.020
σ0.125-0.141=-0.015
min0.349-0.340=0.009
max0.653-0.667=-0.014
name=error_case.art
mean2.337-2.338=-0.000
σ0.003-0.002=0.000
min2.336
max2.341
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean0.909-0.893=0.016
σ0.166-0.108=0.058
min0.803-0.827=-0.024
max1.203-1.083=0.120
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean0.538-0.548=-0.009
σ0.054-0.062=-0.007
min0.492-0.493=-0.001
max0.630-0.652=-0.022
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean0.829-0.859=-0.030
σ0.037-0.031=0.006
min0.785-0.836=-0.052
max0.888-0.911=-0.023

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.115=-0.002
σ0.016-0.034=-0.018
min964.097-964.086=0.011
max964.138-964.171=-0.033
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean0.837-0.845=-0.008
σ0.017-0.013=0.004
min0.809-0.822=-0.014
max0.852-0.854=-0.002
name=cdr_enhanced_4k_loc.art
mean884.713-884.712=0.002
σ0.002-0.006=-0.005
min884.710-884.705=0.006
max884.715-884.720=-0.005
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean0.678-0.733=-0.055
σ0.039-0.009=0.031
min0.633-0.718=-0.085
max0.737-0.740=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.714-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718-7.719=-0.001
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean4.181-4.208=-0.027
σ0.070-0.094=-0.023
min4.057-3.999=0.058
max4.483-4.700=-0.217
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.667-7.666=0.001
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean4.170-4.201=-0.030
σ0.102-0.070=0.032
min4.014-4.069=-0.055
max4.556-4.463=0.092
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean0.732-0.731=0.001
σ0.033-0.021=0.012
min0.672-0.701=-0.029
max0.930-0.862=0.068
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean0.682-0.689=-0.006
σ0.033-0.019=0.014
min0.491-0.587=-0.096
max0.785-0.795=-0.010

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.303-296.427=-0.124
σ0.195-0.197=-0.001
min296.143-296.281=-0.138
max296.826-296.971=-0.145
mean1898.000-1906.000=-8.000
σ0.000
min1898.000-1906.000=-8.000
max1898.000-1906.000=-8.000
mean0.585-0.574=0.011
σ0.034-0.047=-0.013
min0.537-0.507=0.030
max0.648-0.658=-0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.696-284.695=0.002
σ0.037-0.031=0.007
min284.647-284.662=-0.015
max284.733-284.730=0.004
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean0.393-0.391=0.002
σ0.009-0.008=0.001
min0.387-0.385=0.001
max0.408-0.405=0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.069-1295.079=-0.010
σ0.097-0.110=-0.012
min1294.964-1294.960=0.004
max1295.178-1295.211=-0.033
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean1.899-1.916=-0.017
σ0.076-0.088=-0.012
min1.814-1.822=-0.008
max1.982-2.029=-0.047
iters=5
new-facts=6402
prior-facts=1
mean1539.206-1539.190=0.017
σ6.828-6.837=-0.009
min1535.952-1535.944=0.008
max1551.417-1551.417=0.000
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean2.157-2.263=-0.106
σ0.156-0.295=-0.138
min2.048-2.035=0.013
max2.429-2.703=-0.273
iters=5
new-facts=6402
prior-facts=6402
mean1856.987-1856.984=0.003
σ0.053-0.050=0.003
min1856.941-1856.946=-0.004
max1857.065-1857.060=0.005
mean1768.800-1776.000=-7.200
σ124.642-129.037=-4.395
min1643.000-1645.000=-2.000
max1898.000-1906.000=-8.000
mean3.117-3.063=0.054
σ0.349-0.354=-0.005
min2.866-2.869=-0.003
max3.733-3.693=0.039

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.117-1.195=-0.078
σ0.190-0.295=-0.105
min0.948-0.938=0.009
max1.358-1.690=-0.331

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.786=-0.002
σ581.211-581.212=-0.001
min157.176-157.179=-0.003
max1319.601-1319.605=-0.004
mean96.250
σ8.500
min92.000
max109.000
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean0.542-0.539=0.003
σ0.570-0.555=0.015
min0.256-0.259=-0.003
max1.397-1.372=0.025
policies=20
mean1572.101-1572.088=0.013
σ0.352-0.345=0.007
min1571.862-1571.858=0.004
max1572.624-1572.601=0.023
mean920.000
σ0.000
min920.000
max920.000
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean2.620-2.616=0.004
σ0.021-0.017=0.004
min2.593-2.594=-0.002
max2.643-2.630=0.012
policies=200
mean15729.089-15729.079=0.010
σ0.074-0.130=-0.056
min15729.035-15728.989=0.046
max15729.198-15729.266=-0.068
mean9200.000
σ0.000
min9200.000
max9200.000
mean1643.000-1645.000=-2.000
σ0.000
min1643.000-1645.000=-2.000
max1643.000-1645.000=-2.000
mean26.590-26.409=0.181
σ0.146-0.008=0.138
min26.477-26.402=0.075
max26.801-26.418=0.383