Compare commits

Home / Compare 7286be47 .. ba4f3c19

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.015=-0.000
σ0.371-0.370=0.001
min53.872-53.872=0.000
max55.070-55.067=0.003
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.138-0.140=-0.002
σ0.004-0.007=-0.002
min0.131-0.130=0.002
max0.145-0.149=-0.004
cache=y
dps=1
iters=10
policies=100
mean43.324-43.324=-0.000
σ0.007-0.007=0.000
min43.309-43.308=0.001
max43.333-43.335=-0.002
mean415.000-417.000=-2.000
σ0.000
min415.000-417.000=-2.000
max415.000-417.000=-2.000
mean0.123-0.130=-0.007
σ0.010-0.010=-0.000
min0.114-0.120=-0.006
max0.141-0.149=-0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.308-1006.309=-0.002
σ1.185-1.175=0.010
min1005.768-1005.744=0.024
max1011.269-1011.233=0.036
mean1045.000-1046.500=-1.500
σ311.721-313.302=-1.582
min597.000-598.000=-1.000
max1634.000-1640.000=-6.000
mean1.549-1.544=0.006
σ0.086-0.087=-0.002
min1.469-1.470=-0.001
max1.762-1.781=-0.019

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean0.429-0.404=0.025
σ0.150-0.133=0.017
min0.329-0.315=0.014
max0.688-0.639=0.049
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean0.910-0.896=0.014
σ0.166-0.094=0.072
min0.822-0.823=-0.001
max1.204-1.056=0.147
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean0.544-0.539=0.005
σ0.060-0.064=-0.004
min0.496-0.497=-0.000
max0.648-0.649=-0.001
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean0.844-0.858=-0.014
σ0.039-0.030=0.009
min0.815-0.831=-0.016
max0.909-0.909=0.001

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.111-964.114=-0.003
σ0.023-0.028=-0.005
min964.090-964.095=-0.005
max964.146-964.161=-0.015
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean0.817-0.812=0.005
σ0.041-0.063=-0.022
min0.750-0.708=0.042
max0.859-0.857=0.003
name=cdr_enhanced_4k_loc.art
mean884.714-884.712=0.002
σ0.002-0.008=-0.006
min884.712-884.703=0.009
max884.717-884.722=-0.005
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean0.725-0.676=0.049
σ0.029-0.047=-0.018
min0.680-0.614=0.067
max0.745-0.741=0.005

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.714=0.000
σ0.002-0.002=0.000
min7.714
max7.719-7.718=0.001
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean4.301-4.301=0.001
σ0.096-0.085=0.011
min4.160-4.110=0.050
max4.937-4.720=0.217
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=0.000
min7.662
max7.669-7.666=0.003
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean4.280-4.273=0.007
σ0.119-0.072=0.046
min3.586-4.101=-0.516
max4.531-4.482=0.049
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean0.735-0.751=-0.015
σ0.017-0.018=-0.001
min0.705-0.723=-0.018
max0.840-0.850=-0.010
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean0.699-0.706=-0.007
σ0.014-0.015=-0.001
min0.669-0.671=-0.001
max0.781-0.771=0.010

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.382-296.216=0.166
σ0.224-0.204=0.020
min296.228-296.071=0.157
max297.006-296.756=0.250
mean1902.000-1926.000=-24.000
σ0.000
min1902.000-1926.000=-24.000
max1902.000-1926.000=-24.000
mean0.576-0.578=-0.002
σ0.044-0.039=0.005
min0.513-0.513=0.000
max0.657-0.647=0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.696-284.696=-0.001
σ0.040-0.036=0.004
min284.644-284.653=-0.009
max284.742-284.736=0.006
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean0.407-0.403=0.004
σ0.003-0.009=-0.006
min0.404-0.387=0.017
max0.411-0.409=0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.079-1295.084=-0.006
σ0.111-0.112=-0.001
min1294.958-1294.960=-0.001
max1295.220-1295.226=-0.007
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean1.918-1.897=0.021
σ0.108-0.085=0.023
min1.799-1.806=-0.007
max2.015-2.011=0.003
iters=5
new-facts=6402
prior-facts=1
mean1539.190-1539.178=0.011
σ6.859-6.843=0.015
min1535.926-1535.898=0.027
max1551.456-1551.416=0.040
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean2.257-2.249=0.008
σ0.275-0.203=0.072
min2.034-2.025=0.009
max2.686-2.448=0.237
iters=5
new-facts=6402
prior-facts=6402
mean1856.984-1856.997=-0.013
σ0.056-0.062=-0.006
min1856.928-1856.931=-0.003
max1857.065-1857.065=-0.001
mean1771.000-1777.800=-6.800
σ130.832-143.472=-12.640
min1634.000-1640.000=-6.000
max1902.000-1926.000=-24.000
mean3.051-2.949=0.103
σ0.244-0.146=0.099
min2.866-2.804=0.062
max3.469-3.106=0.363

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.123-1.203=-0.080
σ0.214-0.255=-0.042
min0.936-0.956=-0.020
max1.421-1.614=-0.192

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.787-447.785=0.002
σ581.212-581.212=0.000
min157.179-157.177=0.002
max1319.605-1319.603=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean0.547-0.546=0.001
σ0.571-0.573=-0.002
min0.259-0.259=0.001
max1.404-1.406=-0.003
policies=20
mean1572.103-1572.087=0.016
σ0.354-0.360=-0.006
min1571.863-1571.843=0.021
max1572.629-1572.622=0.007
mean920.000
σ0.000
min920.000
max920.000
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean2.630-2.632=-0.002
σ0.009-0.017=-0.008
min2.624-2.617=0.007
max2.644-2.655=-0.011
policies=200
mean15729.098-15729.082=0.016
σ0.109-0.087=0.021
min15729.028-15728.988=0.040
max15729.259-15729.200=0.060
mean9200.000
σ0.000
min9200.000
max9200.000
mean1634.000-1640.000=-6.000
σ0.000
min1634.000-1640.000=-6.000
max1634.000-1640.000=-6.000
mean26.472-26.609=-0.137
σ0.016-0.213=-0.197
min26.448-26.445=0.003
max26.481-26.918=-0.437