Compare commits

Home / Compare 58d468c6 .. 326ad5ba

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.036-54.056=-0.020
σ0.368-0.370=-0.002
min53.890-53.917=-0.028
max55.082-55.109=-0.027
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.149-0.142=0.007
σ0.009-0.004=0.006
min0.138-0.139=-0.001
max0.162-0.148=0.014
cache=y
dps=1
iters=10
policies=100
mean43.384-43.393=-0.008
σ0.005-0.006=-0.001
min43.378-43.381=-0.003
max43.396-43.401=-0.005
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.123-0.120=0.003
σ0.004-0.006=-0.002
min0.120-0.114=0.006
max0.130-0.129=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.327-1007.005=-0.678
σ0.911-1.205=-0.294
min1005.867-1006.432=-0.565
max1010.118-1012.055=-1.937
mean1053.800-1051.850=1.950
σ305.174-307.634=-2.460
min582.000-577.000=5.000
max1453.000-1643.000=-190.000
mean1.559-1.533=0.025
σ0.086-0.086=0.001
min1.477-1.451=0.025
max1.759-1.805=-0.046

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.001
σ0.002-0.003=-0.000
min0.881-0.882=-0.000
max0.886-0.887=-0.001
mean1453.000-1643.000=-190.000
σ0.000
min1453.000-1643.000=-190.000
max1453.000-1643.000=-190.000
mean0.443-0.438=0.005
σ0.181-0.132=0.049
min0.352-0.347=0.005
max0.766-0.664=0.102
name=error_case.art
mean2.333-2.339=-0.005
σ0.003
min2.332-2.337=-0.005
max2.337-2.342=-0.005
mean1453.000-1643.000=-190.000
σ0.000
min1453.000-1643.000=-190.000
max1453.000-1643.000=-190.000
mean0.920-0.892=0.027
σ0.174-0.106=0.068
min0.818-0.815=0.004
max1.228-1.077=0.151
name=heavy_item.art
mean1.521-1.524=-0.002
σ0.002
min1.520-1.522=-0.002
max1.524-1.526=-0.002
mean1453.000-1643.000=-190.000
σ0.000
min1453.000-1643.000=-190.000
max1453.000-1643.000=-190.000
mean0.540-0.542=-0.001
σ0.047-0.037=0.011
min0.499-0.516=-0.017
max0.616-0.605=0.011
name=nested_use.art
mean2.355-2.361=-0.005
σ0.002
min2.355-2.360=-0.005
max2.358-2.364=-0.005
mean1453.000-1643.000=-190.000
σ0.000
min1453.000-1643.000=-190.000
max1453.000-1643.000=-190.000
mean0.846-0.860=-0.014
σ0.037-0.041=-0.004
min0.800-0.825=-0.025
max0.902-0.927=-0.025

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.543-964.837=-1.294
σ0.025-0.033=-0.008
min963.523-964.810=-1.287
max963.585-964.892=-1.307
mean1453.000-1643.000=-190.000
σ0.000
min1453.000-1643.000=-190.000
max1453.000-1643.000=-190.000
mean0.812-0.839=-0.027
σ0.044-0.024=0.020
min0.766-0.806=-0.040
max0.858-0.864=-0.006
name=cdr_enhanced_4k_loc.art
mean884.853-885.513=-0.659
σ0.005-0.008=-0.003
min884.847-885.504=-0.657
max884.861-885.524=-0.663
mean1453.000-1643.000=-190.000
σ0.000
min1453.000-1643.000=-190.000
max1453.000-1643.000=-190.000
mean0.726-0.703=0.023
σ0.027-0.038=-0.011
min0.679-0.640=0.039
max0.744-0.743=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.716=-0.010
σ0.002-0.002=0.000
min7.705-7.715=-0.010
max7.711-7.719=-0.008
mean1453.000-1643.000=-190.000
σ0.000
min1453.000-1643.000=-190.000
max1453.000-1643.000=-190.000
mean4.249-4.246=0.002
σ0.073-0.074=-0.001
min4.116-4.143=-0.027
max4.550-4.570=-0.021
name=record_render_large_syntax_err.art
mean7.655-7.665=-0.010
σ0.002
min7.654-7.664=-0.010
max7.658-7.668=-0.010
mean1453.000-1643.000=-190.000
σ0.000
min1453.000-1643.000=-190.000
max1453.000-1643.000=-190.000
mean4.057-4.054=0.002
σ0.312-0.326=-0.014
min3.382-3.415=-0.032
max4.352-4.503=-0.151
name=record_render_success.art
mean2.288-2.291=-0.003
σ0.002
min2.287-2.290=-0.003
max2.291-2.294=-0.003
mean1453.000-1643.000=-190.000
σ0.000
min1453.000-1643.000=-190.000
max1453.000-1643.000=-190.000
mean0.748-0.745=0.003
σ0.026-0.017=0.009
min0.667-0.714=-0.047
max0.937-0.850=0.087
name=record_render_syntax_err.art
mean2.163-2.166=-0.002
σ0.002
min2.163-2.165=-0.002
max2.166-2.169=-0.002
mean1453.000-1643.000=-190.000
σ0.000
min1453.000-1643.000=-190.000
max1453.000-1643.000=-190.000
mean0.708-0.709=-0.001
σ0.017-0.015=0.001
min0.681-0.681=0.000
max0.819-0.796=0.023

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.573-297.016=-1.443
σ0.203-0.195=0.008
min295.441-296.827=-1.385
max296.116-297.500=-1.384
mean1912.000-1900.000=12.000
σ0.000
min1912.000-1900.000=12.000
max1912.000-1900.000=12.000
mean0.588-0.583=0.005
σ0.028-0.045=-0.017
min0.518-0.522=-0.005
max0.616-0.695=-0.080

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.245-286.824=-1.579
σ0.040-0.043=-0.003
min285.193-286.761=-1.568
max285.286-286.868=-1.581
mean1453.000-1643.000=-190.000
σ0.000
min1453.000-1643.000=-190.000
max1453.000-1643.000=-190.000
mean0.392-0.405=-0.013
σ0.011-0.015=-0.003
min0.380-0.388=-0.008
max0.404-0.428=-0.024
iters=5
new-facts=1
prior-facts=6402
mean1295.155-1297.212=-2.056
σ0.112-0.064=0.048
min1295.074-1297.153=-2.079
max1295.342-1297.295=-1.953
mean1453.000-1643.000=-190.000
σ0.000
min1453.000-1643.000=-190.000
max1453.000-1643.000=-190.000
mean1.973-2.060=-0.087
σ0.219-0.052=0.167
min1.797-2.010=-0.214
max2.337-2.130=0.208
iters=5
new-facts=6402
prior-facts=1
mean1538.138-1541.428=-3.290
σ3.973-6.808=-2.835
min1536.239-1538.259=-2.021
max1545.242-1553.604=-8.363
mean1453.000-1643.000=-190.000
σ0.000
min1453.000-1643.000=-190.000
max1453.000-1643.000=-190.000
mean2.334-2.475=-0.140
σ0.276-0.217=0.059
min2.077-2.166=-0.089
max2.761-2.729=0.032
iters=5
new-facts=6402
prior-facts=6402
mean1857.101-1859.110=-2.009
σ0.054-0.079=-0.025
min1857.049-1858.995=-1.946
max1857.176-1859.192=-2.016
mean1749.000-1772.800=-23.800
σ176.634-126.308=50.326
min1499.000-1643.000=-144.000
max1912.000-1900.000=12.000
mean3.054-3.082=-0.027
σ0.274-0.284=-0.010
min2.863-2.815=0.048
max3.529-3.486=0.043

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.756-1.204=0.552
σ0.179-0.290=-0.111
min1.445-0.933=0.512
max1.906-1.693=0.213

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.611-448.822=-5.211
σ577.065-581.372=-4.307
min155.077-158.134=-3.057
max1309.208-1320.880=-11.672
mean96.250
σ8.500
min92.000
max109.000
mean1453.000-1643.000=-190.000
σ0.000
min1453.000-1643.000=-190.000
max1453.000-1643.000=-190.000
mean0.539-0.555=-0.016
σ0.560-0.575=-0.014
min0.257-0.259=-0.002
max1.379-1.417=-0.038
policies=20
mean1551.052-1581.627=-30.575
σ0.342-0.355=-0.014
min1550.820-1581.387=-30.567
max1551.560-1582.155=-30.595
mean920.000
σ0.000
min920.000
max920.000
mean1453.000-1643.000=-190.000
σ0.000
min1453.000-1643.000=-190.000
max1453.000-1643.000=-190.000
mean2.608-2.639=-0.031
σ0.040-0.013=0.027
min2.580-2.622=-0.043
max2.667-2.651=0.016
policies=200
mean15518.511-15824.252=-305.741
σ0.070-0.090=-0.020
min15518.449-15824.164=-305.715
max15518.606-15824.372=-305.766
mean9200.000
σ0.000
min9200.000
max9200.000
mean1453.000-1643.000=-190.000
σ0.000
min1453.000-1643.000=-190.000
max1453.000-1643.000=-190.000
mean26.174-26.614=-0.440
σ0.125-0.039=0.086
min26.042-26.577=-0.536
max26.287-26.662=-0.375