Compare commits

Home / Compare 410e4563 .. d73f854d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.015=0.039
σ0.367-0.370=-0.003
min53.915-53.872=0.043
max55.099-55.067=0.032
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.138-0.140=-0.002
σ0.005-0.004=0.000
min0.132-0.136=-0.004
max0.145-0.148=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.393-43.322=0.071
σ0.008-0.007=0.001
min43.386-43.310=0.076
max43.411-43.334=0.077
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.122-0.122=-0.001
σ0.004-0.004=0.000
min0.118-0.118=0.000
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.004-1006.306=0.698
σ1.238-1.185=0.053
min1006.464-1005.770=0.694
max1012.203-1011.271=0.932
mean1050.650-1042.700=7.950
σ308.105-312.021=-3.916
min574.000-594.000=-20.000
max1642.000-1631.000=11.000
mean1.586-1.587=-0.001
σ0.106-0.088=0.018
min1.501-1.509=-0.008
max1.897-1.817=0.080

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.866=0.018
σ0.003
min0.882-0.864=0.018
max0.887-0.869=0.018
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean0.441-0.410=0.031
σ0.159-0.131=0.028
min0.348-0.326=0.022
max0.724-0.640=0.084
name=error_case.art
mean2.339-2.337=0.001
σ0.003
min2.337-2.336=0.001
max2.342-2.341=0.001
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean0.898-0.880=0.017
σ0.114-0.096=0.018
min0.829-0.815=0.014
max1.101-1.049=0.052
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002
min1.522-1.522=0.001
max1.526-1.526=0.001
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean0.541-0.542=-0.001
σ0.048-0.049=-0.001
min0.510-0.510=0.000
max0.624-0.625=-0.001
name=nested_use.art
mean2.361-2.360=0.001
σ0.002
min2.360-2.359=0.001
max2.364-2.363=0.001
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean0.848-0.840=0.008
σ0.051-0.041=0.010
min0.814-0.810=0.004
max0.936-0.911=0.025

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.115=0.724
σ0.031-0.034=-0.003
min964.820-964.088=0.732
max964.894-964.172=0.722
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean0.823-0.859=-0.036
σ0.021-0.008=0.013
min0.808-0.853=-0.044
max0.860-0.872=-0.012
name=cdr_enhanced_4k_loc.art
mean885.512-884.712=0.801
σ0.007-0.007=-0.000
min885.504-884.705=0.799
max885.522-884.723=0.799
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean0.723-0.698=0.026
σ0.022-0.082=-0.060
min0.687-0.555=0.133
max0.740-0.747=-0.007

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.715=0.002
σ0.002-0.002=0.000
min7.715-7.714=0.002
max7.722-7.718=0.004
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean4.208-3.839=0.369
σ0.077-0.361=-0.284
min4.091-3.387=0.704
max4.536-4.512=0.024
name=record_render_large_syntax_err.art
mean7.665-7.663=0.002
σ0.002
min7.664-7.662=0.002
max7.668-7.666=0.002
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean4.224-3.496=0.728
σ0.057-0.072=-0.015
min4.124-3.389=0.735
max4.430-3.833=0.597
name=record_render_success.art
mean2.291-2.289=0.001
σ0.002
min2.290-2.289=0.001
max2.294-2.292=0.001
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean0.734-0.742=-0.008
σ0.018-0.019=-0.001
min0.701-0.711=-0.010
max0.839-0.856=-0.018
name=record_render_syntax_err.art
mean2.166-2.165=0.001
σ0.002
min2.165-2.164=0.001
max2.169-2.168=0.001
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean0.700-0.705=-0.006
σ0.016-0.023=-0.007
min0.668-0.594=0.074
max0.790-0.790=-0.001

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.967-296.281=0.685
σ0.203-0.244=-0.041
min296.822-296.077=0.745
max297.510-296.944=0.567
mean2028.000-1902.000=126.000
σ0.000
min2028.000-1902.000=126.000
max2028.000-1902.000=126.000
mean0.567-0.573=-0.005
σ0.034-0.044=-0.010
min0.511-0.510=0.001
max0.600-0.669=-0.068

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.813-284.693=2.120
σ0.037-0.038=-0.000
min286.768-284.640=2.129
max286.870-284.737=2.134
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean0.394-0.398=-0.004
σ0.007-0.010=-0.003
min0.386-0.384=0.002
max0.403-0.406=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1297.270-1295.087=2.183
σ0.094-0.119=-0.025
min1297.137-1294.962=2.175
max1297.386-1295.244=2.142
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean2.214-1.875=0.339
σ0.081-0.070=0.012
min2.125-1.807=0.318
max2.325-1.969=0.356
iters=5
new-facts=6402
prior-facts=1
mean1541.361-1539.192=2.169
σ6.809-6.849=-0.040
min1538.190-1535.919=2.271
max1553.539-1551.440=2.100
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean2.293-2.262=0.031
σ0.176-0.261=-0.084
min2.161-2.038=0.124
max2.558-2.672=-0.114
iters=5
new-facts=6402
prior-facts=6402
mean1859.118-1856.984=2.135
σ0.063-0.056=0.007
min1859.027-1856.931=2.096
max1859.188-1857.067=2.121
mean1778.200-1771.000=7.200
σ167.867-130.924=36.943
min1642.000-1631.000=11.000
max2028.000-1902.000=126.000
mean2.879-2.999=-0.121
σ0.044-0.174=-0.130
min2.838-2.861=-0.023
max2.926-3.303=-0.376

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.252-1.228=0.024
σ0.338-0.305=0.033
min0.940-0.947=-0.007
max1.818-1.721=0.097

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-447.783=1.039
σ581.372-581.212=0.160
min158.134-157.173=0.961
max1320.880-1319.601=1.279
mean96.250
σ8.500
min92.000
max109.000
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean0.561-0.526=0.034
σ0.596-0.525=0.072
min0.260-0.261=-0.001
max1.455-1.313=0.142
policies=20
mean1581.631-1572.092=9.539
σ0.362-0.368=-0.006
min1581.386-1571.847=9.540
max1582.169-1572.640=9.530
mean920.000
σ0.000
min920.000
max920.000
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean2.638-2.654=-0.016
σ0.008-0.017=-0.009
min2.629-2.632=-0.003
max2.645-2.669=-0.024
policies=200
mean15824.037-15729.006=95.031
σ0.309-0.154=0.155
min15823.582-15728.826=94.757
max15824.259-15729.197=95.062
mean9200.000
σ0.000
min9200.000
max9200.000
mean1642.000-1631.000=11.000
σ0.000
min1642.000-1631.000=11.000
max1642.000-1631.000=11.000
mean26.669-26.598=0.071
σ0.084-0.039=0.045
min26.545-26.558=-0.013
max26.726-26.647=0.079