Compare commits

Home / Compare 199fc5e4 .. f43265e9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.343-54.208=0.135
σ0.369-0.370=-0.001
min54.200-54.063=0.137
max55.392-55.260=0.132
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.141-0.140=0.001
σ0.003-0.004=-0.000
min0.138-0.136=0.002
max0.147-0.146=0.001
cache=y
dps=1
iters=10
policies=100
mean43.628-43.494=0.134
σ0.008-0.006=0.002
min43.615-43.484=0.131
max43.643-43.505=0.138
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.119-0.124=-0.005
σ0.004-0.004=0.000
min0.115-0.120=-0.005
max0.126-0.130=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1008.329-1007.638=0.691
σ0.869-0.866=0.003
min1007.834-1007.140=0.694
max1011.926-1011.215=0.711
mean1053.050-1048.250=4.800
σ316.641-317.894=-1.252
min574.000-576.000=-2.000
max1521.000-1657.000=-136.000
mean1.552-1.551=0.001
σ0.084-0.071=0.013
min1.465-1.457=0.007
max1.763-1.749=0.014

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1521.000-1657.000=-136.000
σ0.000
min1521.000-1657.000=-136.000
max1521.000-1657.000=-136.000
mean0.414-0.419=-0.005
σ0.135-0.142=-0.007
min0.339-0.330=0.009
max0.655-0.671=-0.016
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1521.000-1657.000=-136.000
σ0.000
min1521.000-1657.000=-136.000
max1521.000-1657.000=-136.000
mean0.872-0.876=-0.004
σ0.093-0.084=0.009
min0.810-0.826=-0.015
max1.033-1.024=0.009
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1521.000-1657.000=-136.000
σ0.000
min1521.000-1657.000=-136.000
max1521.000-1657.000=-136.000
mean0.536-0.534=0.002
σ0.050-0.048=0.002
min0.493-0.501=-0.007
max0.613-0.614=-0.002
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1521.000-1657.000=-136.000
σ0.000
min1521.000-1657.000=-136.000
max1521.000-1657.000=-136.000
mean0.821-0.845=-0.024
σ0.052-0.046=0.006
min0.775-0.804=-0.029
max0.908-0.920=-0.012

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.822-964.830=-0.008
σ0.024-0.022=0.001
min964.802-964.813=-0.011
max964.860-964.867=-0.007
mean1521.000-1657.000=-136.000
σ0.000
min1521.000-1657.000=-136.000
max1521.000-1657.000=-136.000
mean0.784-0.810=-0.026
σ0.080-0.030=0.050
min0.672-0.772=-0.099
max0.865-0.848=0.017
name=cdr_enhanced_4k_loc.art
mean885.511-885.511=-0.000
σ0.007-0.006=0.001
min885.504
max885.518-885.517=0.000
mean1521.000-1657.000=-136.000
σ0.000
min1521.000-1657.000=-136.000
max1521.000-1657.000=-136.000
mean0.699-0.701=-0.003
σ0.026-0.037=-0.010
min0.667-0.660=0.007
max0.724-0.752=-0.028

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719
mean1521.000-1657.000=-136.000
σ0.000
min1521.000-1657.000=-136.000
max1521.000-1657.000=-136.000
mean4.208-4.234=-0.025
σ0.083-0.078=0.005
min4.067-4.092=-0.025
max4.613-4.475=0.139
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.671-7.668=0.003
mean1521.000-1657.000=-136.000
σ0.000
min1521.000-1657.000=-136.000
max1521.000-1657.000=-136.000
mean4.234-4.229=0.005
σ0.084-0.092=-0.008
min4.097-4.052=0.046
max4.523-4.512=0.011
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1521.000-1657.000=-136.000
σ0.000
min1521.000-1657.000=-136.000
max1521.000-1657.000=-136.000
mean0.744-0.742=0.002
σ0.019-0.017=0.002
min0.708-0.703=0.005
max0.862-0.841=0.020
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1521.000-1657.000=-136.000
σ0.000
min1521.000-1657.000=-136.000
max1521.000-1657.000=-136.000
mean0.703-0.534=0.169
σ0.014-0.079=-0.065
min0.673-0.479=0.194
max0.770-0.773=-0.003

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.883-296.183=0.699
σ0.235-0.267=-0.032
min296.692-295.938=0.754
max297.510-296.907=0.603
mean2045.000-1972.000=73.000
σ0.000
min2045.000-1972.000=73.000
max2045.000-1972.000=73.000
mean0.568-0.570=-0.002
σ0.024-0.064=-0.040
min0.541-0.505=0.036
max0.601-0.713=-0.112

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean288.976-286.981=1.995
σ0.040-0.040=-0.001
min288.923-286.925=1.998
max289.019-287.025=1.994
mean1521.000-1657.000=-136.000
σ0.000
min1521.000-1657.000=-136.000
max1521.000-1657.000=-136.000
mean0.393-0.398=-0.004
σ0.009-0.010=-0.001
min0.383-0.390=-0.007
max0.404-0.414=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1299.285-1297.357=1.928
σ0.123-0.110=0.013
min1299.192-1297.230=1.962
max1299.492-1297.491=2.001
mean1521.000-1657.000=-136.000
σ0.000
min1521.000-1657.000=-136.000
max1521.000-1657.000=-136.000
mean1.904-1.952=-0.047
σ0.179-0.052=0.127
min1.797-1.867=-0.071
max2.216-1.995=0.220
iters=5
new-facts=6402
prior-facts=1
mean1543.528-1541.496=2.031
σ6.867-6.889=-0.022
min1540.267-1538.137=2.130
max1555.808-1553.814=1.995
mean1521.000-1657.000=-136.000
σ0.000
min1521.000-1657.000=-136.000
max1521.000-1657.000=-136.000
mean2.295-2.290=0.004
σ0.174-0.250=-0.077
min2.107-1.986=0.121
max2.548-2.524=0.024
iters=5
new-facts=6402
prior-facts=6402
mean1861.282-1859.294=1.988
σ0.051-0.067=-0.015
min1861.222-1859.216=2.006
max1861.337-1859.358=1.979
mean1732.800-1809.000=-76.200
σ219.210-157.979=61.231
min1521.000-1657.000=-136.000
max2045.000-1972.000=73.000
mean2.894-3.206=-0.312
σ0.052-0.323=-0.271
min2.842-2.863=-0.022
max2.959-3.682=-0.723

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.707-1.472=0.235
σ0.222-0.286=-0.064
min1.315-1.092=0.223
max1.845-1.848=-0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.341-446.570=0.771
σ580.935-580.936=-0.001
min156.872-156.100=0.772
max1318.743-1317.973=0.770
mean96.250
σ8.500
min92.000
max109.000
mean1521.000-1657.000=-136.000
σ0.000
min1521.000-1657.000=-136.000
max1521.000-1657.000=-136.000
mean0.534-0.553=-0.019
σ0.554-0.575=-0.020
min0.254-0.256=-0.002
max1.365-1.415=-0.049
policies=20
mean1569.012-1561.306=7.706
σ0.343-0.331=0.012
min1568.776-1561.078=7.698
max1569.521-1561.798=7.724
mean920.000
σ0.000
min920.000
max920.000
mean1521.000-1657.000=-136.000
σ0.000
min1521.000-1657.000=-136.000
max1521.000-1657.000=-136.000
mean2.604-2.598=0.006
σ0.021-0.006=0.014
min2.579-2.592=-0.014
max2.625-2.606=0.020
policies=200
mean15698.224-15621.265=76.959
σ0.106-0.065=0.041
min15698.137-15621.200=76.936
max15698.374-15621.354=77.021
mean9200.000
σ0.000
min9200.000
max9200.000
mean1521.000-1657.000=-136.000
σ0.000
min1521.000-1657.000=-136.000
max1521.000-1657.000=-136.000
mean26.305-26.212=0.093
σ0.087-0.048=0.039
min26.233-26.174=0.059
max26.424-26.283=0.141