Signal Processing and Networking for Big Data Applications

- Print publication year: 2017
- Online publication date: May 2017

- Publisher: Cambridge University Press
- DOI: https://doi.org/10.1017/9781316408032.015
- pp 322-360

[1] https://en.wikipedia.org/wiki/Andrew_File_System.

[2] https://en.wikipedia.org/wiki/Network_File_System.

[3] Proceedings of USENIX Symposium on Operating System Principles, Lake George, NY, USA, October 2003. , , and , “The google file system,” in

[4] Proceedings of ACM Special Interest Group on Management of Data Conference, Indianapolis, IN, USA, June 2010. , , , , , , and , “Pregel: A system for large–scale graph processing,” in

[5] Proceedings of Conference on Uncertainty in Artificial Intelligence, Catalina Island, USA, July 2010. , , , , , and , “Graphlab: A new framework for parallel machine learning,” in

[6] Proceedings of International Conference on Very Large Data Bases, Istanbul, Turkey, August 2012. , , , , , and , “Distributed graphlab: A framework for machine learning and data mining in the cloud,” in

[7] Solving multiple–block separable convex minimization problems using two–block alternating direction method of multipliers,” Pacific Journal on Optimization, vol. 11, no. 4, pp. 645–667, 2015. , , , and , “

[8] Proceedings of IEEE International Conference on Computer Communications, Turin, Italy, April 2013. , , , and , “Improving reduce task data locality for sequential MapReduce jobs,” in

[9] Proceedings of Eurosys Conference, Paris, France, April 2010. , , , , , and , “Delay scheduling: A simple technique for achieving locality and fairness in cluster scheduling,” in

[10] A scheduling philosophy for multiprocessing systems,” Communication of the ACM, vol. 11, no. 5, pp. 346–360, May 1968. , “

[11] PhD dissertation, Technical University of Berlin, 1996. , “Polytopes and scheduling,”

[12] Practical multiprocessor scheduling algorithms for efficient parallel processing,” IEEE Transactions on Computers, vol. 33, no. 11, pp. 1023–1029, November 1984. and , “

[13] A comparison of list schedules for parallel processing systems,” Communications of the ACM, vol. 17, no. 12, pp. 685–690, December 1974. , , and , “

[14] Approximation bounds for a general class of precedence constrained parallel machine scheduling problems,” SIAM Journal on Computing, vol. 35, no. 5, pp. 1241–1253, March 2006. and , “

[15] Proceedings of IEEE International Conference on Communications, Shanghai, China, April 2011. , , , , , and , “Scheduling in mapreduce–like systems for fast completion time,” in

[16] Proceedings of IEEE International Conference on Communications, Orlando, FL, USA, March 2012. , , and , “Joint scheduling of processing and shuffle phases in mapreduce systems,” in

[17] Proceedings of IEEE International Conference on Computer Communications, Toronto, Canada, April 2014. , , and , “Joint scheduling of mapreduce jobs with servers: Performance bounds and experiments,” in

[18] Proceedings of USENIX Operating System Design and Implementation, San Francisco, CA, USA, December 2004. and , “Mapreduce: Simplified data processing on large clusters,” in

[19] The 7th Workshop on Large–Scale Distributed Systems for Information Retrieval, Boston, MA, USA, July 2009. , “The curse of zipf and limits to parallelization: A look at the stragglers problem in mapreduce,” in

[20] Proceedings of IEEE International Conference on Data Engineering, Washington, DC, USA, April 2012. , , , and , “Load balancing in MapReduce based on scalable cardinality estimates,” in

[21] Open Cirrus Summit 2011, Atlanta, GA, USA, October 2011. , , , and , “A study of skew in MapReduce applications,” in

[22] Proceedings of ACMSpecial Interest Group on Management of Data Conference, Scottsdale, AZ, USA, May 2012. , , , and , “Skewtune: Mitigating skew in MapReduce applications,” in

[23] Proceedings of IEEE International Conference on Computer Communications, Hong Kong, China, April 2015. , , and , “Actcap: Accelerating MapReduce on heterogeneous clusters with capability–aware data placement,” in

[24] Proceedings of IEEE International Conference on Computer Communications, Toronto, Canada, April 2014. , , , and , “Online load balancing for MapReduce with skewed data input,” in

[25] IEEE Second International Conference on Cloud Computing Technology and Science, Washington, DC, USA, November 2010. , , , , , and , “Leen: Locality/fairness–aware key partitioning for mapreduce in the cloud,” in

[26] Proceedings of International Conference on Cloud Computing and Services Science, Noordwijkerhout, the Netherlands, May 2011. , , , and , “Handling data skew in MapReduce,” in

[27] Proceedings of USENIX Hot Topics in Operating Systems, Santa Ana Pueblo, NM, USA, May 2013. , , , , , , , and , “The case for tiny tasks in compute clusters,” in

[28] Proceedings of USENIX Symposium on Operating System Principles, Farmington, PA, USA, November 2013. , , , and , “Sparrow: Distributed, low latency scheduling,” in

[29] Proceedings of USENIX Annual Technical Conference, Santa Clara, CA, USA, July 2015. , , , and , “Hawk: Hybrid datacenter scheduling,” in

[30] Proceedings of IEEE/ACM Symposium on Quality of Services, Montreal, Canada, June 2013. , , , and , “On interference–aware provisioning for cloudbased big data processing,” in

[31] Proceedings of the ACM Special Interest Group on Data Communications Annual Conference, Helsinki, Finland, August 2012. , , , and , “The only constant is change: Incorporating time–varying network reservations in data centers,” in

[32] Proceedings of IEEE International Conference on Computer Communications, Toronto, Canada, April 2014. , , , and , “A deep investigation into network performance in virtual machine based cloud environments,” in

[33] Proceedings of ACM Symposium on Cloud Computing, San Jose, CA, USA, October 2012. , , , , and , “Heterogeneity and dynamicity of clouds at scale: Google trace analysis,” in

[34] Proceedings of IEEE/ACM International Symposium on Quality of Services, Beijing, China, June 2016. , , , and , “Tetris: Optimizing cloud resource usage unbalance with elastic VM,” in

[35] Proceedings of USENIX Networking System Design and Implementation, Boston, MA, USA, March 2011. , , , , , , , and , “Mesos: A platform for fine–grained resource sharing in the data center,” in

[36] Proceedings of ACM Eurosys Conference, Prague, Czech Republic, April 2013. , , , and , “Omega: Flexible, scalable schedulers for large compute clusters,” in

[37] Proceedings of ACM Eurosys Conference, Bordeaux, France, April 2015. , , , , , and , “Large–scale cluster management at Google with Borg,” in

[38] Proceedings of USENIX Annual Technical Conference, Broomfield, CO, USA, October 2014. , , , , , , , and , “Apollo: Scalable and coordinated scheduling for cloud–scale computing,” in

[39] Proceedings of USENIX Annual Technical Conference, Santa Clara, CA, USA, July 2015. , , and , “Bistro: Scheduling data–parallel jobs against live production systems,” in

[40] Proceedings of USENIX Networking System Design and Implementation, Boston, MA, USA, March 2011. , , , , , and , “Dominant resource fairness: Fair allocation of multiple resources types,” in

[41] Proceedings of ACM Symposium on Cloud Computing, San Jose, CA, USA, October 2012. , , , , and , “True elasticity in multi–tenant data–intensive compute clusters,” in

[42] Proceedings of USENIX Symposium on Operating System Principles, Big Sky, MT, USA, October 2009. , , , , , and , “Quincy: Fair scheduling for distributed computing clusters,” in

[43] Proceedings of USENIX Hot Topics in Cloud Computing, SanDiego, CA, USA, June 2009. , , and , “Towards optimizing hadoop provisioning in the cloud,” in

[44] Proceedings of IEEE International Conference on Cloud Computing, Washington, DC, USA, July 2011. and , “Towards optimal resource provisioning for running mapreduce programs in public clouds,” in

[45] Proceedings of ACM Symposium on Cloud Computing, Cascais, Portugal, October 2011. , , and , “No one (cluster) size fits all: Automatic cluster sizing for data–intensive analytics,” in

[46] Moving big data to the cloud: An online cost–minimizing approach,” IEEE Journal on Selected Areas in Communications Special Issue on Networking Challenges in Cloud Computing Systems and Applications, vol. 31, no. 12, pp. 2710–2721, December 2013. , , , , , and , “

[47] Robust and efficient distributed compression for cloud radio access networks,” IEEE Transactions on Vehicular Technology, vol. 62, no. 2, pp. 692–703, February 2013. , , , and , “

[48] Proceedings of IEEE International Conference on Parallel and Distributed Systems, Melbourne, Australia, December 2015. , , , and , “Matrixmap: Programming abstraction and implementation of matrix computation for big data applications,” in

[49] Mllib: Machine learning in apache spark,” Journal of Machine Learning Research, vol. 17, no. 34, pp. 1–7, 2016. , , , , , , , , , , , , , , , and , “

[50] http://spark.apache.org/docs/latest/mllib–guide.html.

[51] Nonlinear Programming, 2nd ed., Belmont, MA, USA: Athena Scientific, 1999. ,

[52] Introductory lectures on Convex Optimization: A Basic Course, Springer, 2004. ,

[53] On the convergence of the coordinate descent method for convex differentiable minimization,” Journal of Optimization Theory and Application, vol. 72, no. 1, pp. 7–35, 1992. and , “

[54] On the linear convergence of descent methods for convex essentially smooth minimization,” SIAM Journal on Control and Optimization, vol. 30, no. 2, pp. 408–425, 1992. and , “

[55] A unified algorithmic framework for block–structured optimization involving big data,” IEEE Signal Processing Magazine, vol. 33, no. 1, pp. 57–77, 2016. , , , and , “

[56] Neuro–Dynamic Programming, Belmont, MA, USA: Athena Scientific, 1996. and ,

[57] 2014, pp. 7208–7212. , , and , “Flexible parallel algorithms for big data optimization,” in 2014 IEEE International Conference on Acoustics, Speech and Signal Processing, May

[58] Decomposition by partial linearization: Parallel optimization of multi–agent systems,” IEEE Transactions on Signal Processing, vol. 63, no. 3, pp. 641–656, February 2014. , , , , and , “

[59] PhD thesis, University of Minnesota, 2014. , “Successive convex approximation: Analysis and applications,”

[60] Proceedings of the Neural Information Processing Systems, Montreal, Canada, December 2014, pp. 1440–1448. , , , and , “Parallel successive convex approximation for nonsmooth nonconvex optimization,” in

[61] Iterative Solution of Nonlinear Equations in Several Variables, Academic Press, 1970. and ,

[62] A quadratic programming procedure,” Naval Research Logistics Quarterly, vol. 4, no. 1, pp. 79–85, March 1957. , “

[63] Minimizing certain convex functions,” Journal of the Society for Industrial and Applied Mathematics, vol. 11, no. 3, pp. 588–593, September 1963. , “

[64] Optimisation. Méthodes numériques, Masson, 1976. ,

[65] On the convergence of sequential minimization algorithms,” Journal of Optimization Theory and Applications, vol. 12, no. 6, pp. 567–575, December 1973. and , “

[66] On search directions for minimization algorithms,” Mathematical Programming, vol. 4, no. 1, pp. 193–201, December 1973. , “

[67] A unified convergence analysis of block successive minimization methods for nonsmooth optimization,” SIAM Journal on Optimization, vol. 23, no. 2, pp. 1126–1153, June 2013. , , and , “

[68] A random coordinate descent algorithm for optimization problems with composite objective function and linear coupled constraints,” Computational Optimization and Applications, vol. 57, no. 2, pp. 307–377, March 2014. and , “

[69] Convergence of a block coordinate descent method for nondifferentiable minimization,” Journal of Optimization Theory and Applications, vol. 103, no. 9, pp. 475–494, June 2001. , “

[70] Maximum block improvement and polynomial optimization,” SIAM Journal on Optimization, vol. 22, no. 1, pp. 87–107, January 2012. , , , and , “

[71] Error bounds and convergence analysis of feasible descent methods: A general approach,” Annals of Operations Research, vol. 46, no. 1, pp. 157–178, February 1993. and , “

[72] Efficiency of coordinate descent methods on huge–scale optimization problems,” SIAM Journal on Optimization, vol. 22, no. 2, pp. 341–362, April 2012. , “

[73] On the convergence of block coordinate descent type methods,” SIAM Journal on Optimization, vol. 23, no. 4, pp. 2037–2060, 2013. and , “

[74] 2013, http://arXiv:1310.6957. , , , and , “Iteration complexity analysis of block coordinate descent methods,” preprint,

[75] 2013, http://arXiv:1306.5918. and , “Randomized block coordinate non–monotone gradient method for a class of nonlinear programming,” preprint,

[76] Iteration complexity of randomized block–coordinate descent methods for minimizing a composite function,” Mathematical Programming, vol. 144, no. 1–2, pp. 1–38, 2014. and , “

[77] Maximum likelihood from incomplete data via the EM algorithm,” Journal of the Royal Statistical Society Series B, vol. 39, no. 1, pp. 1–38, 1977. , , and , “

[78] The concave–convex procedure,” Neural Computation, vol. 15, no. 4, pp. 915–936, April 2003. and , “

[79] Advances in Neural Information Processing Systems, ed. , , and , MIT Press, 2001, pp. 556–562. and , “Algorithms for non–negative matrix factorization,” in

[80] An iteratively weighted MMSE approach to distributed sum–utility maximization for a MIMO interfering broadcast channel,” IEEE Transactions on Signal Processing, vol. 59, no. 9, pp. 4331–4340, September 2011. , , , and , “

[81] Multiplier and gradient methods,” Journal of Optimization Theory and Applications, vol. 4, no. 5, pp. 303–320, 1969. , “

[82] Optimization, ed. , New York: Academic Press, 1972, pp. 283–298. , “A method for nonlinear constraints in minimization problems,” in

[83] Augmented Lagrangian and Operator–Splitting Methods in Nonlinear Mechanics, Philadelphia, PA, USA: SIAM, 1989. and ,

[84] Convergence analysis of a proximal–like minimization algorithm using Bregman functions,” SIAM Journal on Optimization, vol. 3, no. 3, pp. 538–543, 1993. and , “

[85] Multi–agent distributed optimization via inexact consensus ADMM,” IEEE Transactions on Signal Processing, vol. 63, no. 2, pp. 482–497, January 2015. , , and , “

[86] Distributed optimization and statistical learning via the alternating direction method of multipliers,” Foundations and Trends in Machine Learning, vol. 3, no. 1, pp. 1–122, 2011. , , , , and , “

[87] Numerical Methods for Nonlinear Variational Problems, New York: Springer–Verlag, 1984. ,

[88] On the O(1/n) convergence rate of the Douglas–Rachford alternating direction method,” SIAM Journal on Numerical Analysis, vol. 50, no. 2, pp. 700–709, 2012. and , “

[89] On nonergodic convergence rate of Douglas–Rachford alternating direction method of multipliers,” Numerische Mathematik, vol. 130, no. 3, pp. 567–577, 2015. and , “

[90] Fast alternating linearization methods for minimizing the sum of two convex functions,” Mathematical Programming, vol. 141, no. 1–2, pp. 349–382, 2012. , , and , “

[91] Fast alternating direction optimization methods,” UCLA CAM Report
12–35, 2012. , , and , “

[92] 2012. and , “On the global linear convergence of the alternating direction method of multipliers,” Rice University CAAM Technical Report TR12–14,

[93] Laboratory for Information and Decision Systems, MIT, http://hdl.handle.net/1721.1/3197, 1990. and , “An alternating direction method for linear programming,”

[94] On the global and linear convergence of the generalized alternating direction method of multipliers,” Journal of Scientific Computing, vol. 66, no. 3, pp. 889– 916, 2016. and , “

[95] 2016, http://arXiv:1208.3922. and , “On the linear convergence of the alternating direction method of multipliers,” accepted by Mathematical Programming Series A,

[96] Local linear convergence of the alternating direction method of multipliers on quadratic or linear programs,” SIAM Journal on Optimization, vol. 23, no. 4, pp. 2183– 2207, 2013. , “

[97] The direct extension of ADMM for multi–block convex minimization problems is not necessarily convergent,” Mathematical Programming, vol. 155, no. 1–2, pp. 57–98, 2016. , , , and , “

[98] 22, no. 2, pp. 313–340, 2012. , , and , “Alternating direction method with Gaussian back substitution for separable convex programming,” SIAM Journal on Optimization, vol.

[99] On the proximal Jacobian decomposition of ALM for multipleblock separable convex minimization problems and its relationship to ADMM,” Journal of Scientific Computing, vol. 66, no. 3, pp. 1204–1217, 2016. , , and , “

[100] 2014, http://arXiv:1312.3040. , , , and , “Parallel multi–block ADMM with o (1/k) convergence,” preprint,

[101] 2013, http://arXiv:1401.7079. , , , , , and , “A block successive upper bound minimization method of multipliers for linearly constrained convex optimization,” preprint,

[102] First–order algorithms for convex optimization with nonseparate objective and coupled constraints,” Optimization online, vol. 3, p. 5, 2015. and , “

[103] 2010. , “An alternating direction algorithm for nonnegative matrix factorization,” preprint,

[104] 2014, pp. 6201–6205. and , “Alternating direction method of multipliers for non–negative matrix factorization with the beta–divergence,” in IEEE International Conference on Acoustics, Speech and Signal Processing, May

[105] Alternating directions method of multipliers for l1–penalized zero variance discriminant analysis and principal component analysis,” Computational Optimization and Applications, vol. 64, no. 3, pp. 725–754, 2016. and , “

[106] Alternating direction method of multipliers for real and complex polynomial optimization models,” Optimization, vol. 63, no. 6, pp. 883–898, 2014. , , and , “

[107] Proceedings of International Conference on Machine Learning, Beijing, China, June 2014, pp. 1701–1709. and , “Asynchronous distributed ADMM for consensus optimization,” in

[108] Distributed clustering using wireless sensor networks,” IEEE Journal of Selected Topics in Signal Processing, vol. 5, no. 4, pp. 707–724, August 2011. , , and , “

[109] Alternating direction methods for classical and ptychographic phase retrieval,” Inverse Problems, vol. 28, no. 11, pp. 1–18, 2012. , , , and , “

[110] Convergence analysis of alternating direction method of multipliers for a family of nonconvex problems,” SIAM Journal on Optimization, vol. 26, no. 1, pp. 337–364, 2016. , , and , “

[111] Weakly Differentiable Functions: Sobolev Spaces and Functions of Bounded Variation, Graduate Texts in Mathematics, New York, USA: Springer, 1989. ,

[112] The Kullback–Leibler distance,” The American Statistician, vol. 41, no. 4, pp. 340–341, 1987. , “

[113] Information Theory and Statistics, Mineola, NY, USA: Dover Pubns, 1997. ,

[114] Applied Logistic Regression, vol. 354, Hoboken, NJ, USA: Wiley–Interscience, 2000, vol. 354. and ,

[115] Proceedings of the International Conference on Machine Learning, New York, NY, USA: ACM, July 2008, pp. 272–279. , , , and , “Efficient projections onto the l1– ball for learning in high dimensions,” in

[116] Proceedings of the Annual International Conference on Machine Learning, Montreal, QC, Canada, 2009, pp. 857–864. , , , and , “An efficient projection for regularization,” in

[117] Proceedings of Annual International Conference on Machine Learning, Montreal, QC, Canada, 2009, pp. 657–664. and , “Efficient Euclidean projections in linear time,” in

[118] Probing the Pareto frontier for basis pursuit solutions,” SIAM Journal on Scientific Computing, vol. 31, no. 2, pp. 890–912, 2008. and , “

[119] 2008. , , , and , “Group sparsity via lineartime projection,” Optimization Online,

[120] Convex Optimization, Cambridge University Press, 2004. and ,

[121] A coordinate gradient descent method for nonsmooth separable minimization,” Mathematical Programming, vol. 117, no. 1, pp. 387–423, 2009. and , “

[122] 2012. , , and , “A unified convergence analysis of coordinatewise successive minimization methods for nonsmooth optimization,” Report of University of Minnesota, Twin Cites

[123] DOA estimation using a greedy block coordinate descent algorithm,” IEEE Transactions on Signal Processing, vol. 60, no. 12, pp. 6382–6394, December 2012. , , and , “

[124] De–noising by soft–thresholding,” IEEE Transactions on Information Theory, vol. 41, no. 3, pp. 613–627, May 1995. , “

[125] A singular value thresholding algorithm for matrix completion,” SIAM Journal on Optimization, vol. 20, no. 4, pp. 1956–1982, 2008. , , and , “

[126] Fixed point and Bregman iterative methods for matrix rank minimization,” Mathematical Programming Series A, vol. 128, no. 1–2, pp. 321–353, 2011. , , and , “

[127] Fast singular value thresholding without singular value decomposition,” UCLA CAM Report 10–24, vol. 5, 2010. and , “

[128] Nonlinear total variation based noise removal algorithms,” Physica D: Nonlinear Phenomena, vol. 60, no. 1–4, pp. 259–268, 1992. , , and , “

[129] Image restoration with discrete constrained total variation, Part I: Fast and exact optimization,” Journal of Mathematical Imaging and Vision, vol. 26, no. 3, pp. 261–276, 2006. and , “

[130] Parametric maximum flow algorithms for fast total variation minimization,” SIAM Journal on Scientific Computing, vol. 31, no. 5, pp. 3712– 3743, 2009. and , “

[131] Continuation method for total variation denoising problems,” Advanced Signal Processing Algorithms, vol. 2563, no. 1, pp. 314–325, 1995. , , and , “

[132] An algorithm for total variation minimization and applications,” Journal of Mathematical Imaging and Vision, vol. 20, no. 1–2, pp. 89–97, 2004. , “

[133] 2005. , “Total variation minimization and a class of binary MRF models,” Energy Minimization Methods in Computer Vision and Pattern Recognition, Lecture Notes in Computer Science 3757, pp. 136–152,

[134] An iteratively reweighted norm algorithm for minimization of total variation functionals,” IEEE Signal Processing Letters, vol. 14, no. 12, pp. 948–951, December 2007. and , “

[135] A new alternating minimization algorithm for total variation image reconstruction,” SIAM Journal on Imaging Sciences, vol. 1, no. 3, pp. 248–272, 2008. , , , and , “

[136] The split Bregman method for l1 regularized problems,” SIAM Journal on Imaging Sciences, vol. 2, no. 2, pp. 323–343, 2009. and , “

[137] Proceedings of the Neural Information Processing Sytems, Lake Tohoe, NV, USA, December 2013, pp. 458–466. , “Better approximation and faster algorithm using the proximal average,” in

[138] 2013, pp. 91–99. , “On decomposing the proximal map,” in Proceedings of the Neural Information Processing Sytems,

[139] An EM algorithm for wavelet–based image restoration,” IEEE Transactions on Image Processing, vol. 12, no. 8, pp. 906–916, August 2003. and , “

[140] A note on wavelet–based inversion algorithms,” Contemporary Mathematics, vol. 313, pp. 85–96, 2002. and , “

[141] 2004. , , , and , “A unified variational framework for image restoration,” European Conference on Computer Vision, Prague, Lecture Notes in Computer Sciences 3024, pp. 1–13,

[142] On the numerical solution of the heat conduction problem in 2 and 3 space variables,” Transactions of the American Mathematical Society, vol. 82, pp. 421–439, 1956. and , “

[143] The numerical solution of parabolic elliptic differential equations,” SIAM Journal on Applied Mathematics, vol. 3, no. 1, pp. 28–41, 1955. and , “

[144] A dual algorithm for the solution of nonlinear variational problems via finite–element approximations,” Computers and Mathematics with Applications, vol. 2, no. 1, pp. 17–40, 1976. and , “

[145] On the Douglas–Rachford splitting method and the proximal point algorithm for maximal monotone operators,” Mathematical Programming, vol. 55, no. 1–3, pp. 293–318, 1992. and , “

[146] Augmented Lagrangian Methods, Ambsterdam, New York, USA: North–Holland, 1983. and ,

[147] Signal recovery by proximal forward–backward splitting,” Multiscale Modeling and Simulation, vol. 4, no. 4, pp. 1168–1200, 2005. and , “

[148] Convex Analysis, Princeton, USA: Princeton University Press, 1970. ,

[149] 2008. , , , and , “An efficient algorithm for compressed MR imaging using total variation and wavelets,” IEEE International Conference on Computer Vision and Pattern Recognition, pp. 1–8, September

[150] Sparsity and smoothness via the fused lasso,” Journal of the Royal Statistical Society: Series B (Statistical Methodology), vol. 67, no. 1, pp. 91–108, 2005. , , , , and , “

[151] On the linear convergence of descent methods for convex essentially smooth minimization,” SIAM Journal on Control and Optimization, vol. 30, no. 2, pp. 408–425, 1990. and , “

[152] Fixed–point continuation for l1–minimization: Methodology and convergence,” SIAM Journal on Optimization, vol. 19, no. 3, pp. 1107–1130, 2008. , , and , “

[153] A method of solving a convex programming problem with convergence rate O(1/k2),” Soviet Mathematics Doklady, vol. 27, no. 2, pp. 372–376, 1983. , “

[154] 2007. , “Gradient methods for minimizing composite objective function,” www.optimization–online.org, CORE Discussion Paper 2007/76,

[155] 2008. , “On accelerated proximal gradient methods for convex–concave optimization,” submitted to SIAM Journal on Optimization,

[156] A fast iterative shrinkage–thresholding algorithm for linear inverse problems,” SIAM Journal on Imaging Sciences, vol. 2, no. 1, pp. 183–202, 2009. and , “

[157] NESTA: A fast and accurate first–order method for sparse recovery,” SIAM Journal on Imaging Sciences, vol. 4, no. 1, pp. 1–39, 2011. , , and , “

[158] 2011. , , and , “Group sparse optimization by alternating direction method,” Rice University CAAM Technical Report TR11–06,

[159] Guaranteed minimum–rank solutions of linear matrix equations via nuclear norm minimization,” SIAM Review, vol. 52, no. 3, pp. 471–501, 2010. , , and , “

[160] The relaxation method of finding the common points of convex sets and its application to the solution of problems in convex programming,” USSR Computational Mathematics and Mathematical Physics, vol. 7, no. 3, pp. 200–217, 1967. , “

[161] Error forgetting of Bregman iteration,” Journal of Scientific Computing, vol. 54, no. 2–3, pp. 684–95, 2013. and , “

[162] An iterative regularization method for total variation–based image restoration,” SIAM Journal on Multiscale Modeling and Simulation, vol. 4, no. 2, pp. 460–489, 2005. , , , , and , “

[163] Alternating direction algorithms for problems in compressive sensing,” SIAM Journal on Scientific Computing, vol. 33, no. 1, pp. 250–278, 2011. and , “

[164] Robust principal component analysis?” Journal of the ACM, vol. 58, no. 3, pp. 1–37, 2011. , , , and , “

[165] Least angle regression,” The Annals of Statistics, vol. 32, no. 2, pp. 407–499, 2004. , , , and , “

[166] Applied Mathematics and Parallel Computing, Springer, 1996, pp. 57–76. , “An algorithm for the solution of the parametric quadratic programming problem,” in

[167] 2010, http://arXiv:1009.4219. , , and , “Safe feature elimination in sparse supervised learning,” preprint,

[168] Strong rules for discarding predictors in lasso-type problems,” Journal of the Royal Statistical Society: Series B (Statistical Methodology), vol. 74, no. 2, pp. 245-266, 2012. , , , , , , and , “

[169] Sparse reconstruction by separable approximation,” IEEE Transactions on Signal Processing, vol. 57, no. 7, pp. 2479-2493, July 2009. , , and , “

[170] On the convergence of an active set method for l1-minimization,” Optimization Methods and Software, vol. 27, no. 6, pp. 1127-1146, 2012. , , , and , “

[171] Numerical Optimization, New York, USA: Springer- Verlag, 1999. and ,

[172] Signal recovery from random measurements via orthogonal matching pursuit,” IEEE Transactions on Information Theory, vol. 53, no. 12, pp. 4655-4666, December 2007. and , “

[173] Sparse solution of underdetermined linear equations by stagewise orthogonal matching pursuit,” submitted to IEEE Transactions on Information Theory, 2006. , , , and , “

[174] Signal recovery from incomplete and inaccurate measurements via regularized orthogonal matching pursuit,” IEEE Journal of Selected Topics in Signal Processing, vol. 4, no. 2, pp. 310-316, April 2010. and , “

[175] 2008. and , “Subspace pursuit for compressive sensing: Closing the gap between performance and complexity,” arXiv:0803.0811v1 [cs.NA],

[176] Cosamp: Iterative signal recovery from incomplete and inaccurate samples,” Applied and Computational Harmonic Analysis, vol. 26, no. 3, pp. 301-321, 2009. and , “

[177] Hard thresholding pursuit: An algorithm for compressive sensing,” SIAM Journal on Numerical Analysis, vol. 49, no. 6, pp. 2543-2563, 2011. , “

[178] Sparse signal reconstruction via iterative support detection,” SIAM Journal on Imaging Sciences, vol. 3, no. 3, pp. 462-491, 2010. and , “

[179] Iterative hard thresholding for compressed sensing,” Applied and Computational Harmonic Analysis, vol. 27, no. 3, pp. 265-274, 2009. and , “

[180] Normalized iterative hard thresholding: Guaranteed stability and performance,” IEEE Journal of Selected Topics in Signal Processing, vol. 4, no. 2, pp. 298-309, April 2010. and , “

[181] Bregman iterative algorithms for l1-minimization with applications to compressed sensing,” SIAM Journal on Imaging Sciences, vol. 1, no. 1, pp. 143-168, 2008. , , , and , “

[182] Fast linearized Bregman iteration for compressive sensing and sparse denoising,” Communications in Mathematical Sciences, vol. 8, no. 1, pp. 93-111, 2010. , , , and , “

[183] An accelerated proximal gradient algorithm for nuclear norm regularized linear least squares problems,” Pacific Journal of Optimization, vol. 6, no. 15, pp. 615-640, 2010. and , “

[184] Linearized augmented Lagrangian and alternating direction methods for nuclear norm minimization,” Mathematics of Computation, vol. 82, no. 281, pp. 301-329, 2013. and , “

[185] Matrix completion from a few entries,” IEEE Transactions on Information Theory, vol. 56, no. 6, pp. 2980-2998, June 2010. , , and , “

[186] Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm,” Mathematical Programming Computation, vol. 4, no. 4, pp. 333-361, 2012. , , and , “

[187] Model-based compressive sensing,” IEEE Transactions on Information Theory, vol. 56, no. 4, pp. 1982-2001, April 2010. , , , and , “

[188] Proceedings of IEEE Workshop on Quality of Services, New Haven, CT, USA, June 2006. , , and , “Partial network coding: Theory and application in continuous sensor data collection,” in

[189] Approximating the minimum spanning tree weight in sublinear time,” SIAM Journal on computing, vol. 34, no. 6, pp. 1370-1379, July 2005. , , and , “

[190] Sublinear algorithm surveys, Online: http://people.csail.mit.edu/ronitt/sublinear.html.

[191] Subspace learning and imputation for streaming big data matrices and tensors,” IEEE Transactions on Signal Processing, vol. 63, no. 10, pp. 2663-2677, May 2015. , , and , “

[192] A tensor-based approach for big data representation and dimensionality reduction,” IEEE Transactions on Emerging Topics in Computing, vol. 2, no. 3, pp. 280-291, September 2014. , , , , , and , “

[193] International Conference on Big Data and Smart Computing, Jeju Island, Korea, February 2015, pp. 11-14. , , , , and , “Tensor decomposition of Toeplitz jacket matrices for big data processing,” in

[194] Breaking the curse of dimensionality using decompositions of incomplete tensors: Tensor-based scientific computing in big data analysis,” IEEE Signal Processing Magazine, vol. 31, no. 5, pp. 71-79, September 2014. , , , and , “

[195] Parallel randomly compressed cubes : A scalable distributed architecture for big tensor decomposition,” IEEE Signal Processing Magazine, vol. 31, no. 5, pp. 57-70, September 2014. , , and , “

[196] Tensor decompositions and applications,” SIAM Review, vol. 51, no. 3, pp. 455-500, 2009. and , “

[197] Analysis of individual differences in multidimensional scaling via an N-way generalization of ‘Eckart-Young’ decomposition,” Psychometrika, vol. 35, no. 3, pp. 283-319, 1970. and , “

[198] Parafac2: Mathematical and technical notes,” UCLA Working Papers in Phonetics, vol. 22, no. 3044, p. 122215, 1972. , “

[199] Candelinc: A general approach to multidimensional analysis of many-way arrays with linear constraints on parameters,” Psychometrika, vol. 45, no. 1, pp. 3-24, 1980. , , and , “

[200] First Joint Meeting of the Psychometric Society and the Society for Mathematical Psychology, McMaster University, Hamilton, Ontario, vol. 5, 1978. , “Models for analysis of asymmetrical relationships among N objects or stimuli,” in

[201] Uniqueness proof for a family of models sharing features of tucker's three-mode factor analysis and parafac/candecomp,” Psychometrika, vol. 61, no. 1, pp. 133-154, 1996. and , “

[202] Parafac algorithms for large-scale problems,” Neurocomput., vol. 74, no. 11, pp. 1970-1984, May 2011, http://dx.doi.org/10.1016/j.neucom.2010.06.030.
and , “

[203] Conference of ThRee-Way Methods in Chemistry and Psychology, Chania, Greece, June 2006. , , and , “The constrained block-PARAFAC decomposition,” in

[204] “COMFAC: Matlab code for LS fitting of the complex PARAFAC model in 3-D,” http://people.ece.umn.edu/ñikos/comfac.m.

[205] “Factoring tensors in the cloud: A tutorial on big tensor data analytics,” www.cs.cmu.edu /~epapalex/tutorials/icassp14.html.

[206] Multi-way compressed sensing for sparse low-rank tensors,” IEEE Signal Processing Letters, vol. 19, no. 11, pp. 757-760, August 2012. and , “

[207] On generic identifiability of 3-tensors of small rank,” SIAM Journal on Matrix Analysis and Applications, vol. 33, no. 3, pp. 1018-1037, 2012. and , “

[208] Tensor completion for estimating missing values in visual data,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 1, pp. 208-220, January 2013. , , , and , “

[209] Tensor completion and low-n-rank tensor recovery via convex optimization,” Inverse Problems, vol. 27, no. 2, p. 025010, 2011. , , and , “

[210] Tensor versus matrix completion: A comparison with application to spectral data,” IEEE Signal Processing Letters, vol. 18, no. 7, pp. 403-406, July 2011. , , , and , “

[211] Low-rank tensor completion by Riemannian optimization,” BIT Numerical Mathematics, vol. 54, no. 2, pp. 447-468, 2014. , , and , “

[212] 2013, http://arXiv:1312.1254.
, , , and , “Parallel matrix factorization for low-rank tensor completion,” preprint,

[213] On tensor completion via nuclear norm minimization,” Foundations of Computational Mathematics, vol. 16, no. 4, pp. 1031-1068, 2016. and , “

[214] Graph-theoretical methods for detecting and describing gestalt clusters,” IEEE Transactions on Computers, vol. C-20, no. 1, pp. 68-86, January 1971. , “

[215] Tensor voting: A perceptual organization approach to computer vision and machine learning,” Synthesis Lectures on Image, Video, and Multimedia Processing, vol. 2, no. 1, pp. 1-136, 2006. and , “

[216] An Efficient Method for Tensor Voting Using Steerable Filters, Berlin, Heidelberg, Germany: Springer Berlin Heidelberg, 2006, pp. 228-240. , , , , and ,

[217] The design and use of steerable filters,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 13, no. 9, pp. 891-906, September 1991. and , “

[218] Proceedings of IEEE Global Communications Conference, Austin, TX, USA, December 2014, pp. 4891-4897. , , , and , “Mobile trace inference based on tensor voting,” in

[219] PhD dissertation, Troy, NY, USA, 2008. , “Range data analysis by free-space modeling and tensor voting,”

[220] Batch and adaptive parafac-based blind separation of convolutive speech mixtures,” IEEE Transactions on Audio, Speech, and Language Processing, vol. 18, no. 6, pp. 1193-1207, August 2010. , , , and , “

[221] Blind parafac receivers for DS-CDMA systems,” IEEE Transactions on Signal Processing, vol. 48, no. 3, pp. 810-823, March 2000. , , and , “

[222] Parallel factor analysis in sensor array processing,” IEEE Transactions on Signal Processing, vol. 48, no. 8, pp. 2377-2388, August 2000. , , and , “

[223] ParCube: Sparse Parallelizable Tensor Decompositions. Berlin, Heidelberg, Germany: Springer Berlin Heidelberg, 2012, pp. 521-536. , , and ,

[224] Least squares algorithms under unimodality and nonnegativity constraints,” Journal of Chemometrics, vol. 12, no. 4, pp. 223-247, 1998. and , “

[225] Tensor decompositions for signal processing applications: From two-way to multiway component analysis,” IEEE Signal Processing Magazine, vol. 32, no. 2, pp. 145-163, March 2015. , , , , , , and , “

[226] High-order tensor decomposition for large-scale data analysis,” in IEEE International Congress on Big Data, June 2015, pp. 665-668. and , “

[227] 2014, http://arXiv:1407.139.
, , and , “Generalized higher-order tensor decomposition via parallel ADMM,” preprint,

[228] Tensor subspace analysis,” in Advances in Neural Information Processing Systems, vol. 18, pp. 499-506, 2005. , , and , “

[229] A block coordinate descent method for regularized multiconvex optimization with applications to nonnegative tensor factorization and completion,” SIAM Journal on Imaging Sciences, vol. 6, no. 3, pp. 1758-1789, 2013. and , “

[230] 2013, http://arXiv:1307.4653.
and , “A new convex relaxation for tensor completion,” preprint,

[231] A splitting augmented Lagrangian method for low multilinear-rank tensor recovery,” Asia-Pacific Journal of Operational Research, vol. 32, no. 1, p. 1540008, 2015. , , and , “

[232] Alternating proximal gradient method for sparse nonnegative tucker decomposition,” Mathematical Programming Computation, vol. 7, no. 1, pp. 39-70, 2015. , “

[233] Block coordinate update method in tensor optimization,” Siam J. Imaging Sciences, vol. 6, no. 3, pp. 1758-1789, 2014. , “

[234] An efficient matrix factorization method for tensor completion,” IEEE Signal Processing Letters, vol. 20, no. 4, pp. 307-310, April 2014. and , “

[235] 2011. , , , and , “Statistical performance of convex tensor decomposition,” NIPS–11 Proceedings of the 24th International Conference on Neural Information Processing Systems, pp. 972-980,

[236] Generalized higher order orthogonal iteration for tensor learning and decomposition,” IEEE Transactions on Neural Networks and Learning Systems, vol. 27, no. 12, pp. 2551-2563, November 2015. , , , , and , “

[237] Advances in Neural Information Processing Systems, Lake Tohoe, NV, USA, December 2013, pp. 836-844. and , “Low-rank matrix and tensor completion via adaptive sampling,” in

[238] 2015, pp. 53-56. , , , and , “Overcomplete tensor decomposition via convex optimization,” in IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, December

[239] Robust low-rank tensor recovery: Models and algorithms,” SIAM Journal on Matrix Analysis and Applications, vol. 35, no. 1, pp. 225-253, 2014. and , “

[240] 2009, pp. 525-529. , , , and , “Symmetric tensor decomposition,” in European Signal Processing Conference,

[241] Tensor based missing traffic data completion with spatial-temporal correlation,” Physica A: Statistical Mechanics and its Applications, vol. 446, pp. 54-63, 2016. , , , and , “

[242] 2009, pp. 2114-2121. , , , and , “Tensor completion for estimating missing values in visual data,” in IEEE International Conference on Computer Vision, September

[243] 2015, http://ArXiv:1502.06930.
and , “Tensor decomposition with generalized lasso penalties,” preprint,

[244] Tensor principal component analysis via convex optimization,” Mathematical Programming, vol. 150, no. 2, pp. 423-457, 2015. , , and , “

[245] 2014, pp. 417-420. , , , and , “Truncated nuclear norm minimization for tensor completion,” in IEEE Sensor Array and Multichannel Signal Processing Workshop, June

[246] 2008, pp. 1-7. and , “Efficient tensor voting with 3D tensorial harmonics,” in IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, June

[247] 1993, pp. 786-787. and , “Inferring global perceptual contours from local features,” in Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, June

[248] 2002, pp. 181-186. , , and , “Continuous multi-views tracking using tensor voting,” in Proceedings of Workshop on Motion and Video Computing, 2002, December

[249] Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Hilton Head Island, SC, USA, June 2000, vol. 2. and , “Tracking segmented objects using tensor voting,” in

[250] 3-D image pre-processing algorithms for improved automated tracing of neuronal arbors,” Neuroinformatics, vol. 9, no. 2, pp. 219-231, 2011. , , and , “

[251] Multifeature object trajectory clustering for video analysis,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 18, no. 11, pp. 1555-1564, November 2008. and , “

[252] A unifying framework of mining trajectory patterns of various temporal tightness,” IEEE Transactions on Knowledge and Data Engineering, vol. 27, no. 6, pp. 1478-1490, June 2015. , , and , “

[253] Satellite tracking of a fin whale (Balaenoptera physalus) in the north-western Mediterranean Sea and fractal analysis of its trajectory,” Hydrobiologia, vol. 452, no. 1, pp. 163-171, 2001. and , “

[254] International Conference on Design of Reliable Communication Networks, Kansas City, MO, USA, March 2015, pp. 125-132. and , “Robustness analysis of mobile ad hoc networks using human mobility traces,” in

[255] International Conference on Pattern Recognition, Tsukuba Science City, Japan, November 2012, pp. 3716-3720. and , “Unsupervised multi-target trajectory detection, learning and analysis in complicated environments,” in

[256] Proceedings of International Conference on Artificial Intelligence, Modelling and Simulation, Kota Kinabalu, Malaysia, December 2013, pp. 289-293. and , “Rectified trajectory analysis based abnormal loitering detection for video surveillance,” in

[257] “Deep learning wikipedia,” https://en.wikipedia.org/wiki/Deep_learning.

[258] 1966. and , “Cybernetic predicting devices,” DTIC Document, Tech. Rep.,

[259] Polynomial theory of complex systems,” IEEE Transactions on Systems, Man, and Cybernetics, vol. SMC-1, no. 4, pp. 364-378, October 1971. , “

[260] Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position,” Biological Cybernetics, vol. 36, no. 4, pp. 193-202, 1980. , “

[261] Learning complex, extended sequences using the principle of history compression,” Neural Computation, vol. 4, no. 2, pp. 234-242, March 1992. , “

[262] Deep learning in neural networks: An overview,” Neural Networks, vol. 61, pp. 85-117, 2015. , “

[263] Habilitation thesis, TUM, 1993. ,

[264] The ‘wake-sleep’ algorithm for unsupervised neural networks,” Science, vol. 268, no. 5214, p. 1158, 1995. , , , and , “

[265] Untersuchungen zu dynamischen neuronalen netzen,” in Diploma, Technische Universitat Munchen, p. 91, 1991. , “

[266] 2001. , , , and , “Gradient flow in recurrent nets: The difficulty of learning long-term dependencies,”

[267] Deep Learning,” Scholarpedia, vol. 10, no. 11, p. 32832, 2015, revision no. 152272. , “

[268] Proceedings of the 5th National Conference on Artificial Intelligence. Philadelphia, PA, August 11-15, Science, vol. 1, 1986. , “Learning while searching in constraint-satisfaction problems,”

[269] Multi-Valued and Universal Binary Neurons: Theory, Learning and Applications, Springer Science & Business Media, 2013. , , and ,

[270] Learning multiple layers of representation,” Trends in Cognitive Sciences, vol. 11, no. 10, pp. 428-434, 2007. , “

[271] Long short-term memory,” Neural Computation, vol. 9, no. 8, pp. 1735-1780, November 1997. and , “

[272] Proceedings of the 23rd International Conference on Machine Learning, ser. ICML –06. New York, NY, USA: ACM, 2006, pp. 369-376. , , , and , “Connectionist temporal classification: Labelling unsegmented sequence data with recurrent neural networks,” in

[273] 2014, http://arXiv:1402.1128.
, , and , “Long short-term memory based recurrent neural network architectures for large vocabulary speech recognition,” preprint,

[274] 2015. and , “Constructing long short-term memory based deep recurrent neural networks for large vocabulary speech recognition,” IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 4520-4524, April

[275] Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, Brisbane, Australia, April 2015, pp. 4470-4474. and , “Unidirectional long short-term memory recurrent neural network with recurrent output layer for low-latency speech synthesis,” in

[276] Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups,” IEEE Signal Processing Magazine vol. 29, no. 6, pp. 82-97, November 2012.
et al., “

[277] 2013, pp. 8599-8603. , , and , “New types of deep neural network learning for speech recognition and related applications: An overview,” in 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, May

[278] 2013, pp. 8604-8608. , , , , , , , , , , , and , “Recent advances in deep learning for speech research at Microsoft,” in 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, May

[279] 2013, pp. 6669-6673. , , and , “A deep convolutional neural network using heterogeneous pooling for trading acoustic invariance with phonetic confusion,” in 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, May

[280] Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, Vancouver, BC, Canada, May 2013, pp. 8614-8618. , , , and , “Deep convolutional neural networks for LVCSR,” in

[281] “Slides on deep learning,” http://www.cs.nyu.edu/yann/talks/lecun-ranzato-icml2013.pdf.

[282] Deep learning: Methods and applications,” Foundations and Trends in Signal Processing, vol. 7, no. 34, pp. 197-387, 2014. and , “

[283] Automatic Speech Recognition: A Deep Learning Approach, Springer, 2012. and ,

[284] “Deng receives prestigious IEEE technical achievement award,” http://blogs.technet.com/b /inside_microsoft_research/archive/2015/12/03/deng-receives-prestigious-ieee-technical -achievement-award.aspx.

[285] GPU implementation of neural networks,” Pattern Recognitionvol. 37, no. 6, pp. 1311-1314, 2004. and , “

[286] 2006. , , and , “High performance convolutional neural networks for document processing,” Suvisoft,

[287] 2010, http://arXiv:1003.0358.
, , , and , “Deep big simple neural nets excel on handwritten digit recognition,” preprint,

[288] Proceedings of the Annual International Conference on Machine Learning. New York, NY, USA: ACM, 2009, pp. 873-880. , , and , “Large-scale deep unsupervised learning using graphics processors,” in

[289] Deep learning,” Nature, vol. 521, no. 7553, pp. 436-444, 2015. , , and , “

[290] 2012, pp. 1097-1105. , , and , “Imagenet classification with deep convolutional neural networks,” in Advances in Neural information Processing Systems, ed. F. Pereira et al., Curran Associates, Inc.,

[291] Advances in Neural information Processing Systems, ed.
et al., North Miami Beach, FL, USA: Curran Associates, Inc., 2014, pp. 3104-3112. , , and , “Sequence to sequence learning with neural networks,” in

[292] 2014, http://arXiv:1406.1078.
, , Ç. Gülçehre, F. Bougares, H. Schwenk, and Y. Bengio, “Learning phrase representations using RNN encoder-decoder for statistical machine translation,” preprint,

[293] A fast learning algorithm for deep belief nets,” Neural computation, vol. 18, no. 7, pp. 1527-1554, 2006. , , and , “

[294] Greedy layer-wise training of deep networks,” in Advances in Neural information Processing Systems, vol. 19, 2007, p. 153. , , , and , “

[295] Advances in Neural information Processing Systems, ed. , Morgan-Kaufmann, 1990, pp. 396-404. , , , , , , and , “Handwritten digit recognition with a back-propagation network,” in

[296] Gradient-based learning applied to document recognition,” Proceedings of the IEEE vol. 86, no. 11, pp. 2278-2324, November 1998. , , , and , “

[297] A neural probabilistic language model,” Journal of Machine Learning Research vol. 3, no. February, pp. 1137-1155, 2003. , , , and , “

[298] Learning precise timing with LSTM recurrent networks,” Journal of Machine Learning Research vol. 3, pp. 115-143, August 2002. , , and , “

[299] International Workshop on Biologically Inspired Approaches to Advanced Information Technology, Berlin, Heidelberg: Springer, 2004, pp. 127-136. , , , and , “Biologically plausible speech recognition with LSTM neural nets,” in

[300] International Conference on Artificial Neural Networks, Berlin, Heidelberg: Springer, 2007, pp. 220-229. , , and , “An application of recurrent neural networks to discriminative keyword spotting,” in

[301] 2014. , “How Skype used AI to build its amazing new language translator,” Wire, December

[302] 2014, http://arXiv:1412.5567.
, , , , , , , , , , and , “Deep speech: Scaling up end-to-end speech recognition,” preprint,

[303] “Plenary speakers,” www.icassp2016.org/PlenarySpeakers.asp.

[304] 2015. , “Achievements and challenges of deep learning,” Microsoft,

[305] IEEE Conference on Computer Vision and Pattern Recognition, Rhode Island, RI, USA, June 2012, pp. 3642-3649. , , and , “Multi-column deep neural networks for image classification,” in

[306] IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA, June 2015, pp. 3156-3164. , , , and , “Show and tell: A neural image caption generator,” in

[307] IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA, June 2015, pp. 1473-1482. , , , , , , , , , , , and , “From captions to visual concepts and back,” in

[308] 2014, http://arXiv:1411.2539.
, , and , “Unifying visual-semantic embeddings with multimodal neural language models,” preprint,

[309] Proceedings of the 19th ACM International Conference on Multimedia, New York, NY, USA, 2011, pp. 343-352. , , and , “Bilinear deep learning for image classification,” in

[310] “Nvidia demos a car computer trained with ‘deep learning’,” www.technology review.com/s/533936/ces-2015-nvidia-demos-a-car-computer-trained-with-deep-learning/.

[311] “What is a driverless car?,” www.wisegeek.com/what-is-a-driverless-car.htm.

[312] “Self-driving cars now legal in California,” www.cnn.com/2012/09/25/tech/innovation /self-driving-car-california/.

[313] Toward robotic cars,” Communications of the ACM, vol. 53, no. 4, pp. 99-106, 2010. , “

[314] Proceedings of International Conference on Intelligent Robots and Systems, Kyongju, Korea, 1999, vol. 3, pp. 1507-1512. and , “Dead reckoning and cartography using stereo vision for an autonomous car,” in

[315] “The beginning of the end of driving,” www.motortrend.com/news/the-beginning-of -the-end-of-driving/.

[316] “European roadmap smart systems for automated driving,” www.smart-systems-integr ation.org/public/documents/publications/EPoSS%20Roadmap_Smart%20Systems%20for %20Automated%20Driving_2015_V1.pdf.

[317] Vehicle detection in driving simulation using extreme learning machine,” Neurocomputing, vol. 128, pp. 160-165, 2014. , , , and , “

[318] LSTM recurrent networks learn simple context-free and context-sensitive languages,” IEEE Transactions on Neural Networks vol. 12, no. 6, pp. 1333-1340, November 2001. and , “

[319] 2016, http://arXiv:1602.02410.
, , , , and , “Exploring the limits of language modeling,” preprint,

[320] 2015, http://arXiv:1512.00103.
, , , and , “Multilingual language processing from bytes,” preprint,

[321] 2013. , , , and , “Parsing with compositional vector grammars,” in ACL,

[322] Proceedings of the Conference on Empirical Methods in Natural Language Processing, Citeseer, 2013, vol. 1631, p. 1642. , , , , , , and , “Recursive deep models for semantic compositionality over a sentiment treebank,” in

[323] 2014, pp. 101-110. , , , , and , “A latent semantic model with convolutional-pooling structure for information retrieval,” in Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management,

[324] Proceedings of the 22nd ACM International Conference on Conference on Information and KnowledgeManagement, San Francisco, CA, USA, October 2013, pp. 2333-2338. , , , , , and , “Learning deep structured semantic models for web search using clickthrough data,” in

[325] Using recurrent neural networks for slot filling in spoken language understanding,” IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 23, no. 3, pp. 530-539, March 2015. , , , , , , , , , , and , “

[326] ACL. Citeseer, 2014. , , , and , “Learning continuous phrase representations for translation modeling,” in

[327] 2014, www.microsoft.com/ en-us /research/publication/modeling-interestingness-with-deep-neural-networks/. , , , , and , “Modeling interestingness with deep neural networks,” Tech. Rep., October

[328] Proceedings of the 23rd ACM International Conference on Information and Knowledge Management, Shanghai, China, November 2014. , , and , “Deep learning for natural language processing: Theory and practice (tutorial),” in

[329] “Merck molecular activity challenge,” www.kaggle.com/c/MerckActivity/details/winners.

[330] 2014, http://arXiv:1406.1231.
, , and , “Multi-task neural networks for QSAR predictions,” preprint,

[331] “Merck molecular activity challenge,” https://tripod.nih.gov/tox21/challenge/leader board.jsp.

[332] “NCATS announces Tox21 Data Challenge Winners,” https://tripod.nih.gov/tox21/chal lenge/leaderboard.jsp.

[333] 2015, http://arXiv:1510.02855.
, , and A. Heifets, “Atomnet: A deep convolutional neural network for bioactivity prediction in structure-based drug discovery,” preprint,

[334] 2015, http://arXiv:1504.01840.
, “Autonomous CRM control via CLV approximation with deep reinforcement learning in discrete and continuous action space,” preprint,

[335] Advances in Neural Information Processing Systems, Lake Tahoe, CA, USA, December 2013, pp. 2643-2651. , , and , “Deep content-based music recommendation,” in

[336] Proceedings of the 24th InternationalConference on World Wide Web, ser.WWW–15. New York, NY, USA: ACM, 2015, pp. 278-288, http://doi.acm.org/10.1145/2736277.2741667.
, , and , “A multi-view deep learning approach for cross domain user modeling in recommendation systems,” in

[337] Proceedings of the 5th ACM Conference on Bioinformatics, Computational Biology, and Health Informatics, ACM, Newport Beach, CA, USA, September 2014, pp. 533-540. , , and , “Deep autoencoder neural networks for gene ontology annotation predictions,” in

[338] Representation learning: A review and new perspectives,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 8, pp. 1798-1828, August 2013. , , and , “

[339] Deep belief networks,” Scholarpedia, vol. 4, no. 5, p. 5947, 2009. , “

[340] On contrastive divergence learning,” in Artificial Intelligence and Statistics Conference, vol. 10, pp. 33-40, 2005. and , “

[341] A Practical Guide to Training Restricted Boltzmann Machines, Springer, 2012, pp. 599-619. ,

[342] Ninth International Conference on Artificial NeuralNetworks, vol. 1. Edinburgh, UK: IET, September 1999, pp. 1-6. , “Products of experts,” in

[343] Training products of experts by minimizing contrastive divergence,” Neural Computation, vol. 14, no. 8, pp. 1771-1800, 2002. , “

[344] Learning deep architectures for AI,” Foundations and trends® in Machine Learning, vol. 2, no. 1, pp. 1-127, 2009. , “

[345] Advances in Neural Information Processing Systems, Lake Tahoe, CA, USA, December 2013, pp. 2553-2561. , , and , “Deep neural networks for object detection,” in

[346] Proceedings of the International Conference on Machine Learning, ACM, Corvallis, OR, USA, June 2007, pp. 473-480. , , , , and , “An empirical evaluation of deep architectures on problems with many factors of variation,” in

[347] Training restricted Boltzmann machines: An introduction,” Pattern Recognition, vol. 47, no. 1, pp. 25-39, 2014. and , “

[348] Backpropagation applied to handwritten zip code recognition,” Neural Computation, vol. 1, no. 4, pp. 541-551, December 1989. , , , , , , and , “

[349] Proceedings of Fourth International Conference on Computer Vision, 1993. Berlin, Germany, May 1993, pp. 121-128. , , and , “Learning recognition and segmentation of 3-D objects from 2-D images,” in

[350] “Convolutional neural network,” http://ufldl.stanford.edu/tutorial/supervised/Convolutiona lNeuralNetwork/.

[351] Going deeper with convolutions,” in IEEE Conference on Computer Vision and Pattern Recognition, June 2015, pp. 1-9. , , , , , , , , and , “

[352] 2010. , “Convolutional deep belief networks on cifar-10,” http://www.cs.toronto.edu/kriz/conv-cifar10-aug2010.pdf, not published,

[353] Proceedings of the Annual International Conference on Machine Learning, ser. ICML –09. New York, NY, USA: ACM, 2009, pp. 609-616. , , , and , “Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations,” in

[354] A novel connectionist system for unconstrained handwriting recognition,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, no. 5, pp. 855-868, May 2009. , , , , , and , “

[355] International Conference on Artificial Neural Networks, Springer, 2009, pp. 755-764. , , , and , “Evolving memory cell structures for sequence learning,” in

[356] Proceedings International Joint Conference on Artificial Intelligence, Hyderabad, India, January 2007, pp. 774-779. , , and , “Sequence labelling in structured domains with hierarchical recurrent neural networks,” in

[357] Advances in Neural Information Processing Systems 21, North Miami Beach, FL, USA: Curran Associates, Inc., 2009, pp. 545-552. and , “Offline handwriting recognition with multidimensional recurrent neural networks,” in

[358] Photo-real talking head with deep bidirectional LSTM,” in IEEE International Conference on Acoustics, Speech and Signal Processing, April 2015, pp. 4884-4888. , , , and , “

[359] “Google voice search: Faster and more accurate,” https://research.googleblog.com/2015 /09/google-voice-search-faster-and-more.html.

[360] Cisco, “Cisco visual networking index: Global mobile data traffic forecast update 2015- 2020,” White Paper, 2016.

[361] Apache Spark, “Apache Spark: Lightning-fast cluster computing,” 2016, http://spark.apache.org.

[362] A survey on human activity recognition using wearable sensors,” IEEE Communications Surveys & Tutorials, vol. 15, no. 3, pp. 1192-1209, 2013. and , “

[363] AAAI Workshop on Activity Context Representation: Techniques and Languages, Palo Alto, CA, USA, 2012. and , “The impact of personalization on smartphone-based activity recognition,” in

[364] Context aware computing for the Internet of things: A survey,” IEEE Communications Surveys & Tutorials, vol. 16, no. 1, pp. 414-454, 2014. , , , and , “

[365] Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion,” The Journal of Machine Learning Research, vol. 11, pp. 3371-3408, 2010. , , , , and , “

[366] DeepFi: Deep learning for indoor fingerprinting using channel state information,” in IEEE Wireless Communications and Networking Conference, March 2015, pp. 1666-1671. , , , and , “

[367] Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications, ACM, 2015, pp. 117-122. and , “Can deep learning revolutionize mobile sensing?” in

[368] Multimodal deep learning,” in Proceedings of the International Conference on Machine Learning, 2011, pp. 689-696. , , , , , and , “

[369] Advances in Neural Information Processing Systems, Lake Tahoe, NV, USA, December 2012, pp. 1223-1231.
et al., “Large scale distributed deep networks,” in

[370] Large-scale deep belief nets with MapReduce,” IEEE Access, vol. 2, pp. 395-403, 2014. and , “

[371] Proceedings of the 5th International Workshop on Knowledge Discovery from Sensor Data, ACM, 2011, pp. 25-33. , , , , , and , “Design considerations for the WISDM smart phone-based sensor mining architecture,” in

[372] reCAPTCHA: Humanbased character recognition via web security measures,” Science, vol. 321, no. 5895, pp. 1465-1468, 2008. , , , , and , “

[373] Auctions: Theory and Practice, ser. Princeton, NJ, USA: Princeton University Press, 2004. ,

[374] Application of mobility prediction in wireless networks using markov renewal theory,” IEEE Transactions on Vehicular Technology, vol. 59, no. 2, pp. 788-802, February 2010. and , “

[375] Prediction in wireless networks by markov chains,” IEEE Wireless Communications, vol. 16, no. 2, pp. 56-64, April 2009. and , “

[376] Proceedings of the 7th ACM International Symposium on Mobile Ad Hoc Networking and Computing, ser. MobiHoc 06. New York, NY, USA: ACM, 2006, pp. 85-96. and , “Modeling steady-state and transient behaviors of user mobility: Formulation, analysis, and application,” in

[377] 2002. , “Life patterns: Structure from wearable sensors,” https://dspace.mit.edu/handle/1721.1/8030,

[378] Eigenbehaviors: Identifying structure in routine,” Behavioral Ecology and Sociobiology, vol. 63, no. 7, pp. 1057-1066, 2009. and , “

[379] Mining user moving patterns for personal data allocation in a mobile computing system,” in Proceedings of the 2000 International Conference on Parallel Processing, August 2000, pp. 573-580. and , “

[380] Database and Expert Systems Applications, Springer, 2002, pp. 331-340. , , , and , “Temporal pattern mining of moving objects for location-based service,” in

[381] Eigenplaces: Analysing cities using the space- time structure of the mobile phone network,” Environment and Planning B: Planning and Design, vol. 36, no. 5, pp. 824-836, 2009. , , and , “

[382] Eigenplaces: Segmenting space through digital signatures,” IEEE Pervasive Computing, vol. 9, no. 1, pp. 78-84, January 2010. , , and , “

[383] Deep machine learning: A new frontier in artificial intelligence research [research frontier],” IEEE Computational Intelligence Magazine, vol. 5, no. 4, pp. 13-18, November 2010. , , and , “

[384] Reducing the dimensionality of data with neural networks,” Science, vol. 313, no. 5786, pp. 504-507, 2006. and , “

[385] Bayesian Nonparametrics: Principles and Practice, Cambridge, UK: Cambridge University Press, 2010. and , “Hierarchical Bayesian nonparametric models with applications,” in

[386] Hierarchical beta processes and the Indian buffet process,” in Artificial Intelligence and Statistics Conference, vol. 2, pp. 564-571, 2007. and , “

[387] Advances in Neural Information Processing Systems, Cambridge, MA, USA: MIT Press, vol. 12., 2000, pp. 554-560. , “The infinite Gaussian mixture model,” in

[388] Proceedings of the International Conference on Machine Learning, New York, NY, USA: ACM, 2011, pp. 361-368. , , , , and , “The hierarchical beta process for convolutional factor analysis and deep learning,” in

[389] Proceedings of the Twenty-Second Conference on Uncertainty in Artificial Intelligence, AUAI Press, 2006, pp. 536-543. , “A non-parametric Bayesian method for inferring hidden causes,” in

[390] International Conference on Independent Component Analysis and Signal Separation, Springer
Berlin Heidelberg, 2007, pp. 381-388. and , “Infinite sparse factor analysis and infinite independent components analysis,” in

[391] The Indian buffet process: An introduction and review,” Journal of Machine Learning Research, vol. 12, pp. 1185-1224, July 2011. and , “

[392] On contrastive divergence learning,” in Artificial Intelligence and Statistics Conference, vol. 10, pp. 33-40, 2005. and , “

[393] Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information,” IEEE Transactions on Information Theory, vol. 52, no. 2, pp. 489-509, February 2006. , , and , “

[394] Communications on Pure and Applied Mathematics, vol. 2005, no. 59, pp. 1207-1233, 2005. , , and , “Stable signal recovery from incomplete and inaccurate information,”

[395] Near optimal signal recovery from random projections: Universal encoding strategies?” IEEE Transactions on Information Theory, vol. 52, no. 12, pp. 5406- 5425, December 2006. and , “

[396] IEEE Transactions on Information Theory, vol. 52, no. 4, pp. 1289-1306, April 2006. , “Compressed sensing,”

[397] Certain topics in telegraph transmission theory,” Transactions of the American Institute of Electrical Engineers, vol. 47, no. 2, pp. 617-644, April 1928. , “

[398] Communication in the presence of noise,” Proc. Institute of Radio Engineers, vol. 37, no. 1, pp. 10-21, 1949. , “

[399] Sparse approximate solutions to linear systems,” SIAM Journal on Computing, vol. 24, no. 2, pp. 227-234, 1995. , “

[400] Sparse and Redundant Representations: From Theory to Applications in Signal and Image Processing, Springer Verlag, 2010. ,

[401] Sparse Image and Signal Processing: Wavelets, Curvelets, Morphological Diversity, Cambridge, UK: Cambridge University Press, 2010. , , and ,

[402] The curvelet transform for image denoising,” IEEE Transactions on Image Processing, vol. 11, no. 6, pp. 670-684, June 2002. , , and , “

[403] Emergence of simple-cell receptive field properties by learning a sparse code for natural images,” Nature, vol. 381, no. 6583, pp. 607-609, 1996. and , “

[404] Multi-frame compression: Theory and design,” Signal Processing, vol. 80, no. 10, pp. 2121-2140, 2000. , , and , “

[405] K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation,” IEEE Transactions on Signal Processing, vol. 54, no. 11, pp. 4311-4322, November 2006. , , and , “

[406] Model selection and estimation in regression with grouped variables,” Journal of the Royal Statistical Society: Series B, vol. 68, no. 1, pp. 49-67, April 2006. and , “

[407] Theoretical results on sparse representations of multiplemeasurement vectors,” IEEE Transactions on Signal Processing, vol. 54, no. 12, pp. 4634-4643, December 2006. and , “

[408] Consistency of the group lasso and multiple kernel learning,” The Journal of Machine Learning Research, vol. 9, pp. 1179-1225, 2008. , “

[409] A sparse signal reconstruction perspective for source localization with sensor arrays,” IEEE Transactions on Signal Processing, vol. 53, no. 8, pp. 3010-3022, August 2005. , , and , “

[410] Sparse solutions to linear inverse problems with multiple measurement vectors,” IEEE Transactions on Signal Processing, vol. 53, no. 7, pp. 2477-2488, July 2005. , , , and , “

[411] Collaborative spectrum sensing from sparse observations in cognitive radio networks,” IEEE Journal on Selected Topicson Communications Special Issue on Advances in Cognitive Radio Networking andCommunications, vol. 29, no. 2, pp. 327-337, February 2011. , , , , and , “

[412] PhD dissertation, Stanford University, 2002. , “Matrix rank minimization with applications,”

[413] Exact matrix completion via convex optimization,” Foundationsof Computational Mathematics, vol. 9, no. 6, pp. 717-772, 2009. and , “

[414] Interior-point method for nuclear norm approximation with application to system identification,” SIAM Journal on Matrix Analysis and Applications, vol. 31, no. 3, pp. 1235-1256, 2009. and , “

[415] Theory of semidefinite programming for sensor network localization,” Mathematical Programming, vol. 109, no. 2, pp. 367-384, 2007. and , “

[416] Shape and motion from image streams under orthography: A factorization method,” International Journal of Computer Vision, vol. 9, no. 2, pp. 137- 154, 1992. and , “

[417] A sequential factorization method for recovering shape and motion from image streams,” IEEE Transactions on Pattern Analysis and MachineIntelligence, vol. 19, no. 8, 858-867, August 1997. and , “

[418] Using collaborative filtering to weave an information tapestry,” Communications of the ACM, vol. 35, no. 12, 61-70, 1992. , , , and , “

[419] Robust recovery of signals from a structured union of subspaces,” IEEE Transactions on Information Theory, vol. 55, no. 11, 5302-5316, November 2009. and , “

[420] Sampling signals from a union of subspaces,” IEEE Signal ProcessingMagazine, vol. 25, no. 2, 41-47, March 2008. and , “

[421] Sparsity and incoherence in compressive sampling,” InverseProblems, vol. 23, no. 3, 969-985, 2007. and , “

[422] Spectrum-blind minimum-rate sampling and reconstruction of multiband signals,” in Proceedings of IEEE International Conference on Acoustics,Speech, and Signal Processing, vol. 3, May 1996, 1688-1691. and , “

[423] Sampling signals with finite rate of innovation,” IEEE Transactions on Signal Processing, vol. 50, no. 6, 1417-1428, June 2002. , , and , “

[424] Decoding by linear programming,” IEEE Transactions onInformation Theory, vol. 51, no. 12, 4203-4215, December 2005. and , “

[425] Theory of compressive sensing via 1-minimization: A non-rip analysis and extensions,” Journal of the Operations Research Society of China, vol. 1, no. 1, 79-105, 2013. , “

[426] A probabilistic and RIPless theory of compressed sensing,” IEEETransactions on Information Theory, vol. 57, no. 11, 7235-7254, November 2010. and , “

[427] Uncertainty principles and ideal atomic decompositions,” IEEETransactions on Information Theory, vol. 47, no. 7, 2845-2862, November 2001. and , “

[428] Sparse representations in unions of bases,” IEEE Transactionson Information Theory, vol. 49, no. 12, 3320-3325, December 2003. and , “

[429] 2005. , “A simple proof for recoverability of _1-minimization: Go over or under?” RiceUniversity CAAM Technical Report TR05-09,

[430] Compressed sensing and best k-term approximation,” Journal of the American Mathematical Society, vol. 22, no. 1, 211-231, 2009. , , and , “

[431] The restricted isometry property and its implications for compressed sensing,” Comptes Rendus Mathematique, vol. 346, no. 9-10, 589-592, 2008. , “

[432] Sparsest solutions of underdetermined linear systems via _qminimization for 0 q ≤ 1,” Applied and Computational Harmonic Analysis, vol. 26, no. 3, 395-407, 2009. and , “

[433] A note on guaranteed sparse recovery via _1-minimization,” Applied andComputational Harmonic Analysis, vol. 29, no. 1, 97-103, July 2010. , “

[434] Shifting inequality and recovery of sparse signals,” IEEE Transactions on Signal Processing, vol. 58, no. 3, 1300-1308, March 2010. , , and , “

[435] New bounds on the restricted isometry constant δ2k
,” Applied andComputational Harmonic Analysis, vol. 31, no. 3, 460-468, 2011. and , “

[436] 2010. , “PhD thesis: Random observations on random observations: Sparse signal acquisition and processing,” PhD dissertation,

[437] A simple proof of the restricted isometry property for random matrices,” Constructive Approximation, vol. 28, no. 3, 253-263, 2007. , , , and , “

[438] Uniform uncertainty principle for Bernoulli and subgaussian ensembles,” Constructive Approximation, vol. 28, no. 3, 277-289, 2008. , , and , “

[439] Compressive sensing and structured random matrices,” Theoretical Foundationsand Numerical Methods for Sparse Recovery, vol. 9, 1-92, 2010. , “

[440] Explicit constructions of RIP matrices and related problems,” Duke Mathematical Journal, vol. 159, no. 1, 145-185, 2011. , , , , and , “

[441] Proceedings of the 44th Annual Conference on InformationSciences and Systems, 1-6, Princeton, NJ, USA, March 2010. , , and , “On the restricted isometry of deterministically subsampled Fourier matrices,”

[442] Proceedings of the Nineteenth Annual ACM-SIAM Symposium on Discrete Algorithms, 30-33, San Francisco, CA, USA, January 20-22, 2008. , “Explicit constructions for compressed sensing of sparse signals,” SODA –08

[443] Derivation of compressive sensing theorems from the spherical section property,” University of Waterloo, CO, vol. 769, 2009. , “

[444] Diameters of some finite-dimensional sets and classes of smooth functions,” Mathematics of the USSR-Izvestiya, vol. 11, p. 317, 1977. , “

[445] The widths of a Euclidean ball,” Dokl. Akad. Nauk SSSR, vol. 277, no. 5, 1048-1052, 1984. and , “

[446] and , Combinatorial Group Testing and Its Applications. World Scientific Pub. Co. Inc., 2000.

[447] Combining geometry and combinatorics: A unified approach to sparse signal recovery,” in 2008 46th Annual AllertonConference on Communication, Control, and Computing, September 2008, pp. 798- 805. , , , , and , “

[448] Sparse recovery using sparse matrices,” Proceedings of the IEEE, vol. 98, no. 6, 937-947, June 2010. and , “

[449] 2007, 237-246. , , , and , “One sketch for all: Fast algorithms for compressed sensing,”

[450] Approximate sparse recovery: Optimizing time and measurements,” SIAM Journal on Computing, vol. 41, no. 2, 436-453, 2012. , , , and , “

[451] 2006. , “When is missing data recoverable?” Rice University CAAM Technical ReportTR06-15,

[452] http://dsp.rice.edu/cs.

[453] Beyond Nyquist: Efficient sampling of sparse bandlimited signals,” IEEE Transactions on InformationTheory, vol. 56, no. 1, 520-544, January 2010. , , , , and , “

[454] IEEE DallasCircuits and Systems Workshop, Dallas, October 2006. , , , , , , , and , “Analog-to-information conversion via random demodulation,” in

[455] IEEE InternationalSymposium on Circuits and Systems, ISCAS, New Orleans, LA, USA, May 2007. , , , , , and , “Analog-to-information conversion via random demodulation,” in

[456] From theory to practice: Sub-Nyquist sampling of sparse wideband analog signals,” IEEE Journal of Selected Topics in Signal Processing, vol. 4, no. 2, 375-391, April 2010. and , “

[457] 2009 IEEEInformation Theory Workshop, Sicily, Italy, October 2009. and , “Expected rip: Conditioning of the modulated wideband converter,” in

[458] IEEE Convention of Electrical and Electronics Engineers, Israel, December 2008, 290-294. , Y. C.|Eldar, and , “Efficient sampling of sparse wideband analog signals,” in

[459] Xampling: Signal acquisition and processing in union of subspaces,” IEEE Transactions on Signal Processing, vol. 59, no. 10, pp. 4719- 4734, October 2011. , , and , “

[460] Xampling at the rate of innovation,” IEEE Transactions onSignal Processing, vol. 60, no. 3, 1121-1133, March 2012. and , “

[461] Time-delay estimation from low-rate samples: A union of subspaces approach,” IEEE Transactions on Signal Processing, vol. 58, no. 6, pp. 3017- 3031, June 2011. and , “

[462] Sub-nyquist sampling of short pulses,” IEEE Transactions onSignal Processing, vol. 60, no. 3, 1134-1148, March 2012. and , “

[463] CompressedSensing Theory and Applications, Cambridge, UK: Cambridge University Press, 2012. and , “Xampling: Compressed sensing of analog signals,”

[464] Pervasive computing: Vision and challenges,” IEEE Personal Communications, vol. 8, no. 4, pp. 10 -17, August 2001. , “

[465] Design of ultra-low-cost uhf rfid tags for supply chain applications,” IEEECommunications Magazine, vol. 42, no. 8, 140-151, August 2004. , , , , , , , , , , , , , , , and , “

[466] Proceedings of the 7th ACM Conferenceon Embedded Networked Sensor Systems, ser. SenSys –09. New York, NY, USA: ACM, 2009, 99-112. , , , , , , and , “Canopy closure estimates with greenorbs: Sustainable sensing in the forest,” in

[467] Wireless Communications, Cambridge, UK: Cambridge University Press, 2005. ,

[468] Wireless Communications: Principles and Practice (2nd ed.) USA: Prentice Hall, 2001. ,

[469] Atomic decomposition by basis pursuit,” SIAM Journal on Scientific Computing (SISC), vol. 20, no. 1, 33-61, 1998. , , and , “

[470] Compressed channel sensing: A new approach to estimating sparse multipath channels,” Proceedings of the IEEE, vol. 98, no. 6, 1058-1076, June 2010. , , , and , “

[471] Ultra-wideband compressed sensing channel estimation,” IEEE Journal of Selected Topics in Signal Processing, vol. 1, no. 3, pp. 383- 395, October 2007. , , and , “

[472] Application of compressive sensing to sparse channel estimation,” IEEE Communications Magazine, vol. 48, 164-174, November 2010. , , , and , “

[473] 2009, 1-5. , , , and , “A compressive sensing based ultrawideband communication system,” in Proceedings of IEEE International Conference onCommunications,

[474] , “Multiple channel estimation using spectrally random probes,” in Proc. SPIEWavelets XIII, 2009.

[475] 2008, 2048-2052. , , and , “Compressed sensing of wireless channels in time, frequency, and space,” in 2008 42nd Asilomar Conference on Signals, Systems andComputers, October

[476] Ultra-wideband Positioning Systems: TheoreticalLImits, Ranging Algorithms and Protocols, Cambridge, UK: Cambridge University Press, 2011. , , and ,

[477] The end of spectrum scarcity,” IEEE Spectrum Archive, vol. 41, no. 3, 48-52, March 2004. and , “

[478] Cognitive radio: Brain-empowered wireless communications,” IEEE Journalon Selected areas in Communications, vol. 23, no. 2, 201-220, February 2005. , “

[479] Efficient discovery of spectrum opportunities with MAC-layer sensing in cognitive radio networks,” IEEE Transactions on Mobile Computing, vol. 7, no. 5, 533-545, May 2008. and , “

[480] Longley-Rice methodology for evaluating TV coverage and interference,” Office of Engineering and Technology Bulletin, no. 69, 2004. , “

[481] Proceedings of IEEE International Conference on Communications, Istanbul, Turkey, June 2006, 1658-1663. , , and , “Cooperative sensing among cognitive radios,” in

[482] Proceedings of IEEE International Symposium on New Frontiersin Dynamic Spectrum Access Networks, Baltimore, MD, USA, November 2005, pp. 131- 136. and , “Collaborative spectrum sensing for opportunistic access in fading environments,” in

[483] Opportunistic spectrum access in fading channels through collaborative sensing,” Journal of Communications, vol. 2, no. 2, 71-82, March 2007. and , “

[484] Proceedings ofIEEE Conference on Computer Communications, Rio de Janeiro, Brazil, April 2009, 2114-2122. , , , , and , “Coalitional games for distributed collaborative spectrum sensing in cognitive radio networks,” in

[485] Cooperative spectrum sensing in cognitive radio: Part I: Two user networks,” IEEE Transactions on Wireless Communications, vol. 6, no. 6, 2204-2213, June 2007. and , “

[486] Cooperative spectrum sensing in cognitive radio: Part II: Multiuser networks,” IEEE Transactions on Wireless Communications, vol. 6, no. 6, 2214-2222, June 2007. and , “

[487] Cooperative sensing for primary detection in cognitive radio,” IEEE Journal of Selected Topics in Signal Processing, vol. 2, no. 1, 18-27, February 2008. and , “

[488] Optimal linear cooperation for spectrum sensing in cognitive radio networks,” IEEE Journal of Selected Topics in Signal Processing, vol. 2, no. 1, 28-40, February 2008. , , and , “

[489] Proceedings of International Conference on Communications, Glasgow, Scotland, June 2007, 2511-2515. , , and , “Cluster-based cooperative spectrum sensing in cognitive radio systems,” in

[490] Proceedings of IEEE Wireless Communications and Networking Conference, Hong Kong, China, February 2007, 25-30. , , and , “Cooperative spectrum sensing for cognitive radios under bandwidth constraints,” in

[491] Proceedings of IEEE Consumer Communications and NetworkingConference, Las Vegas, NV, USA, January 2008, 968-972. and , “Energy efficient techniques for cooperative spectrum sensing in cognitive radios,” in

[492] Recent advances in techniques for hyperspectral image processing,” Remote Sens.Environment, vol. 113, no. 1, 110-122, 2009. , , , , , , , , , , , , and , “

[493] Hyperspectral remote sensing data analysis and future challenges,” IEEEGeoscience and Remote Sensing Magazine, vol. 1, no. 2, 6-36, June 2013. , , , , , and , “

[494] An introduction to compressive sampling,” IEEE SignalProcessing Magazine, vol. 25, no. 2, 21-30, March 2008. and , “

[495] Sparsity and structure in hyperspectral imaging: Sensing, reconstruction, and target detection,” IEEE SignalProcessing Magazine, vol. 31, no. 1, 116-126, January 2014. , , , and , “

[496] Proceedings of IEEE International Conference on Image Processing, Paris, France, October 2014, 684-688. , “Compressive pushbroom and whiskbroom sensing for hyperspectral remotesensing imaging,” in

[497] Single-pixel imaging via compressive sampling,” IEEE Signal ProcessingMagazine, vol. 25, no. 2, 83-91, March 2008. , , , , , , and , “

[498] A compressive sensing and unmixing scheme for hyperspectral data processing,” IEEE Transactions on Image Processing, vol. 21, no. 3, 1200-1210, March 2012. , , and , “

[499] Proceedings of IEEE International Conferenceon Acoustic, Speech and Signal Processing, Kyoto, Japan, March 2012, pp. 2741- 2744. and , “Hyperspectral image compressed sensing via low-rank and joint-sparse matrix recovery,” in

[500] HYCA: A new technique for hyperspectral compressive sensing,” IEEE Transactions on Geoscience and Remote Sensing, vol. 53, no. 5, 2819-2831, May 2015. , , and , “

[501] Automatic spectral target recognition in hyperspectral imagery,” IEEE Transactions on Aerospace and Electronic Systems, vol. 39, no. 4, 1232-1249, October 2003. and , “

[502] Sparse representation for target detection in hyperspectral imagery,” IEEE Journal of Selected Topics in Signal Processing, vol. 5, no. 3, pp. 629-640, June 2011. , , and , “

[503] Simultaneous joint sparsity model for target detection in hyperspectral imagery,” IEEE Geoscience and Remote Sensing Letters, vol. 8, no. 4, pp. 676-680, July 2011. , , and , “

[504] Distributed sparse linear regression,” IEEE Transactions on Signal Processing, vol. 58, no. 10, pp. 5262-5276, 2010. , , and , “

[505] Distributed basis pursuit,” IEEE Transactions on Signal Processing, vol. 60, no. 4, pp. 1942-1956, April 2012. , , , and , “

[506] Proceedings of ACM International Conference on Knowledge Discovery and Data Mining, New York, NY, USA, June 2009, pp. 547-556. , , , and , “Large-scale sparse logistic regression,” in

[507] A new class of distributed optimization algorithm: Application of regression of distributed data,” Optimization Methods and Software, vol. 27, no. 1, pp. 71-88, 2012. , , and , “

[508] Proceedings of Annual IEEE Symposium on Foundations of Computer Sciences, Cambridge, MA, USA, October 2003, pp. 482-491. , , and , “Gossip-based computation of aggregate information,” in

[509] Proceedings of IEEE International Conference on Acoustic, Speech and Signal Processing, Kyoto, Japan, March 2012, pp. 2925-2928. , , , and , “Decentralized low-rank matrix completion,” in

[510] Distributed subgradient methods for multi-agent optimization,” IEEE Transaction on Automatic Control, vol. 54, no. 1, pp. 48-61, Jan. 2009. and , “

[511] Convex Optimization in Signal Processing and Communications, Cambridge, UK: Cambridge University Press, 2009. and , “Cooperative distributed multi-agent optimization,” in

[512] Constrained consensus and optimization in multiagent networks,” IEEE Transactions on Automatic Control, vol. 55, no. 4, pp. 922-938, April 2010. , , and , “

[513] Distributed asynchronous constrained stochastic optimization,” IEEE Journal of Selected Topics in Signal Processing, vol. 5, no. 4, pp. 772-790, August 2011. and , “

[514] Problems in decentralized decision making and computation,” PhD thesis, MIT, 1984. , “

[515] 2015. , , and , “On the convergence of decentralized gradient descent,” SIAM Journal on Optimization,

[516] Master's thesis, MIT, 2012. , “Fast distributed first-order methods,”

[517] Distributed strongly convex optimization,” in 50th Annual Allerton Conference on Communication, Control, and Computing, Monticello, IL, USA, Oct 2012, pp. 593-600. and , “

[518] Parallel and Distributed Computation: Numerical Methods (2nd ed.) Belmont, MA, USA: Athena Scientific, 1997. and ,

[519] Splitting Methods in Communication and Imaging, NewYork, USA: Springer, 2015. , , , , and , “Proximal splitting methods in signal processing,” in

[520] Consensus in ad hoc WSNs with noisy links - Part I: Distributed estimation of deterministic signals,” IEEE Transactions on Signal Processing, vol. 56, no. 1, pp. 350-364, 2008. , , and , “

[521] On the linear convergence of the ADMM in decentralized consensus optimization,” IEEE Transactions on Signal Processing, vol. 62, no. 7, pp. 1750-1761, April 2014. , , , , and , “

[522] DLM: Decentralized linearized alternating direction method of multipliers,” IEEE Transactions on Signal Processing, vol. 63, no. 15, pp. 4051-4064, August 2015. , , , and , “

[523] Proximal algorithms,” Foundations and Trends in Optimization, vol. 1, no. 3, pp. 1-112, 2013. and , “

[524] EXTRA: An exact first-order algorithm for decentralized consensus optimization,” SIAM Journal on Optimization, vol. 25, no. 2, pp. 944-966, 2014. , , , and , “

[525] Dual averaging for distributed optimization: Convergence analysis and network scaling,” IEEE Transactions on Automatic Control, vol. 57, no. 3, pp. 592-606, March 2012. , , and , “

[526] Primal-dual subgradient methods for convex problems,” Mathematical Programming, vol. 120, no. 1, pp. 261-283, 2009. , “

[527] 40th International Conference on Acoustic, Speech and Signal Processing, Brisbane, Australia, April 2015. , , and , “On the convergence of alternating direction method of mulitpliers for a family of nonconvex problems,” in

[528] Distributed optimization over time-varying directed graphs,” IEEE Transactions on Automatic Control, vol. 60, no. 3, pp. 601-615, March 2015. and , “

[529] Global Conference on Signal and Information Processing, Austin, TX, USA, December 2013. and , “On the O(1/k) convergence of asynchronous distributed alternating direction method of multipliers,” in

[530] Incremental gradient, subgradient, and proximal methods for convex optimization: A survey,” Optimization for Machine Learning, vol. 4, pp. 85-119, 2012. , “

[531] On the convergence of the LMS algorithm with adaptive learning rate for linear feedforward networks,” Neural Computation, vol. 3, no. 2, pp. 226-245, 1991. , “

[532] A convergent incremental gradient method with a constant step size,” SIAM Journal on Optimization, vol. 18, no. 1, pp. 29-51, 2007. , , and , “

[533] 2015. , , and , “Convergence rate of incremental aggregated gradient algorithms,” IEEE Transactions on Signal Processing, preprint,

[534] Proceedings of the Annual Conference on Neural Information Processing Systems, Lake Tahoe, NV, USA, December 2012. , , and , “A stochastic gradient method with an exponential convergence rate for strongly-convex optimization with finite training sets,” in

[535] Proceeding of Annual Conference on Neural Information Processing Systems, Montreal, Canada, December 2014. , , and , “Saga: A fast incremental gradient method with support for non-strongly convex composite objectives,” in

[536] Proceedings of the Annual Conference on Neural Information Processing Systems, Lake Tahoe, NV, USA, December 2013. and , “Accelerating stochastic gradient descent using predictive variance reduction,” in

[537] A proximal stochastic gradient method with progressive variance reduction,” Siam Journal on Optimization, vol. 24, pp. 2057-2075, 2014. and , “

[538] , , and , “Semi-stochastic coordinate descent,” preprint, 2014, http://arXiv:1412.6293.

[539] Stochastic dual coordinate ascent methods for regularized loss minimization,” Journal of Machine Learning Research, vol. 14, pp. 567-599, 2013. and , “

[540] Proceedings of the International Conference on Machine Learning, Lille, France, June 2015. and , “A lower bound for the optimization of finite sums,” in

[541] Interscience Series in Discrete Mathematics, Wiley, 1983. and , “Problem complexity and method efficiency in optimization,” in

[542] , “An optimal randomized incremental gradient method,” preprint, 2015, https:// arxiv.org/abs/1507.02000.

[543] Coordinate descent optimization for L1 minimization with applications to compressed sensing: A greedy algorithm,” Inverse Problems and Imaging, vol. 3, no. 3, pp. 487-503, 2009. and , “

[544] Advances in Neural Information Processing Systems, Vancouver, Canada, December 2008. and , “The tradeoffs of large scale learning,” in

[545] Advances in Neural Information Processing Systems, Vancouver, Canada, December 2010. , , , and , “Parallelized stochastic gradient descent,” in

[546] Advances in Neural Information Processing Systems, Granada, Spain, December 2011. , , , and , “Hogwild: A lock-free approach to parallelizing stochastic gradient descent,” in

[547] International Conference on Machine Learning, Helsinki, Finland, July 2008. , , , , and , “A dual coordinate descent method for large-scale linear SVM,” in

[548] Distributed optimization and statistical learning via the alternating direction method of multipliers,” Foundation and Trends in Machine Learning, vol. 3, no. 1, pp. 1-122, November 2010. , , , , and , “

[549] and , “New analysis and results for the Frankwolfe method,” http://arXiv.org/abs/1307.0873 2014.

[550] International Conference on Machine Learning, Atlanta, GA, USA, June 2013. , , , and , “Block-coordinate Frank-Wolfe optimization for structural SVMs,” in

[551] and , “CVX: Matlab software for disciplined convex programming, Version 2.1,” http://cvxr.com/cvx, March 2014.

[552] Conference on Computer Systems, Salzburg, Austria, April 2011. , , , , and , “CloneCloud: Elastic execution between mobile device and cloud,” in

[553] Layering as optimization decomposition: A mathematical theory of network architectures,” Proceedings of the IEEE, vol. 95, no. 1, pp. 255-312, January 2007. , , , and , “

[554] Proceedings of IEEE International Conference on Computer Communications, Orlando, FL, USA, March 2012. , , , , and , “ThinkAir: Dynamic resource allocation and parallel execution in the cloud for mobile code offloading,” in

[555] ACM Special Interest Group on Data Communications Workshop on Mobile Cloud Computing, Helsinki, Finland, August 2012. , , , , and , “Scalability of a mobile cloud management system,” in

[556] Proceedings of the ACM Special Interest Group on Data Communications, New Delhi, India, August 2010. , , , and , “Donar: Decentralized sever selection for cloud services,” in

[557] Proceedings of USENIX Symposium on Networked Sytems Design and Implementation, San Jose, CA, USA, April 2010. , , , , , and , “Optimizing cost and performance in online service provider networks,” in

[558] Proceedings of ACM Special Interest Group on Data Communications Workshop on Mobile Cloud Computing, Portland, OR, USA, August 2002. , , , , and , “Optimizing cost and performance for multihoming,” in

[559] Proceedings of USENIX International Conference on Autonomic Computing, San Jose, CA, USA, June 2013. , , and , “Temperature aware workload management in geo-distributed datacenters,” in

[560] Proceedings of ACM Special Interest Group on Measurement and Evaluation, Seattle, WA, USA, June 2009. , , , and , “Cooperative content distribution and traffic engineering in an ISP network,” in

[561] Proceedings of ACMInternational Conference on emerging Networking Experiments and Technologies, Nice, France, December 2012. , , , and , “To coordinate or not to coordinate? Wide-area traffic management for data centers,” in

[562] Proceedings of IEEE International Conference on Computer Communications, Turin, Italy, April 2013. and , “Joint request mapping and response routing for geo-distributed cloud services,” in

[563] The case for VM-based cloudlets in mobile computing,” IEEE Pervasive Computing, vol. 8, no. 4, pp. 14-23, October 2009. , , , and , “

[564] Proceedings of the ACM Special Interest Group on Data Communications, Seattle,WA, USA, August 2008. , , , , , , , and , “Openflow: Enabling innovation in campus networks,” in

[565] Fair end-to-end window-based congestion control,” IEEE/ACM Transactions on Networking, vol. 8, no. 6, pp. 556-567, 2000. and , “

[566] Rate control for communication networks: Shadow price, proportional fairness and stability,” Journal of Operational Research Society, vol. 49, pp. 237-252, March 1998. , , and , “

[567] Proceedings of the IEEE International Conference on Computer Communications, San Diego, CA, USA, March 2010. , , , and , “Minimizing electricity cost: Optimization of distributed internet data centers in a multi-electricity-market environment,” in

[568] The cost of a cloud: Research problems in data center networks,” ACM Special Interest Group on Data Communications Computer Communication Review, vol. 39, no. 1, pp. 68-73, January 2009. , , , and , “

[569] Proceedings of the ACM International Symposium on Computer Architecture, San Diego, CA, USA, June 2007. , , and , “Power provisioning for a warehouse-size computer,” in

[570] Proceedings of USENIX Symposium on Networked Systems Design and Implementation, Seattle, WA, USA, November 2006. , , , , , , and , “iPlane: An information plane for distributed services,” in

[571] “AT&T 2012 Sustainability Report: Water,” www.att.com/gen/landing-pages?pid=24188.

[572] “Water use hints at problems at Utah Data Center,” www.sltrib.com/.

[573] Office of governor in California, “Governor brown declares drought state of emergency,” 2014, http://gov.ca.gov/news.php?id=18368.

[574] Proceedings of Special Interest Group on Performance Evaluation, London, UK, June 2012. , , , , , , , and , “Renewable and cooling aware workload management for sustainable data centers,” in

[575] Holistic datacenter design in the open compute project,” Computer, vol. 45, no. 7, pp. 83-85, 2012. , “

[576] Grow a Greener Data Center, New Jersey: Cisco Press, 2009. ,

[577] Proceedings of International Conference on Cloud and Green Computing, Karlsruhe, Germany, September 2013. , “Optimizing water efficiency in distributed data centers,” in

[578] “Google data centers,” www.google.com/about/datacenters/.

[579] U. Institute, “Data center industry survey,” 2013, http://uptimeinstitute.com/2013 -survey-results.

[580] eBay. [Online]. Available: http://tech.ebay.com/dashboard.

[581] “Prineville data center,” [Online]. Available: www.facebook.com/PrinevilleDataCenter/.

[582] Proceedings of the IEEE International Conference on Computer Communications, San Francisco, CA, USA, March 2003. , , , and , “Long-term forecasting of internet backbone traffic: Observations and initial methods,” in

[583] Collision-tolerant media access control for asynchronous users over frequency-selective channels,” IEEE Transactions on Wireless Communications, vol. 12, no. 10, pp. 5162-5171, 2013. , , , and , “

[584] IEEE Global Communications Conference, Austin, TX, USA, December 2014. , , and , “Scalable workload management for water efficiency in data centers,” in

[585] Wireless network virtualization: A survey, some research issues and challenges,” IEEE Communications Surveys Tutorials, vol. 17, no. 1, pp. 358-380, 2015. and , “

[586] Virtual network embedding: A survey,” IEEE Communications Surveys Tutorials, vol. 15, no. 4, pp. 1888-1906, 2013. , , , , and , “

[587] Resource discovery and allocation in network virtualization,” IEEE Communications Surveys Tutorials, vol. 14, no. 4, pp. 1114-1128, 2012. , , and , “

[588] How to lease the internet in your spare time,” Special Interest Group on Data Communications Computer Communication Review, vol. 37, no. 1, pp. 61-64, January 2007. , , and , “

[589] Network virtualization: State of the art and research challenges,” IEEE Communications Magazine, vol. 47, no. 7, pp. 20-26, July 2009. and , “

[590] Wireless Virtualization, ser. Springer Briefs in Computer Science.
Springer, 2013. , , and ,

[591] International Conference on Selected Topics: Stochastic Game for Wireless Network Virtualization, Montreal, Canada, August 2013, pp. 62-67. , , and , “Current trends and perspectives in wireless virtualization,” in

[592] Stochastic game for wireless network virtualization,” Networking, IEEE/ACM Transactions on Networking, vol. 21, no. 1, pp. 84-97, February 2013. and , “

[593] Annual Conference on Information Sciences and Systems, Baltimore, MD, USA, March 2015. and , “Game-theory based power and spectrum virtualization for maximizing spectrum efficiency over mobile cloud-computing wireless networks,” in

[594] IEEE Wireless Communications and Networking Conference, Istanbul, Turkey, April 2014, pp. 1803-1808. , , , , , and , “Opportunistic spectrum sharing for wireless virtualization,” in

[595] IEEE Global Communications Conference, Austin, TX, USA, December 2014, pp. 4959-4964. , , , and , “Distributed resource allocation in full-duplex relaying networks with wireless virtualization,” in

[596] NVS: A substrate for virtualizing wireless resources in cellular networks,” IEEE/ACM Transactions on Networking, vol. 20, no. 5, pp. 1333-1346, October 2012. , , , and , “

[597] Simultaneous routing and resource allocation via dual decomposition,” IEEE Transactions on Communications, vol. 52, no. 7, pp. 1136-1144, July 2004. , , and , “

[598] Fundamental trade-offs on green wireless networks,” IEEE Communications Magazine, vol. 49, no. 6, pp. 30-37, June 2011. , , , and , “

[599] Smart Grid Communications and Networking, Cambridge, UK: Cambridge University Press, 2012. , , and ,

[600] U.-C. P. S. O. T. Force, “Final report on the August 14, 2003 blackout in the United States and Canada: Causes and recommendations,” Tech. Rep., April 2004.

[601] 2009. , “Effect of stealthy bad data injection on network congestion in market based power system,” The Wall Street Journal, April

[602] Power System State Estimation: Theory and Implementation, New York, USA: Marcel Dekker, Inc., 2004. and ,

[603] Proceedings of 16th ACM Conference on Computer and Communications Security, Chicago, IL, USA, November 2009. , , and , “False data injection attacks against state estimation in electric power grids,” in

[604] Power System Analysis, New York, USA: McGraw-Hill, 1994. and ,

[605] Proceedings of IEEE International Conference on Smart Grid Communications, Gaithersburg, MD, USA, October 2010. , , and , “False data injection attacks in electricity markets,” in

[606] Proceedings of IEEE Wireless Communications and Networking Conference, Paris, France, April 2012. , , and , “Effect of stealthy bad data injection on network congestion in market based power system,” in

[607] Proceedings of IEEE International Conference on Smart Grid Communications, Gaithersburg, MD, USA, October 2010. and , “Stealth attacks and protection schemes for state estimators in power systems,” in

[608] Bad data injection attack and defense in electricity market using game theory study,” IEEE Transactions on Smart Grid, vol. 4, no. 1, pp. 160-169, March 2013. , , , and , “

[609] Malicious data attacks on the smart grid,” IEEE Transactions on Smart Grid, vol. 2, no. 4, pp. 645-658, December 2011. , , , and , “

[610] IEEE International Conference on Smart Grid Communications, Budapest, Hungary, June 2013. , , and , “Detection of false data injection in power grid exploiting low rank and sparsity,” in

[611] Strategic protection against data injection attacks on power grids,” IEEE Transactions on Smart Grid, vol. 2, no. 2, pp. 326-333, June 2011. and , “

[612] Coordinated datainjection attack and detection in the smart grid: A detailed look at enriching detection solutions,” IEEE Signal Processing Magazine, vol. 29, no. 5, pp. 106-115, September 2012. , , , , , and , “

[613] Proceedings of IEEE 52nd Annual Conference on Decision and Control, Florence, Italy, December 2013. , , and , “Fundamental limits of cyber-physical security in smart power grids,” in

[614] Impact of security on power system operation,” Proceedings of the IEEE, vol. 93, no. 11, pp. 2013-2025, November 2001. , , and , “

[615] Optimal load flow with steady-state security,” IEEE Transactions on Power Apparatus and System, vol. 93, no. 3, pp. 745-751, May 1974. and , “

[616] Proceedings of IFAC Symposium on Planning and Operation of Electric Energy System, Rio de Janeiro, Brazil, July 1985. , , and , “Security-constrained dispatch with corrective rescheduling,” in

[617] Power Generation Operation and Control, New York, USA: Wiley, 1996. and ,

[618] Security-constrained optimal power flow with post-contingency corrective rescheduling,” IEEE Transactions on Power Systems, vol. 2, no. 1, pp. 175-180, February 1987. , , and , “

[619] State-of-the-art, challenges, and future trends in security constrained optimal power flow,” Electric Power System Research, vol. 81, no. 8, pp. 1731-1741, August 2011. , , , , , , and , “

[620] Security-constrained optimal generation scheduling in large-scale power systems,” IEEE Transactions on Power Systems, vol. 21, no. 1, pp. 321-332, February 2006. , , and , “

[621] AC contingency dispatch based on securityconstrained unit commitment,” IEEE Transactions on Power Systems, vol. 21, no. 2, pp. 897-908, May 2006. , , and , “

[622] A new iterative approach to the corrective securityconstrained optimal power flow problem,” IEEE Transactions on Power Systems, vol. 23, no. 4, pp. 1533-1541, November 2008. and , “

[623] Decomposed scopf for improving efficiency,” IEEE Transactions on Power Systems, vol. 24, no. 1, pp. 494-495, February 2009. and , “

[624] Compressive Sensing for Wireless Communication, Cambridge, UK: Cambridge University Press, 2012. , , and ,

[625] Robust principal component analysis?” Journal of the ACM, vol. 58, no. 3, pp. 1-37, May 2011. , , , and , “

[626] UIUC, Tech. Rep. UILU-ENG-09-2215, Urbana, FL, USA, 2009. , , , and , “The augmented lagrange multiplier method for exact recovery of corrupted low-rank matrices,”

[627] A singular value thresholding algorithm for matrix completion,” SIAM Journal on Optimization, vol. 20, no. 4, pp. 1956-1982, January 2010. , , and , “

[628] Rice CAAM, Tech. Rep. TR11-02, Houston, TX, USA, 2011. , , and , “Augmented Lagrangian alternating direction method for matrix separation based on low-rank factorization,”

[629] Rice CAAM, Tech. Rep. TR10-07, Houston, TX, USA, 2010. , , and , “Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm,”

[630] MAT-POWER steady-state operations, planning and analysis tools for power systems research and education,” IEEETransactions on Power Systems, vol. 26, no. 1, pp. 12-19, February 2011. , , and , “

[631] A fast distributed implementation of optimal power flow,” IEEE Transactions on Power Systems, vol. 14, no. 3, pp. 858-864, August 1989. , , , and , “

[632] Dynamic network energy management via proximal message passing,” Foundations and Trends in Optimization, vol. 1, no. 2, pp. 1-54, January 2014. , , , and , “

[633] Rice CAAM, Tech. Rep. TR12-14, Houston, TX, USA, 2012. and , “On the global and linear convergence of the generalized alternating direction method of multipliers,”

[634] Numerical Optimization (2nd ed.), New York, USA: Springer, 2006. and ,

[635] Cloudburst: Highly sensitive read mapping with mapreduce,” Bioinformatics, vol. 25, no. 11, pp. 1363-1369, 2009. , “

[636] http://lintool.github.io/Cloud9/.

[637] A symmetric fragment and replicate algorithm for distributed joins,” IEEE Transactions on Parallel and Distributed Systems, vol. 4, no. 12, pp. 1345-1354, December 1993. and , “

[638] Proceedings of Very Large Data Base Conference, Zurich, Switzerland, September 1995. and , “Eager aggregation and lazy aggregation,” in

[639] Proceedings of ACM Symposium on Cloud Computing, San Jose, CA, USA, October 2012. , , and , “Balancing reducer skew in mapreduce workloads using progressive sampling,” in

[640] Proceedings of IEEE Annual Symposium on Foundation on Computer Science, Philadelphia, PA, USA, 2008. , , and , “The power of reordering for online minimum makespan scheduling,” in

[641] and , Algorithm Design, www.pearsoned.co.in/Web/Home.aspx, Pearson Education India, 2006.

[642] 2012. , Probability & Statistics for Engineering and the Sciences, CengageBrain.com,

[643] “Wikipedia page-to-page link,” 2013, http://haselgrove.id.au/wikipedia.htm.

[644] Proceedings of Hawaiian International Conference on Systems Science, Wailea Maui, HI, USA, January 2000. , , and , “Energy-efficient communication protocol for wireless microsensor networks,” in

[645] A survey on sensor networks,” IEEE Communications Magazine, vol. 40, no. 8, pp. 102-114, August 2002. , , , and , “

[646] Proceedings of ACM Annual Conference on Mobile Computing and Networking, Seattle, WA, USA, August 1999. , , , and , “Next century challenges: Scalable coordination in sensor networks,” in

[647] Proceedings of IEEE International Workshop on Mobile Computing Systems and Application, Callicon, NY, USA, June 2002. , , , and , “Supporting aggregate queries over ad-hoc wireless sensor networks,” in

[648] Proceedings of USENIX Operating System Design and Implementation, Boston, MA, USA, December 2002. , , , and , “Tag: A tiny aggregation service for ad hoc sensor networks,” in

[649] Proceedings of IEEE International Conference on Distributed Computing Systems, Vienna, Austria, July 2002. , , , and , “Impact of network density on data aggregation in wireless sensor networks,” in

[650] Proceedings of IEEE International Conference on Distributed Computing Systems Workshop on Distributed Event-based System, Vienna, Austria, July 2002. , , and , “The impact of data aggregation in wireless sensor networks,” in

[651] Routing techniques in wireless sensor networks: A survey,” IEEE Wireless Communications, vol. 11, no. 6, pp. 6-28, December 2004. and , “

[652] Proceedings of ACM Annual Conference on Mobile Computing and Networking, Seattle, WA, USA, August 1999. , , and , “Adaptive protocols for information dissemination in wireless sensor networks,” in

[653] Proceedings of ACM Annual Conference on Mobile Computing and Networking, Boston, MA, USA, August 2000. , , and , “Directed diffusion: A scalable and robust communication paradigm for sensor networks,” in

[654] Proceedings of ACM Workshop on Wireless Sensor Networks and Applications, Atlanta, GA, USA, September 2002. and , “Rumor routing algorithm for sensor networks,” in

[655] Scalable information-driven sensor querying and routing for ad hoc heterogeneous sensor networks,” International Journal of High Performance Computing Applications, vol. 16, no. 3, pp. 293-313, August 2002. , , and , “

[656] Proceedings of the IEEE International Workshop on Sensor Network Protocol and Applications, Seattle, WA, USA, May 2003. , , and , “the acquire mechanism mechanism for efficient querying in sensor networks,” in

[657] Proceedings of IEEE International Conference on Computer Communications, Hong Kong, China, March 2004. and , “Distributed clustering in ad-hoc sensor networks: A hybrid, energy-efficient approach,” in

[658] Proceedings of IEEE International Conference on Computer Communications, San Francisco, CA, USA, March 2003. and , “The power control and clustering in ad-hoc networks,” in

[659] Proceedings of IEEE International Conference on Communications, Anchorage, AK, USA, April 2001. and , “A clustering scheme for hierarchical control in multi-hop wireless networks,” in

[660] Special Issue on Sensor Networks, EURASIP Journal on Applied Signal Processing, vol. 2003, no. 4, 2004. , , and , eds.,

[661] Proceedings of ACM the Symposium on Principles of Database Systems, Paris, France, June 2004. and , “Power-conserving computation of order-statistics over sensor networks,” in

[662] Proceedings of IEEE International Conference on Communications, Miami, FL, USA, March 2005. , , and , “Power aware routing for sensor databases,” in

[663] Iterative water-filling for Gaussian vector multiple-access channels,” IEEE Transactions on Information Theory, vol. 50, no. 1, pp. 145-152, January 2004. , , , and , “

[664] Proceedings of ACM International Conference on Modeling, Analysis and Simulation of Wireless and Mobile Systems, Venice, Italy, October 2004. , , and , “A fast and reliable protocol for wireless sensor networks in critical conditions monitoring applications,” in

[665] Pegasis: Power-efficient gathering in sensor networks,” in Proceedings of IEEE Aerospace Conference, vol. 3, 2002. and , “

[666] Proceedings of IEEE International Conference on Computer Communications, Tel-Aviv, Israel, March 2000. , , and , “On the construction of energy-efficient broadcast and multicast trees in wireless networks,” in

[667] Proceedings of ACM Conference on Embedded Networked Sensor Systems, Baltimore, MD, USA, November 2004. , , , and , “Medians and beyond: New aggregation techniques for sensor networks,” in

[668] Probability inequalities for sums of bounded random variables,” Journal of the American Statistical Association, vol. 58, no. 301, pp. 13-30, 1963. , “