Skip to main content Accessibility help
×
Home

Lab on a beam—Big data and artificial intelligence in scanning transmission electron microscopy

  • Sergei V. Kalinin (a1), Andrew R. Lupini (a2), Ondrej Dyck (a3), Stephen Jesse (a4), Maxim Ziatdinov (a5) and Rama K. Vasudevan (a6)...

Abstract

Atomically resolved imaging of materials enabled by the advent of aberration-corrected scanning transmission electron microscopy (STEM) has become a mainstay of modern materials science. However, much of the wealth of quantitative information contained in the fine details of atomic structure or spectra remains largely unexplored. In this article, we discuss new opportunities enabled by physics-informed big data and machine learning technologies to extract physical information from static and dynamic STEM images, ranging from statistical thermodynamics of alloys to kinetics of solid-state reactions at a single defect level. The synergy of deep-learning image analytics and real-time feedback further allows harnessing beam-induced atomic and bond dynamics to enable direct atom-by-atom fabrication. Examples of direct atomic motion over mesoscopic distances, engineered doping at selected lattice sites, and assembly of multiatomic structures are reviewed. These advances position the scanning transmission electron microscope to transition from a mere imaging tool toward a complete nanoscale laboratory for exploring electronic, phonon, and quantum phenomena in atomically engineered structures.

  • View HTML
    • Send article to Kindle

      To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

      Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      Lab on a beam—Big data and artificial intelligence in scanning transmission electron microscopy
      Available formats
      ×

      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

      Lab on a beam—Big data and artificial intelligence in scanning transmission electron microscopy
      Available formats
      ×

      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

      Lab on a beam—Big data and artificial intelligence in scanning transmission electron microscopy
      Available formats
      ×

Copyright

Footnotes

Hide All

This article is based on the Symposium X (Frontiers of Materials Research) presentation given at the 2018 MRS Fall Meeting in Boston, Mass.

Footnotes

References

Hide All
1.Martin, J.D., Solid State Insurrection: How the Science of Substance Made American Physics Matter (University of Pittsburgh Press, Pittsburgh, 2018).
2.Mody, C.C.M., Instrumental Community (MIT Press, Cambridge, MA, 2011).
3.Krivanek, O.L., Dellby, N., Spence, A.J., Camps, R.A., Brown, L.M., “Aberration Correction in the STEM,” in Electron Microscopy and Analysis 1997, Rodenburg, J.M., Ed. (IOP Publishing, Bristol, 1997), p. 35.
4.Haider, M., Uhlemann, S., Schwan, E., Rose, H., Kabius, B., Urban, K., Nature 392, 768 (1998).
5.Scherzer, O., Optik 2, 114 (1947).
6.Dellby, N., Krivanek, O.L., Nellist, P.D., Batson, P.E., Lupini, A.R., J. Electron Microsc. 50, 177 (2001).
7.Pennycook, S.J., Nellist, P.D., Eds., Scanning Transmission Electron Microscopy: Imaging and Analysis (Springer, New York, 2011).
8.Varela, M., Findlay, S.D., Lupini, A.R., Christen, H.M., Borisevich, A.Y., Dellby, N., Krivanek, O.L., Nellist, P.D., Oxley, M.P., Allen, L.J., Pennycook, S.J., Phys. Rev. Lett. 92, 095502 (2004).
9.Idrobo, J.C., Lupini, A.R., Feng, T.L., Unocic, R.R., Walden, F.S., Gardiner, D.S., Lovejoy, T.C., Dellby, N., Pantelides, S.T., Krivanek, O.L., Phys. Rev. Lett. 120, 095901 (2018).
10.Larocque, H., Bouchard, F., Grillo, V., Sit, A., Frabboni, S., Dunin-Borkowski, R.E., Padgett, M.J., Boyd, R.W., Karimi, E., Phys. Rev. Lett. 117, 154801 (2016).
11.Jiang, Y., Chen, Z., Hang, Y.M., Deb, P., Gao, H., Xie, S.E., Purohit, P., Tate, M.W., Park, J., Gruner, S.M., Elser, V., Muller, D.A., Nature 559, 343 (2018).
12.Dyck, O., Kim, S., Jimenez-Izal, E., Alexandrova, A.N., Kalinin, S.V., Jesse, S., Small 14, e1801771 (2018).
13.Susi, T., Meyer, J.C., Kotakoski, J., Ultramicroscopy 180, 163 (2017).
14.Eigler, D.M., Schweizer, E.K., Nature 344, 524 (1990).
15.Pennycook, S.J., Kalinin, S.V., Nature 515, 487 (2014).
16.Ziatdinov, M., Dyck, O., Jesse, S., Kalinin, S.V., “Atomic Mechanisms for the Si Atom Dynamics in Graphene: Chemical Transformations at the Edge and in the Bulk,” arXiv preprint arXiv:09322 (2019).
17.Jesse, S., He, Q., Lupini, A.R., Leonard, D.N., Oxley, M.P., Ovchinnikov, O., Unocic, R.R., Tselev, A., Fuentes-Cabrera, M., Sumpter, B.G., Pennycook, S.J., Kalinin, S.V., Borisevich, A.Y., Small 11, 5895 (2015).
18.Feng, J., Kvit, A.V., Zhang, C., Hoffman, J., Bhattacharya, A., Morgan, D., Voyles, P.M., “Imaging of Single La Vacancies in LaMnO3,” preprint, submitted arXiv:06308 (2017).
19.Ziatdinov, M., Maksov, A., Kalinin, S.V., npj Comp. Mater. 3, 31 (2017).
20.Pycroscopy: Scientific Analysis of Nanoscale Materials Imaging Data, https://github.com/pycroscopy/AICrystallographer.
21.Simonyan, K., Zisserman, A., “Very Deep Convolutional Networks for Large-Scale Image Recognition,” preprint, submitted arXiv:1409.1556 (2014).
23.Ziatdinov, M., Dyck, O., Maksov, A., Li, X., Sang, X., Xiao, K., Unocic, R.R., Vasudevan, R., Jesse, S., Kalinin, S.V., ACS Nano 11, 12742 (2017).
24.Maksov, A., Dyck, O., Wang, K., Xiao, K., Geohegan, D.B., Sumpter, B.G., Vasudevan, R.K., Jesse, S., Kalinin, S.V., Ziatdinov, M., npj Comp. Mater. 5, 12 (2019).
25.Madsen, J., Liu, P., Kling, J., Wagner, J.B., Hansen, T.W., Winther, O., Schiøtz, J., Adv. Theory Simul. 1, 1800037 (2018).
26.Rashidi, M., Wolkow, R.A., ACS Nano 12, 5185 (2018).
27.Swift, Nion, www.nion.com/swift.
28.Krivanek, O.L., Chisholm, M.F., Nicolosi, V., Pennycook, T.J., Corbin, G.J., Dellby, N., Murfitt, M.F., Own, C.S., Szilagyi, Z.S., Oxley, M.P., Pantelides, S.T., Pennycook, S.J., Nature 464, 571 (2010).
29.Govind Rajan, A., Silmore, K.S., Swett, J., Robertson, A.W., Warner, J.H., Blankschtein, D., Strano, M.S., Nat. Mater. 18, 129 (2019).
30.Ziatdinov, M., Dyck, O., Sumpter, B.G., Jesse, S., Vasudevan, R.K., Kalinin, S.V., “Building and Exploring Libraries of Atomic Defects in Graphene: Scanning Transmission Electron and Scanning Tunneling Microscopy Study,” preprint, submitted arXiv:04256 (2018).
31.Si-Vacancy Complexes in Graphene, https://doi.org/10.25920/0xv3-8459.
32.Takagi, H., Takayama, T., Jackeli, G., Khaliullin, G., Nagler, S.E., Nat. Rev. Phys. 1, 264 (2019).
33.Borisevich, A.Y., Morozovska, A.N., Kim, Y.M., Leonard, D., Oxley, M.P., Biegalski, M.D., Eliseev, E.A., Kalinin, S.V., Phys. Rev. Lett. 109, 065702 (2012).
34.Li, Q., Nelson, C.T., Hsu, S.L., Damodaran, A.R., Li, L.L., Yadav, A.K., McCarter, M., Martin, L.W., Ramesh, R., Kalinin, S.V., Nat. Commun. 8, 1468 (2017).
35.Ievlev, A.V., Jesse, S., Cochell, T.J., Unocic, R.R., Protopopescu, V.A., Kalinin, S.V., ACS Nano 9, 11784 (2015).
36.Sethna, J.P., Statistical Mechanics: Entropy, Order Parameters and Complexity, 1st ed. (Oxford University Press, Oxford, UK, 2006).
37.Vlcek, L., Maksov, A., Pan, M.H., Vasudevan, R.K., Kalinin, S.V., ACS Nano 11, 10313 (2017).
38.Vlcek, L., Vasudevan, R.K., Jesse, S., Kalinin, S.V., J. Chem. Theory Comput. 13, 5179 (2017).
39.Vlcek, L., Ziatdinov, M., Maksov, A., Tselev, A., Baddorf, A.P., Kalinin, S.V., Vasudevan, R.K., ACS Nano 13, 718 (2019).
40.Mardt, A., Pasquali, L., Wu, H., Noe, F., Nat. Commun. 9, 5 (2018).
41.Kalinin, S.V., Borisevich, A., Jesse, S., Nature 539, 485 (2016).
42.Jesse, S., Hudak, B.M., Zarkadoula, E., Song, J., Maksov, A., Fuentes-Cabrera, M., Ganesh, P., Kravchenko, I., Snijders, P.C., Lupini, A.R., Borisevich, A.Y., Kalinin, S.V., Nanotechnology 29, 255303 (2018).
43.Richard Feynman′s blackboard at time of his death (1988) Caltech Photo Archives, ID Number 1.10-29.

Keywords

Lab on a beam—Big data and artificial intelligence in scanning transmission electron microscopy

  • Sergei V. Kalinin (a1), Andrew R. Lupini (a2), Ondrej Dyck (a3), Stephen Jesse (a4), Maxim Ziatdinov (a5) and Rama K. Vasudevan (a6)...

Metrics

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed