Skip to main content Accessibility help
×
Hostname: page-component-7c8c6479df-fqc5m Total loading time: 0 Render date: 2024-03-28T15:28:26.513Z Has data issue: false hasContentIssue false

43 - Computational linguistics

from Part II - Language processing

Published online by Cambridge University Press:  05 June 2012

Masayuki Asahara
Affiliation:
Assistant Professor in Information Science, Nara Institute of Science and Technology
Yasuharu Den
Affiliation:
Associate Professor in Cognitive and Information Sciences, Chiba University
Yuji Matsumoto
Affiliation:
Professor in Information Science, Nara Institute of Science and Technology
Mineharu Nakayama
Affiliation:
Ohio State University
Reiko Mazuka
Affiliation:
Duke University, North Carolina
Yasuhiro Shirai
Affiliation:
Cornell University, New York
Ping Li
Affiliation:
University of Richmond, Virginia
Get access

Summary

Introduction

Computational linguistics is a research field which investigates computational mechanisms of language comprehension and production, realizing them as computer programs. Researchers in this field have been working on formal descriptions of lexical, syntactic, semantic, and pragmatic knowledge, and algorithms for parsing and generation, which utilize these descriptions as rules for governing the computational process and heuristics for assigning preference among them. In traditional approaches, these rules and heuristics were designed by expert linguists and computational linguists, but in more recent approaches, they are automatically acquired from large language resources such as text/speech corpora and electronic dictionaries and thesauri. In the following sections, we describe language resources for Japanese computational linguistics, tools for retrieving and processing information in them, and how they are used in computational linguistic studies and can be used in psycholinguistic studies.

Text/speech corpora

Text/speech corpora are the most important resources in computational linguistics. It can be said that the progress of research on a particular language depends heavily on how many good corpora are available in that language. Japan has fallen behind the US and European countries in corpus development and maintenance. Before 1990s, researchers at individual institutes developed small-scale corpora, and no leading organization like the LDC (Linguistics Data Consortium) in the US was formed. We had to wait until the mid 1990s before large-scale Japanese corpora became available.

Table summarizes major text/speech corpora of Japanese which are currently, or will be in the near future, available. They are extensively used in computational linguistic studies of Japanese such as development and tuning of automatic morphological analyzers, syntactic parsers, information retrieval, text summarization, and dialog systems.

Type
Chapter
Information
Publisher: Cambridge University Press
Print publication year: 2006

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

  • Computational linguistics
    • By Masayuki Asahara, Assistant Professor in Information Science, Nara Institute of Science and Technology, Yasuharu Den, Associate Professor in Cognitive and Information Sciences, Chiba University, Yuji Matsumoto, Professor in Information Science, Nara Institute of Science and Technology
  • Edited by Mineharu Nakayama, Ohio State University, Reiko Mazuka, Duke University, North Carolina, Yasuhiro Shirai, Cornell University, New York
  • General editor Ping Li, University of Richmond, Virginia
  • Book: The Handbook of East Asian Psycholinguistics
  • Online publication: 05 June 2012
  • Chapter DOI: https://doi.org/10.1017/CBO9780511758652.046
Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

  • Computational linguistics
    • By Masayuki Asahara, Assistant Professor in Information Science, Nara Institute of Science and Technology, Yasuharu Den, Associate Professor in Cognitive and Information Sciences, Chiba University, Yuji Matsumoto, Professor in Information Science, Nara Institute of Science and Technology
  • Edited by Mineharu Nakayama, Ohio State University, Reiko Mazuka, Duke University, North Carolina, Yasuhiro Shirai, Cornell University, New York
  • General editor Ping Li, University of Richmond, Virginia
  • Book: The Handbook of East Asian Psycholinguistics
  • Online publication: 05 June 2012
  • Chapter DOI: https://doi.org/10.1017/CBO9780511758652.046
Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

  • Computational linguistics
    • By Masayuki Asahara, Assistant Professor in Information Science, Nara Institute of Science and Technology, Yasuharu Den, Associate Professor in Cognitive and Information Sciences, Chiba University, Yuji Matsumoto, Professor in Information Science, Nara Institute of Science and Technology
  • Edited by Mineharu Nakayama, Ohio State University, Reiko Mazuka, Duke University, North Carolina, Yasuhiro Shirai, Cornell University, New York
  • General editor Ping Li, University of Richmond, Virginia
  • Book: The Handbook of East Asian Psycholinguistics
  • Online publication: 05 June 2012
  • Chapter DOI: https://doi.org/10.1017/CBO9780511758652.046
Available formats
×