Skip to main content
Version: 2.x.x

@yozora/tokenizer-inline-code

Npm VersionNpm DownloadNpm LicenseModule formats: cjs, esmNode.js VersionTested with JestCode Style: prettier

github flavor markdown spec

A backtick string is a string of one or more backtick characters (`) that is neither preceded nor followed by a backtick.

A code span begins with a backtick string and ends with a backtick string of equal length. The contents of the code span are the characters between the two backtick strings, normalized in the following ways:

  • First, line endings are converted to spaces.

  • If the resulting string both begins and ends with a space character, but does not consist entirely of space characters, a single space character is removed from the front and back. This allows you to include code that begins or ends with backtick characters, which must be separated by whitespace from the opening or closing backtick strings.

Install

npm install --save @yozora/tokenizer-inline-code

Usage

tip

@yozora/tokenizer-inline-code has been integrated into @yozora/parser / @yozora/parser-gfm-ex / @yozora/parser-gfm, so you can use YozoraParser / GfmExParser / GfmParser directly.

import YozoraParser from '@yozora/parser'

const parser = new YozoraParser()

// parse source markdown content
parser.parse("`inline code`")

Options

NameTypeRequiredDefault
namestringfalse"@yozora/tokenizer-inline-code"
prioritynumberfalseTokenizerPriority.ATOMIC
  • name: The unique name of the tokenizer, used to bind the token it generates, to determine the tokenizer that should be called in each life cycle of the token in the entire matching / parsing phase.

  • priority: Priority of the tokenizer, determine the order of processing, high priority priority execution. interruptable. In addition, in the match-block stage, a high-priority tokenizer can interrupt the matching process of a low-priority tokenizer.

    Exception: Delimiters of type full are always processed before other type delimiters.

Types

@yozora/tokenizer-inline-code produce InlineCode type nodes. See @yozora/ast for full base types.

import type { Literal } from '@yozora/ast'

export const InlineCodeType = 'inlineCode'
export type InlineCodeType = typeof InlineCodeType

/**
* InlineCode represents a fragment of computer code, such as a file name,
* computer program, or anything a computer could parse.
* @see https://github.com/syntax-tree/mdast#inline-code
* @see https://github.github.com/gfm/#code-span
*/
export type InlineCode = Literal<InlineCodeType>

Live Examples

  • Basic.

    #338
      
      
  • Here two backticks are used, because the code contains a backtick. This example also illustrates stripping of a single leading and trailing space.

    #339
      
      
  • This example shows the motivation for stripping leading and trailing spaces.

    #340
      
      
  • Note that only one space is stripped.

    #341
      
      
  • The stripping only happens if the space is on both sides of the string.

    #342
      
      
  • Only spaces, and not unicode whitespace in general, are stripped in this way.

    #343
      
      
  • No stripping occurs if the code span contains only spaces.

    #344
      
      
  • Line endings are treated like spaces.

      
      
  • Interior spaces are not collapsed.

    #347
      
      
  • Note that backslash escapes do not work in code spans. All backslashes are treated literally.

    #348
      
      
  • Backslash escapes are never needed, because one can always choose a string of nn backtick characters as delimiters, where the code does not contain any strings of exactly nn backtick characters.

      
      
  • Code span backticks have higher precedence than any other inline constructs except HTML tags and autolinks. Thus, for example, this is not parsed as emphasized text, since the second * is part of a code span.

    #351
      
      
  • And this is not parsed as a link.

    #352
      
      
  • Code spans, HTML tags, and autolinks have the same precedence. Thus, this is code span.

    #353
      
      
  • But this is an HTML tag.

    #354
      
      
  • And this is code.

    #355
      
      
  • But this is an autolink.

    #356
      
      
  • When a backtick string is not closed by a matching backtick string, we just have literal backticks.

      
      
  • The following case also illustrates the need for opening and closing backtick strings to be equal in length.

    #359