Top-level paragraphs (that is: paragraphs not embedded in a list) are indexed using the paragraph tag, any additional tags can be added using Reference/Tag.
By default, paragraphs are indexed when they contain a tag or anchor. However, you can enable indexing all paragraphs by adding the following to your ^Library/Config:
config.set("index.paragraph.all", true)
Example query, querying a paragraph with a #paragraph-tag:
${query[[from index.paragraphs("paragraph-tag")]]}
text: paragraph Markdown. When the paragraph carries an anchor, its anchor, tags and inline attributes are removed from this text.page: containing page name.pos, range: start position and [start, end] source range.ref, tag, tags, itags: shared object fields. tag is paragraph.