This is the name of the direction in neuroscience, which explores the techniques used by illusionists, street magicians and other hoaxers.
At the heart of most tricks is the ability to control the attention and perception of the viewer. The magician deceives our senses, and the more imperceptibly he does this, the stronger the effect. Neuroscientists study (and reproduce) magic tricks to understand how our attention works. For example, with the help of various tricks, they assess the ability of the subject to notice minor changes in the picture or the presence of a foreign object in the field of view.