Touch simulator

Draw an Arabic character on the board, then send it to the model to see what it recognises.

؟

What the simulator is for

Touch interfaces are difficult to test from a desk. A mouse produces a single precise pointer, while a real finger produces a broad contact area, a curved path and variable pressure - which is why a gesture that works perfectly with a mouse can fail on a phone. This tool generates synthetic touch input so those paths can be produced and replayed deliberately.

The second use is data collection. Handwriting recognition and gesture classification models are trained on stroke data: the ordered sequence of points that makes up each stroke, with timing. Capturing that in a browser, rather than instrumenting a native app, makes it far quicker to assemble a dataset.

What gets recorded

Each stroke is captured as an ordered list of points with coordinates and timing, which is the same shape most handwriting and gesture models expect as input. Because the timing is preserved, the recording carries speed and rhythm as well as shape - both of which matter to a classifier.

The data can be exported and fed straight into a training pipeline, or replayed to reproduce a specific interaction while debugging a touch handler.

Testing touch handlers

Beyond data collection, the simulator is useful for reproducing a bug. A gesture that only fails on a particular path is hard to trigger by hand repeatedly; replaying a recorded stroke makes it deterministic, so you can watch your handler respond to exactly the same input each time.

Frequently asked questions

What is a touch simulator used for?
Two things: testing how a touch interface responds to realistic gestures without a physical device in hand, and collecting handwriting or gesture stroke data for training and evaluating models.
What data does it capture?
Each stroke is recorded as an ordered sequence of points with coordinates and timing. That preserves the speed and rhythm of the stroke as well as its shape, which is the format most handwriting and gesture recognition models expect.
Can I export the stroke data?
Yes. Captured strokes can be exported for use in a training pipeline, or replayed to reproduce a specific interaction while debugging a touch handler.