Falcon Perception
Perception-centric systems are typically implemented with a modular encoder-decoder pipeline: a vision backbone for feature extraction and a separate decoder (or late-fusion module) for task prediction. This raises a central question: is this architectural separation essential or can a single early-fusion stack do both perception and task modeling at scale? We introduce Falcon Perception, a unified dense Transformer that processes image patches and text tokens in a shared parameter space from the first layer, using a hybrid attention pattern (bidirectional among image tokens, causal for prediction tokens) to combine global visual context with autoregressive, variable-length instance gener...
| Authors | Aviraj Bevli, Sofian Chaybouti, Yasser Dahou et al. |
|---|---|
| Primary category | cs.CV |
| Published | 28 March 2026 |
| Last updated at source | 28 March 2026 |
Connected in the knowledge graph
- tiiuae/Falcon-PerceptionModel · cited by
- tiiuae/Falcon-Perception-300MModel · cited by
- tiiuae/PBenchDataset · cited by
- tiiuae/Falcon-OCRModel · cited by
- acid1burn/falcon_ocr_kv_token_q8.onnxModel · cited by
Models and datasets referencing this paper
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.