Collaborative Middleware for Display Walls

(2010 - 2019) - Contributing Developer

Large Displays, PQLabs Touch Screen, C++, JavaScript, Node.js, Networking, Multi-disciplinary team, Unity, WebGL, Augmented Reality (HoloLens), Kinect Tracking, Omicron


SAGE™ (Scalable Adaptive Graphics Environment) middleware that provides a common operating environment, or framework, to access, display and share data-intensive 2D/3D multimedia content, such as images, video, and PDFs, on tiled-display walls.

SAGE2™, an open-source, browser-based framework to access, display and share data-intensive 2D/3D multimedia content on tiled-display walls.

Contribution Summary

  • Using Omicron input abstracted library, integrated multi-touch interaction for multi-user collaborative use.
  • Designed a multi-touch, multi-user centric user interface
  • Protoyped multi-touch interface design, evaluated in user studies, and deployed into the SAGE2 codebase.


  • Leigh, J., Kobayashi, D., Kirshenbaum, N., Wooton, T., Gonzalez, A., Renambot, L., Johnson, A., Brown, M., Burks, A., Bharadwaj, K. and Nishimoto, A., 2019, September. Usage patterns of wideband display environments in e-science research, development and training. In 2019 15th International Conference on eScience (eScience) (pp. 301-310). DOI:
  • Marrinan, T., Nishimoto, A., Insley, J.A., Rizzi, S., Johnson, A. and Papka, M.E. 2016. Interactive Multi-Modal Display Spaces for Visual Analysis. Proceedings of the 2016 ACM on Interactive Surfaces and Spaces (New York, NY, USA, 2016), 421–426. DOI:
  • Renambot, L., Marrinan, T., Aurisano, J., Nishimoto, A., Mateevitsi, V., Bharadwaj, K., Long, L., Johnson, A., Brown, M. and Leigh, J. 2016. SAGE2: A collaboration portal for scalable resolution displays. Future Generation Computer Systems. 54, (Jan. 2016), 296–305. DOI:
  • Marrinan, T., Aurisano, J., Nishimoto, A., Bharadwaj, K., Mateevitsi, V., Renambot, L., Long, L., Johnson, A. and Leigh, J. SAGE2: A New Approach for Data Intensive Collaboration Using Scalable Resolution Shared Displays. CollaborateCom. Miami, FL, October 2014. DOI: 10.4108/icst.collaboratecom.2014.257337
  • Nishimoto, A. Multi-User Interface for Scalable Resolution Touch Walls, MS Thesis, Department of Computer Science, University of Illinois at Chicago, 2014.