Immersive Visualization / IQ-Station Wiki

This site hosts information on virtual reality systems that are geared toward scientific visualization, and as such often toward VR on Linux-based systems. Thus, pages here cover various software (and sometimes hardware) technologies that enable virtual reality operation on Linux.

The original IQ-station effort was to create low-cost (for the time) VR systems making use of 3DTV displays to produce CAVE/Fishtank-style VR displays. That effort pre-dated the rise of the consumer HMD VR systems, however, the realm of midrange-cost large-fishtank systems is still important, and has transitioned from 3DTV-based systems to short-throw projectors.

Difference between revisions of "VMD"

From IQ-Station Wiki
Jump to navigation Jump to search
m (Added a couple non-immersive development issues)
(Updated for VMD version 1.9.4a57)
Line 2: Line 2:
'''Visual Molecular Dynamics (VMD)'''
'''Visual Molecular Dynamics (VMD)'''


[http://www.ks.uiuc.edu/Research/vmd/ VMD] is a good visualization tool for visualizing large molecular systems (typically used for large biomolecular systems).  VMD has a long history of being interfaced to immersive technologies, including haptic devices and CAVE VR displays.  There is also a section on the usage of VMD for HPC systems.
[http://www.ks.uiuc.edu/Research/vmd VMD] is a good visualization tool for visualizing large molecular systems (typically used for large biomolecular systems).  VMD has a long history of being interfaced to immersive technologies, including haptic devices and CAVE VR displays.  There is also a section on the usage of VMD for HPC systems.


=Immersive Mode VMD=
=Immersive Mode VMD=
Line 12: Line 12:
If VMD with the FreeVR interface is installed and properly configured, follow these steps to run in immersive mode:
If VMD with the FreeVR interface is installed and properly configured, follow these steps to run in immersive mode:


#<CODE>% vmd -dispdev freevrforms ../proteins/brH.pdb</CODE>
#<CODE>% module load freevr vmd</CODE>
#<CODE>% vmd -dispdev freevrforms &LT;path&GT;/proteins/brH.pdb</CODE>
#*This alone should be sufficient to render the molecule in the VR system, with joystick-controlled travel
# In order to grab and move an object, the <CODE>grab</CODE> tool must be initialized:
# In order to grab and move an object, the <CODE>grab</CODE> tool must be initialized:
#:# &rarr;<CODE>Graphics</CODE> &rarr;<CODE>Tools</CODE>
#:# &rarr;<CODE>Graphics</CODE> &rarr;<CODE>Tools</CODE>
Line 28: Line 30:
# Install missing dependencies
# Install missing dependencies
#: Commonly needed packages include:
#: Commonly needed packages include:
#:* tcl-devel (8.x -- perhaps 8.4 or greater)
#:* tcl-devel (8.5 -- 8.6 works with edits to <CODE>Makefile</CODE>)
#:* tk-devel (8.x -- perhaps 8.4 or greater)
#:* tk-devel (8.5 -- 8.6 works with edits to <CODE>Makefile</CODE>)
#:* fltk-devel
#:* fltk-devel
#:* netcdf-devel
#:* netcdf-devel
#:
#:
# Download the latest source (version 1.9.1 as of this writing [04/09/12])
# Download the latest source (version 1.9.4a57 as of this writing [12/21/23])
#:: [http://www.ks.uiuc.edu/Development/Download/download.cgi?PackageName=VMD http://www.ks.uiuc.edu/Development/Download/download.cgi?PackageName=VMD]
#:: [http://www.ks.uiuc.edu/Development/Download/download.cgi?PackageName=VMD http://www.ks.uiuc.edu/Development/Download/download.cgi?PackageName=VMD]
#: NOTE: there is a (free) registration process required
#: NOTE: there is a (free) registration process required
#: NOTE: the pre-built packages may not contain the Immersive features  
#: NOTE: the pre-built packages may not contain the Immersive features  
# Untar the source ball
# Untar the source ball
#: E.g. <CODE>% tar -zxf vmd-1.9.1.src.tar.gz</CODE>
#: E.g. <CODE>% tar -zxf vmd-<version>.src.tar.gz</CODE>
#::(As of this writing [12/21/23] <CODE>&LT;version&GT;</CODE> is <CODE>1.9.4a57</CODE>)
# Compile the plugins
# Compile the plugins
#: <CODE>% export PLUGINDIR=`pwd`/vmd-<version>/plugins</CODE>
#: <CODE>% cd plugins</CODE>
#: <CODE>% cd plugins</CODE>
#: <CODE>% make <architecture></CODE> &mdash; E.g. LINUXAMD64
#: <CODE>% make <architecture></CODE> &mdash; E.g. LINUXAMD64
#: <CODE>% export PLUGINDIR=`pwd`/../vmd-<version>/plugins</CODE>
#: <CODE>% make distrib</CODE>
#: <CODE>% make distrib</CODE>
# Configure VMD
# Configure VMD
Line 50: Line 53:
#::A sample list is:
#::A sample list is:
#::* <CODE>LINUXAMD64 OPENGL FREEVR FLTK TK TCL PTHREADS</CODE>
#::* <CODE>LINUXAMD64 OPENGL FREEVR FLTK TK TCL PTHREADS</CODE>
#::An expanded list is:
#::* <CODE>LINUXAMD64 OPENGL OPENGLPBUFFER FREEVR FLTK TK CXX11 XINERAMA XINPUT LIBPNG ZLIB VRPN NETCDF TCL PTHREADS SILENT</CODE>
#::(I don't necessarily know what all those do and whether they help or not)
#::(As of this writing [12/21/23] I was unable to get the <CODE>CUDA</CODE>, <CODE>Optix</CODE> or <CODE>Python</CODE> options to work.
#: <CODE>% $EDITOR configure</CODE>
#:: CHANGE: <CODE>install_bin_dir=&LT;installation-path&GT;/bin</CODE>
#:: CHANGE: <CODE>install_library_dir=&LT;installation-path&GT;/lib/$install_name</CODE>
#: <CODE>% ./configure</CODE>
#: <CODE>% ./configure</CODE>
# Compile VMD
# Compile VMD
#: <CODE>% cd <path>/vmd-<version></CODE>
#: <CODE>% export PLUGINDIR=`pwd`/plugins</CODE> &mdash; only if you're in a different shell from where this happened in step 4
#: <CODE>% export PLUGINDIR=`pwd`/plugins</CODE> &mdash; only if you're in a different shell from where this happened in step 4
#: <CODE>% cd src</CODE>
#: <CODE>% cd src</CODE>
#: <CODE>% $EDITOR Makefile</CODE>
#: <CODE>% $EDITOR Makefile</CODE>
#::NOTE: you will need to edit the values for <CODE>INCDIRS</CODE> and <CODE>LIBDIRS</CODE> to point to the correct directory for the '''FreeVR''' includes and library.
#:: CHANGE: edit the values for <CODE>INCDIRS</CODE> and <CODE>LIBDIRS</CODE> to point to the correct directory for the '''FreeVR''' includes and library.
#::* (UNLESS: you've configured <CODE>$CPATH</CODE> and <CODE>$LPATH</CODE>, perhaps through the "modules" system.)
#:: CHANGE: edit <CODE>{{Con|tcl8.5}}</CODE> and <CODE>{{Con|tk8.5}}</CODE> to be <CODE>tcl8.6</CODE> and <CODE>tk8.6</CODE> respectively if that's the version of Tcl/Tk installed on your system
#::* NOTE: Ideally the VMD build system would just specify <CODE>tcl8</CODE> and <CODE>tk8</CODE>.
#: <CODE>* make veryclean</CODE>
#: <CODE>* make veryclean</CODE>
#: <CODE>% make -j 8</CODE>
#: <CODE>% make -j 8</CODE>
#::NOTE: you will get several compiler warnings.  As long as they are only warnings, you should be fine.
#::NOTE: you will get a handful compiler warnings.  As long as they are only warnings, you should be fine.
# Install VMD
# Install VMD
#: <CODE>% sudo make install</CODE>
#: <CODE>% sudo make install</CODE>
Line 76: Line 90:
The format of this file is described in the [http://www.ks.uiuc.edu/Research/vmd/vmd-1.9.1/ug/node49.html VMD User's Guide: Tool Window] documentation.
The format of this file is described in the [http://www.ks.uiuc.edu/Research/vmd/vmd-1.9.1/ug/node49.html VMD User's Guide: Tool Window] documentation.


* Create a <CODE>.vmdsensors</CODE> file:
* Create a <CODE>.vmdsensors</CODE> file in your <CODE>$HOME</CODE> directory or the local directory:
*: Here is a sample <CODE>.vmdsensors</CODE> file for use with FreeVR:
*: Here is a sample <CODE>.vmdsensors</CODE> file for use with FreeVR:
<BLOCKQUOTE>
<BLOCKQUOTE>
Line 87: Line 101:
offset 0.9 -4.0 -1.0
offset 0.9 -4.0 -1.0
device freevrbuttons freevrbuttons://local/freevr:0,1,2,3
device freevrbuttons freevrbuttons://local/freevr:0,1,2,3
## if you have more than one wand..
## uncomment the following if you have more than one wand:
#device vrtracker2 freevrtracker://local/freevr:1
#device vrtracker2 freevrtracker://local/freevr:1
#scale 1.0
#scale 1.0
Line 98: Line 112:


* To change the overall world transformation via the Tcl command shell, try these options:
* To change the overall world transformation via the Tcl command shell, try these options:
** <CODE>scale to .5</CODE>
** <CODE>vmd > '''scale to .5'''</CODE>
** <CODE>translate to 0 0 -3</CODE>
** <CODE>vmd > '''translate to 0 0 -3'''</CODE>


* To place the FLTK menu interface on a screen separate from the immersive displays, use the <CODE>DISPLAY</CODE> environment variable.
* To place the FLTK menu interface on a screen separate from the immersive displays, use the <CODE>DISPLAY</CODE> environment variable prior to running the <CODE>vmd</CODE> command.




==Usage Issues==
==Usage Issues==


[NOTE: these issues are from tests with VMD version 1.9.2a15.]
[NOTE: these issues are from tests with VMD version 1.9.2a15. (And need to be re-tested with version 1.9.4a57)]


* I still need to figure out the proper scale and offset (this would/will be easier if we can avoid the use of Euler angles in <CODE>P_GrabTool.C</CODE>).
* I still need to figure out the proper scale and offset (this would/will be easier if we can avoid the use of Euler angles in <CODE>P_GrabTool.C</CODE>).
Line 118: Line 132:
* Changes in representations seem to only have an effect on a single screen.
* Changes in representations seem to only have an effect on a single screen.


==Build Issues==
* VMD should compile with Tcl/Tk 8.6 (as mentioned above), probably better to just use the major version number
* The CUDA option did not compile for me as it's hard-coded to Cuda version 10.2, and I have version 12.3.
* Some of the plugins report as being broken when starting VMD -- but some of them work, so it's not a matter of improperly building/installing the "plugins".


==Development Issues==
==Development Issues==
Line 129: Line 147:
===Non-immersive development issues===
===Non-immersive development issues===
* Can FLTK menus work without OPENGL enabled?
* Can FLTK menus work without OPENGL enabled?
* Running <CODE>./configure</CODE> should report installation directories &mdash; since those are options we may want to change (otherwise one may not know where these can be configured)
* Running <CODE>./configure</CODE> should report installation directories &mdash; since those are options we may want to change (otherwise one may not know where these can be configured).
* Is there a command (if not, can one be added) that reports the configuration options of the compiled VMD?
* Is there a command (if not, can one be added) that reports the configuration options of the compiled VMD?
* "Lines" and "Points" representations don't seem to work when rendering from BigRedII to the desktop.
* <S>"Lines" and "Points" representations don't seem to work when rendering from BigRedII to the desktop.</S>
** (I don't care about the BigRedII HPC system anymore, but this issue may also exist when using VNC, etc.)





Revision as of 20:03, 21 December 2023

Visual Molecular Dynamics (VMD)

VMD is a good visualization tool for visualizing large molecular systems (typically used for large biomolecular systems). VMD has a long history of being interfaced to immersive technologies, including haptic devices and CAVE VR displays. There is also a section on the usage of VMD for HPC systems.

Immersive Mode VMD

Information specific to the usage and setup of VMD for immserive systems such as the CAVE virtual reality display.

How to Run VMD in Immersive Mode

If VMD with the FreeVR interface is installed and properly configured, follow these steps to run in immersive mode:

  1. % module load freevr vmd
  2. % vmd -dispdev freevrforms <path>/proteins/brH.pdb
    • This alone should be sufficient to render the molecule in the VR system, with joystick-controlled travel
  3. In order to grab and move an object, the grab tool must be initialized:
    1. GraphicsTools
    2. Create a grab style tool
    3. set Position to FreeVRTracker
    4. set Buttons to FreeVRButtons
    The wand avatar will now appear in the scene
  4. Now touch an object with the wand avatar and press Button-1 to move it.


How to Build VMD w/ Immersive features

This section specifically instructs on how to compile VMD using the FreeVR immersive interface library.

  1. Install missing dependencies
    Commonly needed packages include:
    • tcl-devel (8.5 -- 8.6 works with edits to Makefile)
    • tk-devel (8.5 -- 8.6 works with edits to Makefile)
    • fltk-devel
    • netcdf-devel
  2. Download the latest source (version 1.9.4a57 as of this writing [12/21/23])
    http://www.ks.uiuc.edu/Development/Download/download.cgi?PackageName=VMD
    NOTE: there is a (free) registration process required
    NOTE: the pre-built packages may not contain the Immersive features
  3. Untar the source ball
    E.g. % tar -zxf vmd-<version>.src.tar.gz
    (As of this writing [12/21/23] <version> is 1.9.4a57)
  4. Compile the plugins
    % export PLUGINDIR=`pwd`/vmd-<version>/plugins
    % cd plugins
    % make <architecture> — E.g. LINUXAMD64
    % make distrib
  5. Configure VMD
    % cd ../vmd-<version>
    % $EDITOR configure.options
    Enter a list of desired options -- make sure to include FREEVR
    A sample list is:
    • LINUXAMD64 OPENGL FREEVR FLTK TK TCL PTHREADS
    An expanded list is:
    • LINUXAMD64 OPENGL OPENGLPBUFFER FREEVR FLTK TK CXX11 XINERAMA XINPUT LIBPNG ZLIB VRPN NETCDF TCL PTHREADS SILENT
    (I don't necessarily know what all those do and whether they help or not)
    (As of this writing [12/21/23] I was unable to get the CUDA, Optix or Python options to work.
    % $EDITOR configure
    CHANGE: install_bin_dir=<installation-path>/bin
    CHANGE: install_library_dir=<installation-path>/lib/$install_name
    % ./configure
  6. Compile VMD
    % cd <path>/vmd-<version>
    % export PLUGINDIR=`pwd`/plugins — only if you're in a different shell from where this happened in step 4
    % cd src
    % $EDITOR Makefile
    CHANGE: edit the values for INCDIRS and LIBDIRS to point to the correct directory for the FreeVR includes and library.
    • (UNLESS: you've configured $CPATH and $LPATH, perhaps through the "modules" system.)
    CHANGE: edit tcl8.5 and tk8.5 to be tcl8.6 and tk8.6 respectively if that's the version of Tcl/Tk installed on your system
    • NOTE: Ideally the VMD build system would just specify tcl8 and tk8.
    * make veryclean
    % make -j 8
    NOTE: you will get a handful compiler warnings. As long as they are only warnings, you should be fine.
  7. Install VMD
    % sudo make install

At this point you can now run VMD in standard desktop mode.

  • For example:
    % vmd ../proteins/brH.pdb


How to Configure VMD for Immersive displays

There are two stages of configuration required for the overall configuration of VMD for immersive displays. The first step is to configure FreeVR for the specific hardware setup of the immersive facility. This is explained in the FreeVR documentation. The second stage is to link the FreeVR inputs to VMD "sensors devices".

VMD "sensor devices" are specified in the .vmdsensors file. The format of this file is described in the VMD User's Guide: Tool Window documentation.

  • Create a .vmdsensors file in your $HOME directory or the local directory:
    Here is a sample .vmdsensors file for use with FreeVR:
###     
### Configuration for the FreeVR trackers
###     
device freevrtracker freevrtracker://local/freevr
scale 0.5
offset 0.9 -4.0 -1.0
device freevrbuttons freevrbuttons://local/freevr:0,1,2,3
## uncomment the following if you have more than one wand:
#device vrtracker2 freevrtracker://local/freevr:1
#scale 1.0
#offset 0.9 -4.0 -1.0

General Usage

Usage Tidbits

  • To change the overall world transformation via the Tcl command shell, try these options:
    • vmd > scale to .5
    • vmd > translate to 0 0 -3
  • To place the FLTK menu interface on a screen separate from the immersive displays, use the DISPLAY environment variable prior to running the vmd command.


Usage Issues

[NOTE: these issues are from tests with VMD version 1.9.2a15. (And need to be re-tested with version 1.9.4a57)]

  • I still need to figure out the proper scale and offset (this would/will be easier if we can avoid the use of Euler angles in P_GrabTool.C).
  • The grab tool only grabs one molecule object at a time, so multiple molecules won't stay together.
  • The grab tool requires that the wand avatar be touching an object before it can be moved.
  • The rotate tool does not work
  • I don't know how to use the joystick tool — does it work with the VR interfaces?
  • I need to learn whether (and if so what) the command-line and/or tcl-shell options for setting up the graphics tools w/o the need for the interactive menu.
  • There are gimble lock issues when the wand points up or down.
  • The material colors of some/all of the objects in the scene are not always present.
  • Changes in representations seem to only have an effect on a single screen.

Build Issues

  • VMD should compile with Tcl/Tk 8.6 (as mentioned above), probably better to just use the major version number
  • The CUDA option did not compile for me as it's hard-coded to Cuda version 10.2, and I have version 12.3.
  • Some of the plugins report as being broken when starting VMD -- but some of them work, so it's not a matter of improperly building/installing the "plugins".

Development Issues

This section is for issues that are of interest to those working directly on the VMD code-base as it relates to immersive interfaces.

  • DONE: Need to figure out how to pass RenderInfo * argument to FreeVRScene::draw() in order to add the navigation controls to where the virtual world is rendered.
  • Need to go over the source code in P_GrabTool.C so that I can know how to improve it (and I'll add comments as we go.) My goal is to avoid the use of Euler angles, since there are gimble lock issues in the interface.
  • Consider adding a grab-world tool that allows the entire world to be grabbed with the wand. An alternative was done — an always active "Grab-World" operation.
  • Determine whether there is a mechanism to enable an X11 window always-on-top property for the FLTK control menu.

Non-immersive development issues

  • Can FLTK menus work without OPENGL enabled?
  • Running ./configure should report installation directories — since those are options we may want to change (otherwise one may not know where these can be configured).
  • Is there a command (if not, can one be added) that reports the configuration options of the compiled VMD?
  • "Lines" and "Points" representations don't seem to work when rendering from BigRedII to the desktop.
    • (I don't care about the BigRedII HPC system anymore, but this issue may also exist when using VNC, etc.)



HPC Usage of VMD

This section describes specific usage and compiling issues related the VMD on HPC systems such as the Indiana University BigRedII supercomputer.

Running VMD via command-driving interactions on BigRedII

Presently, the VMD installed on BigRedII can be used interactively via the TCL command language. Once running in an interactive shell, a molecule can be loaded and rendered with this simple commands:

  1. Load the vmd module:
    % module load vmd
  2. Start VMD:
    % vmd
  3. Load an example molecule:
    vmd > mol new <path>/brH.pdb
  4. Render the current "view" to an image file:
    vmd > render TachyonInternal <filename>.ppm
  5. Quit VMD
    vmd > quit

Then, perhaps in another shell, an image viewer program can be used to see the rendered text. [NOTE: this requires logging on from an X11-cabable desktop system and using the -X flag to ssh.]

  • Use the FEH image viewer:
    % module load imlib2 feh
    % feh --reload 1 <filename>.ppm
  • or use the Eye-of-Gnome viewer:
    % eog <filename>.ppm

Batch VMD on BigRedII