Immersive Visualization / IQ-Station Wiki
This site hosts information on virtual reality systems that are geared toward scientific visualization, and as such often toward VR on Linux-based systems. Thus, pages here cover various software (and sometimes hardware) technologies that enable virtual reality operation on Linux.
The original IQ-station effort was to create low-cost (for the time) VR systems making use of 3DTV displays to produce CAVE/Fishtank-style VR displays. That effort pre-dated the rise of the consumer HMD VR systems, however, the realm of midrange-cost large-fishtank systems is still important, and has transitioned from 3DTV-based systems to short-throw projectors.
Difference between revisions of "VMD"
m (Added a couple non-immersive development issues) |
(Updated for VMD version 1.9.4a57) |
||
Line 2: | Line 2: | ||
'''Visual Molecular Dynamics (VMD)''' | '''Visual Molecular Dynamics (VMD)''' | ||
[http://www.ks.uiuc.edu/Research/vmd | [http://www.ks.uiuc.edu/Research/vmd VMD] is a good visualization tool for visualizing large molecular systems (typically used for large biomolecular systems). VMD has a long history of being interfaced to immersive technologies, including haptic devices and CAVE VR displays. There is also a section on the usage of VMD for HPC systems. | ||
=Immersive Mode VMD= | =Immersive Mode VMD= | ||
Line 12: | Line 12: | ||
If VMD with the FreeVR interface is installed and properly configured, follow these steps to run in immersive mode: | If VMD with the FreeVR interface is installed and properly configured, follow these steps to run in immersive mode: | ||
#<CODE>% vmd -dispdev freevrforms | #<CODE>% module load freevr vmd</CODE> | ||
#<CODE>% vmd -dispdev freevrforms <path>/proteins/brH.pdb</CODE> | |||
#*This alone should be sufficient to render the molecule in the VR system, with joystick-controlled travel | |||
# In order to grab and move an object, the <CODE>grab</CODE> tool must be initialized: | # In order to grab and move an object, the <CODE>grab</CODE> tool must be initialized: | ||
#:# →<CODE>Graphics</CODE> →<CODE>Tools</CODE> | #:# →<CODE>Graphics</CODE> →<CODE>Tools</CODE> | ||
Line 28: | Line 30: | ||
# Install missing dependencies | # Install missing dependencies | ||
#: Commonly needed packages include: | #: Commonly needed packages include: | ||
#:* tcl-devel (8. | #:* tcl-devel (8.5 -- 8.6 works with edits to <CODE>Makefile</CODE>) | ||
#:* tk-devel (8. | #:* tk-devel (8.5 -- 8.6 works with edits to <CODE>Makefile</CODE>) | ||
#:* fltk-devel | #:* fltk-devel | ||
#:* netcdf-devel | #:* netcdf-devel | ||
#: | #: | ||
# Download the latest source (version 1.9. | # Download the latest source (version 1.9.4a57 as of this writing [12/21/23]) | ||
#:: [http://www.ks.uiuc.edu/Development/Download/download.cgi?PackageName=VMD http://www.ks.uiuc.edu/Development/Download/download.cgi?PackageName=VMD] | #:: [http://www.ks.uiuc.edu/Development/Download/download.cgi?PackageName=VMD http://www.ks.uiuc.edu/Development/Download/download.cgi?PackageName=VMD] | ||
#: NOTE: there is a (free) registration process required | #: NOTE: there is a (free) registration process required | ||
#: NOTE: the pre-built packages may not contain the Immersive features | #: NOTE: the pre-built packages may not contain the Immersive features | ||
# Untar the source ball | # Untar the source ball | ||
#: E.g. <CODE>% tar -zxf vmd- | #: E.g. <CODE>% tar -zxf vmd-<version>.src.tar.gz</CODE> | ||
#::(As of this writing [12/21/23] <CODE><version></CODE> is <CODE>1.9.4a57</CODE>) | |||
# Compile the plugins | # Compile the plugins | ||
#: <CODE>% export PLUGINDIR=`pwd`/vmd-<version>/plugins</CODE> | |||
#: <CODE>% cd plugins</CODE> | #: <CODE>% cd plugins</CODE> | ||
#: <CODE>% make <architecture></CODE> — E.g. LINUXAMD64 | #: <CODE>% make <architecture></CODE> — E.g. LINUXAMD64 | ||
#: <CODE>% make distrib</CODE> | #: <CODE>% make distrib</CODE> | ||
# Configure VMD | # Configure VMD | ||
Line 50: | Line 53: | ||
#::A sample list is: | #::A sample list is: | ||
#::* <CODE>LINUXAMD64 OPENGL FREEVR FLTK TK TCL PTHREADS</CODE> | #::* <CODE>LINUXAMD64 OPENGL FREEVR FLTK TK TCL PTHREADS</CODE> | ||
#::An expanded list is: | |||
#::* <CODE>LINUXAMD64 OPENGL OPENGLPBUFFER FREEVR FLTK TK CXX11 XINERAMA XINPUT LIBPNG ZLIB VRPN NETCDF TCL PTHREADS SILENT</CODE> | |||
#::(I don't necessarily know what all those do and whether they help or not) | |||
#::(As of this writing [12/21/23] I was unable to get the <CODE>CUDA</CODE>, <CODE>Optix</CODE> or <CODE>Python</CODE> options to work. | |||
#: <CODE>% $EDITOR configure</CODE> | |||
#:: CHANGE: <CODE>install_bin_dir=<installation-path>/bin</CODE> | |||
#:: CHANGE: <CODE>install_library_dir=<installation-path>/lib/$install_name</CODE> | |||
#: <CODE>% ./configure</CODE> | #: <CODE>% ./configure</CODE> | ||
# Compile VMD | # Compile VMD | ||
#: <CODE>% cd <path>/vmd-<version></CODE> | |||
#: <CODE>% export PLUGINDIR=`pwd`/plugins</CODE> — only if you're in a different shell from where this happened in step 4 | #: <CODE>% export PLUGINDIR=`pwd`/plugins</CODE> — only if you're in a different shell from where this happened in step 4 | ||
#: <CODE>% cd src</CODE> | #: <CODE>% cd src</CODE> | ||
#: <CODE>% $EDITOR Makefile</CODE> | #: <CODE>% $EDITOR Makefile</CODE> | ||
#:: | #:: CHANGE: edit the values for <CODE>INCDIRS</CODE> and <CODE>LIBDIRS</CODE> to point to the correct directory for the '''FreeVR''' includes and library. | ||
#::* (UNLESS: you've configured <CODE>$CPATH</CODE> and <CODE>$LPATH</CODE>, perhaps through the "modules" system.) | |||
#:: CHANGE: edit <CODE>{{Con|tcl8.5}}</CODE> and <CODE>{{Con|tk8.5}}</CODE> to be <CODE>tcl8.6</CODE> and <CODE>tk8.6</CODE> respectively if that's the version of Tcl/Tk installed on your system | |||
#::* NOTE: Ideally the VMD build system would just specify <CODE>tcl8</CODE> and <CODE>tk8</CODE>. | |||
#: <CODE>* make veryclean</CODE> | #: <CODE>* make veryclean</CODE> | ||
#: <CODE>% make -j 8</CODE> | #: <CODE>% make -j 8</CODE> | ||
#::NOTE: you will get | #::NOTE: you will get a handful compiler warnings. As long as they are only warnings, you should be fine. | ||
# Install VMD | # Install VMD | ||
#: <CODE>% sudo make install</CODE> | #: <CODE>% sudo make install</CODE> | ||
Line 76: | Line 90: | ||
The format of this file is described in the [http://www.ks.uiuc.edu/Research/vmd/vmd-1.9.1/ug/node49.html VMD User's Guide: Tool Window] documentation. | The format of this file is described in the [http://www.ks.uiuc.edu/Research/vmd/vmd-1.9.1/ug/node49.html VMD User's Guide: Tool Window] documentation. | ||
* Create a <CODE>.vmdsensors</CODE> file: | * Create a <CODE>.vmdsensors</CODE> file in your <CODE>$HOME</CODE> directory or the local directory: | ||
*: Here is a sample <CODE>.vmdsensors</CODE> file for use with FreeVR: | *: Here is a sample <CODE>.vmdsensors</CODE> file for use with FreeVR: | ||
<BLOCKQUOTE> | <BLOCKQUOTE> | ||
Line 87: | Line 101: | ||
offset 0.9 -4.0 -1.0 | offset 0.9 -4.0 -1.0 | ||
device freevrbuttons freevrbuttons://local/freevr:0,1,2,3 | device freevrbuttons freevrbuttons://local/freevr:0,1,2,3 | ||
## if you have more than one wand | ## uncomment the following if you have more than one wand: | ||
#device vrtracker2 freevrtracker://local/freevr:1 | #device vrtracker2 freevrtracker://local/freevr:1 | ||
#scale 1.0 | #scale 1.0 | ||
Line 98: | Line 112: | ||
* To change the overall world transformation via the Tcl command shell, try these options: | * To change the overall world transformation via the Tcl command shell, try these options: | ||
** <CODE>scale to .5</CODE> | ** <CODE>vmd > '''scale to .5'''</CODE> | ||
** <CODE>translate to 0 0 -3</CODE> | ** <CODE>vmd > '''translate to 0 0 -3'''</CODE> | ||
* To place the FLTK menu interface on a screen separate from the immersive displays, use the <CODE>DISPLAY</CODE> environment variable. | * To place the FLTK menu interface on a screen separate from the immersive displays, use the <CODE>DISPLAY</CODE> environment variable prior to running the <CODE>vmd</CODE> command. | ||
==Usage Issues== | ==Usage Issues== | ||
[NOTE: these issues are from tests with VMD version 1.9.2a15.] | [NOTE: these issues are from tests with VMD version 1.9.2a15. (And need to be re-tested with version 1.9.4a57)] | ||
* I still need to figure out the proper scale and offset (this would/will be easier if we can avoid the use of Euler angles in <CODE>P_GrabTool.C</CODE>). | * I still need to figure out the proper scale and offset (this would/will be easier if we can avoid the use of Euler angles in <CODE>P_GrabTool.C</CODE>). | ||
Line 118: | Line 132: | ||
* Changes in representations seem to only have an effect on a single screen. | * Changes in representations seem to only have an effect on a single screen. | ||
==Build Issues== | |||
* VMD should compile with Tcl/Tk 8.6 (as mentioned above), probably better to just use the major version number | |||
* The CUDA option did not compile for me as it's hard-coded to Cuda version 10.2, and I have version 12.3. | |||
* Some of the plugins report as being broken when starting VMD -- but some of them work, so it's not a matter of improperly building/installing the "plugins". | |||
==Development Issues== | ==Development Issues== | ||
Line 129: | Line 147: | ||
===Non-immersive development issues=== | ===Non-immersive development issues=== | ||
* Can FLTK menus work without OPENGL enabled? | * Can FLTK menus work without OPENGL enabled? | ||
* Running <CODE>./configure</CODE> should report installation directories — since those are options we may want to change (otherwise one may not know where these can be configured) | * Running <CODE>./configure</CODE> should report installation directories — since those are options we may want to change (otherwise one may not know where these can be configured). | ||
* Is there a command (if not, can one be added) that reports the configuration options of the compiled VMD? | * Is there a command (if not, can one be added) that reports the configuration options of the compiled VMD? | ||
* "Lines" and "Points" representations don't seem to work when rendering from BigRedII to the desktop. | * <S>"Lines" and "Points" representations don't seem to work when rendering from BigRedII to the desktop.</S> | ||
** (I don't care about the BigRedII HPC system anymore, but this issue may also exist when using VNC, etc.) | |||
Revision as of 19:03, 21 December 2023
Visual Molecular Dynamics (VMD)
VMD is a good visualization tool for visualizing large molecular systems (typically used for large biomolecular systems). VMD has a long history of being interfaced to immersive technologies, including haptic devices and CAVE VR displays. There is also a section on the usage of VMD for HPC systems.
Immersive Mode VMD
Information specific to the usage and setup of VMD for immserive systems such as the CAVE virtual reality display.
How to Run VMD in Immersive Mode
If VMD with the FreeVR interface is installed and properly configured, follow these steps to run in immersive mode:
% module load freevr vmd
% vmd -dispdev freevrforms <path>/proteins/brH.pdb
- This alone should be sufficient to render the molecule in the VR system, with joystick-controlled travel
- In order to grab and move an object, the
grab
tool must be initialized:- →
Graphics
→Tools
- →
Create
agrab
style tool - set
Position
toFreeVRTracker
- set
Buttons
toFreeVRButtons
- The wand avatar will now appear in the scene
- →
- Now touch an object with the wand avatar and press
Button-1
to move it.
How to Build VMD w/ Immersive features
This section specifically instructs on how to compile VMD using the FreeVR immersive interface library.
- Install missing dependencies
- Commonly needed packages include:
- tcl-devel (8.5 -- 8.6 works with edits to
Makefile
) - tk-devel (8.5 -- 8.6 works with edits to
Makefile
) - fltk-devel
- netcdf-devel
- tcl-devel (8.5 -- 8.6 works with edits to
- Commonly needed packages include:
- Download the latest source (version 1.9.4a57 as of this writing [12/21/23])
- NOTE: there is a (free) registration process required
- NOTE: the pre-built packages may not contain the Immersive features
- Untar the source ball
- E.g.
% tar -zxf vmd-<version>.src.tar.gz
- (As of this writing [12/21/23]
<version>
is1.9.4a57
)
- (As of this writing [12/21/23]
- E.g.
- Compile the plugins
% export PLUGINDIR=`pwd`/vmd-<version>/plugins
% cd plugins
% make <architecture>
— E.g. LINUXAMD64% make distrib
- Configure VMD
% cd ../vmd-<version>
% $EDITOR configure.options
- Enter a list of desired options -- make sure to include
FREEVR
- A sample list is:
LINUXAMD64 OPENGL FREEVR FLTK TK TCL PTHREADS
- An expanded list is:
LINUXAMD64 OPENGL OPENGLPBUFFER FREEVR FLTK TK CXX11 XINERAMA XINPUT LIBPNG ZLIB VRPN NETCDF TCL PTHREADS SILENT
- (I don't necessarily know what all those do and whether they help or not)
- (As of this writing [12/21/23] I was unable to get the
CUDA
,Optix
orPython
options to work.
- Enter a list of desired options -- make sure to include
% $EDITOR configure
- CHANGE:
install_bin_dir=<installation-path>/bin
- CHANGE:
install_library_dir=<installation-path>/lib/$install_name
- CHANGE:
% ./configure
- Compile VMD
% cd <path>/vmd-<version>
% export PLUGINDIR=`pwd`/plugins
— only if you're in a different shell from where this happened in step 4% cd src
% $EDITOR Makefile
- CHANGE: edit the values for
INCDIRS
andLIBDIRS
to point to the correct directory for the FreeVR includes and library.- (UNLESS: you've configured
$CPATH
and$LPATH
, perhaps through the "modules" system.)
- (UNLESS: you've configured
- CHANGE: edit
tcl8.5
andtk8.5
to betcl8.6
andtk8.6
respectively if that's the version of Tcl/Tk installed on your system- NOTE: Ideally the VMD build system would just specify
tcl8
andtk8
.
- NOTE: Ideally the VMD build system would just specify
- CHANGE: edit the values for
* make veryclean
% make -j 8
- NOTE: you will get a handful compiler warnings. As long as they are only warnings, you should be fine.
- Install VMD
% sudo make install
At this point you can now run VMD in standard desktop mode.
- For example:
% vmd ../proteins/brH.pdb
How to Configure VMD for Immersive displays
There are two stages of configuration required for the overall configuration of VMD for immersive displays. The first step is to configure FreeVR for the specific hardware setup of the immersive facility. This is explained in the FreeVR documentation. The second stage is to link the FreeVR inputs to VMD "sensors devices".
VMD "sensor devices" are specified in the .vmdsensors
file.
The format of this file is described in the VMD User's Guide: Tool Window documentation.
- Create a
.vmdsensors
file in your$HOME
directory or the local directory:- Here is a sample
.vmdsensors
file for use with FreeVR:
- Here is a sample
### ### Configuration for the FreeVR trackers ### device freevrtracker freevrtracker://local/freevr scale 0.5 offset 0.9 -4.0 -1.0 device freevrbuttons freevrbuttons://local/freevr:0,1,2,3 ## uncomment the following if you have more than one wand: #device vrtracker2 freevrtracker://local/freevr:1 #scale 1.0 #offset 0.9 -4.0 -1.0
General Usage
Usage Tidbits
- To change the overall world transformation via the Tcl command shell, try these options:
vmd > scale to .5
vmd > translate to 0 0 -3
- To place the FLTK menu interface on a screen separate from the immersive displays, use the
DISPLAY
environment variable prior to running thevmd
command.
Usage Issues
[NOTE: these issues are from tests with VMD version 1.9.2a15. (And need to be re-tested with version 1.9.4a57)]
- I still need to figure out the proper scale and offset (this would/will be easier if we can avoid the use of Euler angles in
P_GrabTool.C
). - The
grab
tool only grabs one molecule object at a time, so multiple molecules won't stay together. - The
grab
tool requires that the wand avatar be touching an object before it can be moved. - The
rotate
tool does not work - I don't know how to use the
joystick
tool — does it work with the VR interfaces? - I need to learn whether (and if so what) the command-line and/or tcl-shell options for setting up the graphics tools w/o the need for the interactive menu.
- There are gimble lock issues when the wand points up or down.
- The material colors of some/all of the objects in the scene are not always present.
- Changes in representations seem to only have an effect on a single screen.
Build Issues
- VMD should compile with Tcl/Tk 8.6 (as mentioned above), probably better to just use the major version number
- The CUDA option did not compile for me as it's hard-coded to Cuda version 10.2, and I have version 12.3.
- Some of the plugins report as being broken when starting VMD -- but some of them work, so it's not a matter of improperly building/installing the "plugins".
Development Issues
This section is for issues that are of interest to those working directly on the VMD code-base as it relates to immersive interfaces.
- DONE: Need to figure out how to pass
RenderInfo *
argument toFreeVRScene::draw()
in order to add the navigation controls to where the virtual world is rendered. - Need to go over the source code in
P_GrabTool.C
so that I can know how to improve it (and I'll add comments as we go.) My goal is to avoid the use of Euler angles, since there are gimble lock issues in the interface. - Consider adding a
grab-world
tool that allows the entire world to be grabbed with the wand. An alternative was done — an always active "Grab-World" operation. - Determine whether there is a mechanism to enable an X11 window always-on-top property for the FLTK control menu.
Non-immersive development issues
- Can FLTK menus work without OPENGL enabled?
- Running
./configure
should report installation directories — since those are options we may want to change (otherwise one may not know where these can be configured). - Is there a command (if not, can one be added) that reports the configuration options of the compiled VMD?
"Lines" and "Points" representations don't seem to work when rendering from BigRedII to the desktop.- (I don't care about the BigRedII HPC system anymore, but this issue may also exist when using VNC, etc.)
HPC Usage of VMD
This section describes specific usage and compiling issues related the VMD on HPC systems such as the Indiana University BigRedII supercomputer.
Running VMD via command-driving interactions on BigRedII
Presently, the VMD installed on BigRedII can be used interactively via the TCL command language. Once running in an interactive shell, a molecule can be loaded and rendered with this simple commands:
- Load the
vmd
module:% module load vmd
- Start VMD:
% vmd
- Load an example molecule:
vmd > mol new <path>/brH.pdb
- Render the current "view" to an image file:
vmd > render TachyonInternal <filename>.ppm
- Quit VMD
vmd > quit
Then, perhaps in another shell, an image viewer program can be used to see the rendered text.
[NOTE: this requires logging on from an X11-cabable desktop system and using the -X
flag to ssh
.]
- Use the FEH image viewer:
% module load imlib2 feh
% feh --reload 1 <filename>.ppm
- or use the Eye-of-Gnome viewer:
% eog <filename>.ppm