[osg-users] vpb on cluster example

Greg Myers aftacer at gmail.com
Thu Jul 31 10:05:23 PDT 2008

```Hey Jason,

Oh okay, now I understand.  Thanks.

When I came into work this morning my terrain database was done and
waiting.  I used osgviewer to check it out and WOW!!
I'm totally amazed at the results and just how simple it was to create
them.  AMAZING TOOLS!!

Now I'm off to the next step.  Drawing different models here and there
on the world to get the hang of things.  This is fun!!

Thanks again
Greg

On Jul 31, 7:01 am, "Jason Beverage" <jasonbever... at gmail.com> wrote:
> Hi Greg,
>
> When you create overviews for a file, it is creating reduced resolution
> versions of the imagery.  When osgTerrain is building the paged database, it
> is using GDAL under the hood to extract different levels of detail of the
> imagery and terrain.  By having overviews built, all of the calls into GDAL
> should be MUCH faster as it can utilize the overviews that were built
> instead of trying to downsample on the fly.
>
> To get all the tools you need to do the job, get FWTools athttp://fwtools.maptools.org/.  Documentation for all of the GDAL utilities
> can be found at:  http://www.gdal.org/gdal_utilities.html
>
> GDAL and OpenSceneGraph are really an amazing combination!
>
> Good luck,
>
> Jason
>
> On Wed, Jul 30, 2008 at 11:49 PM, Greg Myers <afta... at gmail.com> wrote:
> > Jason,
>
> > Thanks for the vpbmaster tip.  I thought it only applied to multiple
> > systems... I guess I need to read things a little better ;)  My
> > database creation times went down dramatically now that all 8 cores
> > are being utilized.  I went ahead and launched a build with a decent
> > amount of imagery and DTED data before I left work.  Hopefully my hard
> > drive doesn't fill up before it gets done.  I'm having another hard
> > drive installed tomorrow so that I can run a bigger set of data over
> > the weekend.
>
> > I haven't tried creating the overviews yet.  How do they help increase
> > speed?  If the explanation is more of a class than a simple response
> > then don't worry about responding, I understand ;)
>
> > Thanks for all your help!
> > Greg
>
> > On Jul 30, 11:46 am, "Jason Beverage" <jasonbever... at gmail.com> wrote:
> > > Hi again Greg,
>
> > > Forgot to mention this previously...
>
> > > You should also try building overviews for all of your geospatial data
> > files
> > > using the gdal utility gdaladdo if they don't already have them.  Doing
> > so
> > > can result in pretty dramatic increases in speed.
>
> > > Jason
>
> > > On Wed, Jul 30, 2008 at 2:44 PM, Jason Beverage <jasonbever... at gmail.com
> > >wrote:
>
> > > > Hi Greg,
>
> > > > I don't believe it is currently possible to modify a database with new
> > > > imagery or terrain once a database is created.  That is something that
> > I
> > > > know Robert was planning on working out at some point for
> > osgTerrain/VPB but
> > > > I'm not sure what its status is.  Using the --terrain option should
> > make
> > > > things run pretty quick though depending on how much data you're
> > throwing at
> > > > it.  Also, try replacing the osgdem command line with vpbmaster as it
> > > > supports multiple cores and thankfully takes the exact same command
> > line
> > > > optoins as osgdem.
>
> > > > Good luck!
>
> > > > Jason
>
> > > > On Wed, Jul 30, 2008 at 2:10 PM, Greg Myers <afta... at gmail.com> wrote:
>
> > > >> Hey Jason,
>
> > > >> Thanks for the reply.  I guess I'm going to have to bite the bullet
> > > >> and try that out.  It just takes a substantial amount of time so I
> > > >> hate to do it without knowing if I'm doing it right in the first
> > > >> place.  Tell me this though, is it possible to add new images to an
> > > >> existing ive file?  For instance, if I ran osgdem against just some
> > > >> plain old DTED data without images and output the results to dted.ive,
> > > >> could I then run another osgdem command and pass in image data using
> > > >> the same dted.ive file?  Would it just add in the images to the
> > > >> terrain or would it start fresh and blow away my existing terrain?
>
> > > >> Thanks
> > > >> Greg
>
> > > >> On Jul 30, 10:43 am, "Jason Beverage" <jasonbever... at gmail.com>
> > wrote:
> > > >> > Hi Greg,
>
> > > >> > I would just remove the -l command line and let vpb run as long as
> > it
> > > >> needs
> > > >> > to.  Depending on the level of your data, it might need to go higher
> > > >> than
> > > >> > level 10.
>
> > > >> > Thanks,
>
> > > >> > Jason
>
> > > >> > On Wed, Jul 30, 2008 at 1:33 PM, Greg Myers <afta... at gmail.com>
> > wrote:
> > > >> > > Hey JP,
>
> > > >> > > First of all I want you to know that I really appreciate your
> > help. :)
>
> > > >> > > I tried the BMNG image that covers my area of interest and that
> > worked
> > > >> > > like a charm.  No more black areas.
>
> > > >> > > Now, I only ran the data using a level setting of 10.  When I zoom
> > in
> > > >> > > on the high res image that I provided, it is not high res at all.
> > > >> > > Does the level setting need to be cranked way up in order to be
> > able
> > > >> > > to see the details in the high res image?  Do I need to specify
> > layer
> > > >> > > options for my high res image like you did in your example?
>
> > > >> > > And one more question, what is the purpose of the archive file
> > output
> > > >> > > type ( the -a option ) ?
>
> > > >> > > Thanks
> > > >> > > Greg
>
> > > >> > > On Jul 30, 3:33 am, "J.P. Delport" <jpdelp... at csir.co.za> wrote:
> > > >> > > > Hi,
>
> > > >> > > > sorry, I can only guess at potential problems...
>
> > > >> > > > I am assuming you are viewing the data with osgviewer so that I
> > can
> > > >> > > > discard other cases where blending might not be set up
> > correctly.
>
> > > >> > > > The black portions normally indicate that something is up with
> > the
> > > >> > > > blending of data. E.g. sometimes the geotiffs have transparent
> > areas
> > > >> > > > that have to be blended with other tiles. This occurs e.g. when
> > the
> > > >> > > > tiles are not square. Since the dted data has no colour data,
> > I'm
> > > >> not
> > > >> > > > sure what the image data will blend with.
>
> > > >> > > > What I would try is to use one of the BMNG tiles as a backdrop.
> > See
> > > >> on
> > > >> > > > the wiki for a link. The BMNG tile covers a wide area and would
> > be
> > > >> used
> > > >> > > > for places in the terrain where you do not supply your own
> > higher
> > > >> res
> > > >> > > > image data.
>
> > > >> > > > jp
>
> > > >> > > > GregMyerswrote:
> > > >> > > > > I have another question for you JP.  I have been playing with
> > the
> > > >> > > osgdem
> > > >> > > > > tool and trying to create a terrain database with some aerial
> > > >> photos (
> > > >> > > > > geotiffs ).  After my database is generated using the command:
>
> > > >> > > > > Osgdem --geocentric --terrain -d DTED -t image.tif -l 4 -o
> > > >> > > test\test.ive
>
> > > >> > > > > I get something that looks about right except that the terrain
> > > >> around
> > > >> > > the
> > > >> > > > > image is blacked out.  More area is blacked out when I'm
> > viewing
> > > >> the
> > > >> > > higher
> > > >> > > > > layers.  I'm attaching a small image so that you can see what
> > I'm
> > > >> > > talking
> > > >> > > > > about.  If you look near the top left corner of the black area
> > you
> > > >> can
> > > >> > > > > barely make out my tiny little geotiff image.  When I zoom out
> > the
> > > >> > > black
> > > >> > > > > area becomes larger.  When I zoom in it becomes smaller but
> > never
> > > >> goes
> > > >> > > > > completely away.  It seems that whichever tile ( I think
> > that's
> > > >> the
> > > >> > > right
> > > >> > > > > term ) the image is located in is blacked out everywhere
> > except
> > > >> where
> > > >> > > the
> > > >> > > > > image is.  Is it not possible to use images that only cover a
> > > >> portion
> > > >> > > of
> > > >> > > > > your terrain or am I just missing some command line arguments
> > or
> > > >> > > something?
>
> > > >> > > > > Thanks
> > > >> > > > > Greg
>
> > > >> > > > > -----Original Message-----
> > > >> > > > > From: osg-users-boun... at lists.openscenegraph.org
> > > >> > > > > [mailto:osg-users-boun... at lists.openscenegraph.org] On Behalf
> > Of
> > > >> J.P.
> > > >> > > > > Delport
> > > >> > > > > Sent: Monday, July 28, 2008 11:49 PM
> > > >> > > > > To: OpenSceneGraph Users
> > > >> > > > > Subject: Re: [osg-users] vpb on cluster example
>
> > > >> > > > > Hi,
>
> > > >> > > > > GregMyerswrote:
> > > >> > > > >> Hi JP,
>
> > > >> > > > >> I'm new and I'm a little fuzzy on the versioning between VPB
> > and
> > > >> OSG.
> > > >> > > > >> It looks like for the example you have provided, we need an
> > older
> > > >> > > > >> version (2.3.6) of OSG.  Do you know if there are plans to
> > > >> upgrade VPB
> > > >> > > > >> to work with the latest releases of OSG or am I totally
> > missing
> > > >> > > > >> something?
>
> > > >> > > > >> Thanks for any info.
> > > >> > > > >> Greg
>
> > > >> > > > > sorry, I should have made the versions I used more explicit.
> > For
> > > >> the
> > > >> > > > > example I used OSG and VPB from svn around June.
>
> > > >> > > > > osgversion says 2.5.1.
>
> > > >> > > > > svn info gives:
> > > >> > > > > Revision: 8413 for OSG
> > > >> > > > > and
> > > >> > > > > Revision: 914 for VPB
>
> > > >> > > > > I'll add the info to the example page.
>
> > > >> > > > > regards
> > > >> > > > > jp
>
> > ------------------------------------------------------------------------
>
> > ------------------------------------------------------------------------
>
> > > >> > > > > _______________________________________________
> > > >> > > > > osg-users mailing list
> > > >> > > > > osg-us... at lists.openscenegraph.org
>
> > > >>http://lists.openscenegraph.org/listinfo.cgi/osg-users-openscenegraph.
> > > >> > > ..
>
> > > >> > > > --
> > > >> > > > This message is subject to the CSIR's copyright terms and
> > > >> conditions,
> > > >> > > e-mail legal notice, and implemented Open Document Format (ODF)
> > > >> standard.
> > > >> > > > The full disclaimer details can be found athttp://
> > > >> > >www.csir.co.za/disclaimer.html.
>
> > > >> > > > This message has been scanned for viruses and dangerous content
> > by
> > > >> > > MailScanner,
> > > >> > > > and is believed to be clean.  MailScanner thanks Transtec
> > Computers
> > > >> for
> > > >> > > their support.
>
> > > >> > > > _______________________________________________
> > > >> > > > osg-users mailing list
> > > >> > > > osg-us... at lists.openscenegraph.orghttp://
> > > >> > > lists.openscenegraph.org/listinfo.cgi/osg-users-openscenegraph...
> > > >> > > _______________________________________________
> > > >> > > osg-users mailing list
> > > >> > > osg-us... at lists.openscenegraph.org
>
> ...
>