Introduction
Closer and closer we get to FME2008 and the User Conference…
Again, this is only half technical items, since development on 2008 is virtually complete.
Items of Interest
w/e 29th February 2008
1) FME User Conference
Just two weeks now until the FME worldwide user conference starts. Don’t miss out. As of this morning (20th Feb) 80% of the spaces are filled with users and resellers from 20 different countries.
There’s many technical sessions, a number of hands-on workshops, personal consultations with FME “doctors” and an evening event that should be very entertaining!
For more info and online registration visit www.safe.com/fmeuc2008
2) First New Certified Professionals
After pre-certifying a number of existing FME users, we now have two new certified professionals; the first to go through the certification process proper.
So congratulations to Guenther Reisinger from Ross Human Resources (a consultancy/systems integration company in Darwin, Australia) and to Eelco Berghuis, a consultant at ESRI Netherlands.
Both of these users went through a rigorous certification process involving submitting a number of projects and a set of customer references.
We received such glowing responses to the request for references, that I have to quote a couple of them:
“Mr Berghuis is one of the best technical consultants I have met in my 12 years of IT projects. He’s serious, knows his job, communicates well and gets the job done. My people always say “Eelco has said so…” meaning that the solution is good.”
“At all times Guenther has produced work of the highest level. In my opinion Guenther is the premier FME expert in the Northern Territory. He has been responsible for innovations in hard copy map production using FME that are amongst the best in Australia, and I believe relevant to the global FME community.”
Congratulations again to both of these new FME Professionals.
If you are interested in receiving the same certification then you can find more information on the Safe Software web site.
3) AttributeDereferencer Transformer
What do you get if you cross Don, Dale and a flight to Toronto? No joke - you get the AttributeDereferencer transformer.
This transformer - and I bet you have to read the explanation twice - copies the value of the attribute whose name is held in the source attribute to a newly created attribute.
For example:
Attribute A = B
Attribute B = 999
So, using the settings as shown (left), results in a new attribute called newAttr that contains the value 999.
This isn’t something you’ll use very often(!) - but it will save a lot of Tcl or FME function calling when you do.
4) CADRG Writing
FME2008 now has the ability to write CADRG (Compressed ARC Digitized Raster Graphics) format data.
This is a complicated format - I get the impression it’s the raster equivalent of writing GDF - and so the writer will develop and change over time as we get feedback from our users on improving ease-of-use.
It will also be an extra cost item - the same as the CADRG reader.
If you want more information on functionality and pricing then please contact Safe via info@safe.com or sales@safe.com
5) Search Envelopes and Coordinate Systems
A new ability for FME2008 is to enter reader search envelope parameters in a different coordinate system to the actual data itself; for example have data in an Albers coordinate system, but enter a search envelope in Lat/Long.
This ability is activated by a parameter called Search Envelope Coordinate System
This screenshot shows how the parameter can be found within the Navigator pane in a Workbench reader parameters. The source data is in Lat/Long, but the search envelope has been specified in meters using a UTM coordinate system.
When we run a workspace with this parameter, FME converts the search envelope into the same coordinate system as the source data, then creates a bounding box from that, as what started out as an envelope may no longer be rectangular after a reprojection. For this reason the output area may be slightly larger than specified.
A movie demonstrating this technique is available on the FME YouTube channel at:
http://www.youtube.com/watch?v=P_T0qY04Ffg
This function is available in FME2008 for any format that has a set of search envelope parameters, which is usually any database plus a number of other formats.
Incidentally this movie also demonstrates the search envelope for SQL Server spatial, which in itself is a new feature worthy of attention!
6) FME iDol Auditions
In advance of the User Conference, we held some FME Idol auditions. Let’s just say you won’t be seeing any of these folk in the contest itself!
I think Marketing person Erin has mistaken which contest this is!
Ken’s translation doesn’t go well:
Brief Notes
- The title of a workspace is now tied to the mapping file directive MAPPING_FILE_ID (build 5180+)
- The DGN writer is now capable of writing graphic cells in “relative” mode
- LandXML reader/writer now supports encoded attributes
Coming Soon: An FME2009 Special! All that’s new in the 2009 beta.
This week’s Weekly was written to the tune of…
Guitar Hero III pounding out from the company Nintendo.
Being the 30-something I am, I’ve never heard of most of the tracks - but I rock at playing Anarchy in the UK
February 29th, 2008
Introduction
Back after a little break… well I did say this would be weekly-ish.
Again this issue is more related to use of FME than new development, since we’re still in the final phases of the 08 release.
Contents
- Training Resources for FME 2008
- New Format: Oracle GeoRaster Reader
- RasterRotationApplier Transformer and @ApplyRasterRotation function
- Random Number Generation via a Web Service
- New Format: Directory and File Pathnames Reader
- FME Group on Facebook
- Data Cleanup and Validation
1) Training Resources for FME 2008
The training materials for FME 2008 are complete (phew!) and will be debuted at the FME User Conference training courses.
In order to achieve our two main aims - training as many users as possible, and providing value for certified trainers - for 2008 we have a number of different training packages aimed at different levels of skill and expertise.
- At the top of the pile are certified trainers. They receive the full set of materials including advanced modules, instructor notes and training certificates, plus receive other certification benefits such as exposure on our web site.
- One step down, users who have applied to our certification program receive more a set of detailed materials to help them bring their training skills up to a certifiable level.
- At the next level, resellers and educational establishments can download a set of basic materials for general educational use by non-certified trainers.
- At the lowest level, users are able to download a set of basic self-study materials as PDFs.
The Online Learning page of the Safe web site will connect you to all public training resources, including the FME Tutorial and the Self-Study materials (nb: the 2008 materials are still awaiting uploading), while the other specialist levels are available either on demand or through the reseller and certification portals.
2) New Format: Oracle GeoRaster Reader
The Oracle GeoRaster reader is a new format for FME2008.
This reader nicely complements the Oracle GeoRaster writer that already exists, since raster data can now be both imported and exported from an Oracle database using FME.
This is an entirely separate reader to the Oracle vector reader, but is documented within the same section of the Readers and Writers Manual.
The table pickers for our Oracle readers are able to tell between vector and raster tables, and will only show the table when it contains the relevant type of data.
The latest builds also include the ability to choose a specific pyramid to read.
The Oracle GeoRaster reader supports most of the numeric and color interpretation types on both bands and palettes supported by FME. It does not support some of Oracle’s more advanced types such as 128 bit Complex Numbers. A search envelope may also be applied to the reader to restrict data retrieval to an area of interest.
The reader supports SRS georeferencing, including rotation of raster features.
3) RasterRotationApplier Transformer and @ApplyRasterRotation function
These two items allow a user to apply a pre-defined raster rotation to a raster feature.
We (Safe) use this function in various places, and have exposed it so that users may also make use of it.
The reasoning behind this is slightly complex - even to a raster user - so here’s a brief outline.
A rotated raster feature - for example a feature from Oracle GeoRaster - is typically stored horizontally with an attribute that records the rotation.
When FME reads the data it keeps it in this structure until it needs to process the feature in a way where rotation would matter - for example clipping.
Sometimes you - the user - may wish to force immediate rotation of the raster in order to inspect or process the data in some way.
For example, the bounding box of a rotated raster may be greatly different to the bounding box of a raster with rotation value.
When you apply this value you can do so in a number of interpretations. As usual these include Nearest Neighbour, Bicubic, Biliniear, Average4 and Average16
Setting a nodata value for the raster is recommended since rotation usually results in areas that are outside of the main raster values.
Note that the value of the rotation is stored as a trait of the geometry when the data is read, is not accessible as a format attribute and bears no relation to fme_rotation
To set a value for this trait you can use the Rotator transformer.
4) Random Number Generation via a Web Service
For quite some time, many forward-looking FME users have suggested the future of spatial data translation and transformation lies in accessing web services. Perhaps the generation of random numbers was not quite what they had in mind, nonetheless it is a good example of a web service that FME can access to carry out a specific (and perhaps specialist) task.
Chief FME Inquisitor Dmitri Bagh has been experimenting with this particular web service and has some great examples.
See http://www.fmepedia.com/index.php/Using_Random.org_service for an index to his workspaces and transformers.
The key benefits of this service - over the in-built RandomNumberGenerator transformer - are:
True Randomness: Dmitri explains why generators such as are found in TCL are not truly random
Random Strings: Strings include characters as well as numbers, making this great for Alpha-Numeric IDs or random passwords
Unique Values: A set of guaranteed unique values is a useful tool for assigning non-duplicate IDs (or just picking lottery numbers)
Dmitri’s transformers can generate either a number of new features with random values, or assign random values to existing features.
The really clever part of his work is to get all of the required values with a single HTTP request; the reason being that 1 request for 1,000 random numbers is way quicker that 1,000 requests for a single number (2 seconds as opposed to 7 minutes)! It’s a very interesting case of FME Best Practice.
Kudos to: The folks at random.org for making such a great service available
5) New Format: Directory and File Pathnames Reader
An experienced FME user will recognize that a new feature in one part of FME - although important in that area - can often be used for many other purposes. Often the uses to which a new function is put are not something that we at Safe had even considered. I’ve a feeling that the Directory and File Pathnames format will turn out to be such a case.
This new format takes a specified folder and returns a list of all its sub-folders, files, or both.
A feature is output for each file/folder in the list, the attributes of which include path name, file name, file extension and type (directory or file).
The intended use of this is for some component of FME Server.
However, I’ve a strong feeling that some of our more experimental users will find different ways to use this; particularly in conjunction with the RasterReader or AttributeFileReader transformer. Maybe as a QA tool, custom logger or… who knows what?!
6) FME Group on Facebook
Any FME user who is a member of Facebook may be interested to know that there is a specific Facebook group set up by some of our FME users.
It looks like a great place to communicate with users on a more personal level, for example sharing photos of Safe related travels or activities.
The link to the group is: http://www.facebook.com/group.php?gid=8670341457
7) Data Cleanup and Validation
If you have browsed the Safe blog recently, you’ll have noticed an article by Pro Services head Mark Stoakes on using FME for data cleanup and quality assurance.
Outside of format translation, this must be one of the top uses of FME, so this is a very important subject.
The article - available here as a PDF - explains to what degree FME meets all of the different requirements of the IS19100 international quality standards, and highlights some example projects where the Pro Services department has produced custom solutions for various clients and data types.
For more information on data validation solutions and other services offered by Safe’s Professional Services team, please visit Safe’s website www.safe.com/services.
8) FME Artwork Example
This egg-box design was created by Dmitri as he experimented with some 3D surfaces.
Dmitri says: “I wanted to make an example of a TriangleStrip. I made a box, tiled it, replaced with points, assigned elevation as the product of a row and a column multiplied first by sin or cos, and built TIN. Now I wonder whether I can use CSGBuilder for making eggs :) I’ll let you know.
You can find the whole set of FME inspired art work on fmepedia at:
http://www.fmepedia.com/index.php/Category:FME_Art
Brief Notes
- Long format names continued to be tweaked to find a consistent naming structure - but should all be finished now
- A fix is implemented for the Concatenator transformer to prevent attributes being wrongly published when a custom transformer is duplicated
- There have been a couple of WMS fixes to make sure SRS and HTTP Proxies are all being used correctly
- Unicode handling for the S-57 reader has been implemented
- The Oracle Raster Writer now allows easier pyramid creation by using default values for settings the user has not specified
- A double-click on a Workbench published parameter now brings up a dialog to edit the value, rather than define the parameter. Right-Click > Edit will now bring up the parameter editing dialog. This is a change in behaviour that may catch a few users by surprise.
This week’s Weekly was written to the tune (if you can call it that) of…
Florence Foster Jenkins singing the Queen of the Night aria from Mozart’s Magic Flute.
This YouTube excerpt is only 3′ 43″ long - but it will take a strong pair of ears to survive to the end.
February 4th, 2008
RSS 2.0