FME Evangelism Weekly Issue #6

Contents

1) Format Names

For FME2008 you may notice some changes in the names of formats, as we have implemented a set of guidelines to try and standardize format names, and prevent them having to be continually updated.

In general we have dropped version numbers from format names, because it only gets confusing as to what is supported, plus the names need to get changed when a new version comes out. Also we’ve avoided using the words “Database”, “File”, or “Raster” unless it is really part of the name.

Acronyms will not get expanded, unless they are rare enough to need explanation, and some format names will be in a non-English language where appropriate.

2) FME User Conference - Sneak Peek
Having spent all of yesterday eavesdropping on the marketing team, I can exclusively(!) reveal the latest inside information about the upcoming user conference.

The latest session to be added to the agenda is:

Do or Do Not: Master Yoda’s Guide to Avoiding the Dark Side of Raster
As the abstract says, “Powerful is FME; but complex are raster formats. Great are the differences between a raster band and palette. Join us to find out how to avoid the pitfalls faced by an apprentice raster master, and how to effectively translate data between raster formats.”

Also revealed are the titles of the hands-on workshops:

  • FME Server
  • Updating Spatial Databases with FME
  • Tips and Tricks to Make You an FME Superhero

Click these links for the current conference agenda and full list of presentations …and don’t forget that early bird registration ends in a week’s time.

3) New Format: Golden Software Surfer 6 Binary Grid
One truly new item this week is the addition of a reader and writer for the Surfer Binary Grid format, version 6. Apparently this is a format used in the petroleum and exploration industry.

Technical Info: The format stores a single band of floating point numerical (Real32) data, and has the ability to set a nodata value. Surfer 6 Binary Grid files also store some georeferencing information (minimum and maximum x, y, and z values). However, they do not support attribution or coordinate systems, except via external metadata files such as .TAB files.

The format is available in the latest FME2008 betas, and requires a Professional Edition license or higher. Support for version 7 and the version 7 ASCII variant will follow in FME2009.

4) SpikeRemover Example
The SpikeRemover transformer is a new item that….. well it removes spikes from your geometry.
Now we have a good example of that transformer on fmepedia, courtesy ofFME scenario specialist Dmitri Bagh.
http://www.fmepedia.com/index.php/SpikeRemover

Dmitri notes that: “If the geometry of a feature is a path, the transformer removes spikes between consecutive path segments as well. For a polygon or donut, if the start/end point is a spike, then it is also removed. The end result is still a polygon/donut. Any polygons, donuts, paths or lines that are part of a collection of geometry [ie aggregate] will also be processed.”

5) HTTP Authentication Function
All web-related formats and transformers such as WFS (left), WMS and the HTTPFetcher have recently been enhanced with the option to use HTTP Authentication. This means that users can now access data that is protected by a username and password.

Three types of authentication are supported: basic, digest and NTLM

6) FME for FDO
In the category of “nice FME use we wouldn’t have known about if the user didn’t write a blog” here are a couple of articles about the new FME for FDO application.

Firstly, user Sean Twomey used this tool to read a whole folder of MapInfo TAB files in a way that’s both “live and funky”. Thanks for the great review Sean. http://edgeofwedge.com/survey.php?p=46

Secondly, user Gwenael Bachelot also reads a folder of MapInfo TAB files (I spot a trend here), and helpfully points out that a full FME license would expose within the FDO all of the other FME supported formats. His article is in French, but with a handy button to translate to English. Thanks Gwenael.
http://geospatialfrance.typepad.com/geospatialfrance/2007/12/fournisseur-fdo.html

7) Jason Birch’s list of favourite FME Transformers!
In case you don’t read the user group postings, Jason Birch (Certified FME Professional, MVP and all round FME power user) recently listed his favourite transformers. I don’t remember why, but it’s an interesting read:

Best Transformer
TopologyBuilder - allows some amazing Q/A processes when combined with FeatureMergers SpatialRelator - relationships are the backbone of complex spatial analysis ExpressionEvaluator - swiss army knife of transformers
Best Supporting Transformer
StringSearcher - insanely powerful for pattern matching and fuzzy searching Tester - this simple but solid transformer, along with its close cousin AttributeFilter, is used in almost all of my workspaces Concatenator - used extensively to build “maptip” fields for web maps FeatureMerger - flip and fold features like there’s no tomorrow
Best Transformer Producer
Sampler - speeds up development, slashing production costs Visualiser - provides insight into production on a granular level SummaryReporter - while this is good for ongoing reporting, it can also help considerably during production
Best Transformer Category
List* - lists are my absolute favourite construct in FME Raster* - very, very handy when you need them
Coolest Transformer Not Used
TransporterSender/Receiver - these things are neat, but I don’t have the volume that would benefit from their use
Least Understood Transformer
SchemaMapper - I know this could be powerful, but have never taken the time to figure it out

Jason also says:
“Of course, a number of transformers and other components require special merit awards. This includes things like neo-readers and writers like KML, GeoRSS and GeoJSON, and neat things like PythonCaller (and its cousin TCLCaller), WebCharter, KMLStyler (wow, what a lifesaver this thing is), VirtualEarthTiler, and HTTP* transformers.
OK, forget the list. I just love all of FME :) “

Brief Notes

  • The Extruder transformer has been upgraded to extrude point features into a vertical line
  • The IFC Reader now has added styledItems support
  • The AutoCAD OD reader has a fix to handle the case when arcs are split on reading
  • The time taken to open large workspaces should be cut by a performance improvement in FME2008.
  • The RasterGeoreferencer transformer now prohibits the use of negative settings values

This week’s Weekly was written to the tune of…
Ian McNabb’s “Still Got the Fever”. The whole album this is from (Head Like a Rock) is full of great tracks like this.

This one isn’t on iTunes (other McNabb songs are), so here’s a YouTube link of a live version. http://www.youtube.com/watch?v=KjADocr31Go

January 18th, 2008

FME Evangelism Weekly Issue #2

1) StatisticsCalculator Transformer Group-By Option

New in FME this week is a group-by option for the StatisticsCalculator. This has been a big user request for a while now, and will let users calculate max, min, mean etc for groups of features, rather than an entire dataset.

There is a demo workspace for this which you can find on fmepedia at: http://www.fmepedia.com/index.php/StatisticsCalculator_Example

It’s just a small demo to find average annual toothpaste expenditure for each postal code in the fictional city of Interopolis.

This is the sort of thing that a census related customer like US Census or UK ONS might find of interest, as well as marketing companies interested in toothpaste; but there are many other instances where it comes in useful for example helping to create feature IDs by finding the max current value, or counting the number of items in feature groups.

User group comments:

“That _is_ cool.”

“Wow, that’s good news for all who are used to SELECT <aggregate_func> FROM … GROUP BY … in SQL”

2) FME Licensing on Linux

For the longest time we didn’t allow the use of floating licenses with Linux (I understand that was for business rather than technical reasons).

However, as of Build 5136 for Linux, FME on Linux can now use a FlexLM license - it can connect to a license server on Windows, Linux, etc, and a license server can be installed on Linux as well.

As Dan Ise said on the user group, “many of you have asked about this in the past, and now it’s here.”

The setup procedure should be the same as for a UNIX license, and the FlexLM packages can be found at ftp://ftp.safe.com/fme/floatingLicense/

3) FME and Python

A number of new Python items this week, some of which you may know about but they’re worth re-iterating.

Misc Python Fixes:

Python paths not logged multiple times (PR#10801)

Fixed python path update (PR#13862 PR#9773)

Fixed population of FME_MacroValues global object (PR#13798)

New Support:

As of build 5142 we now support Python 2.5

New Tutorial:

As you probably saw, Oliver Heimann - a user from Germany, earned himself several gold stars by creating a superb Python Tutorial for FME.

You can find Oliver’s Python Corner on fmepedia at: http://www.fmepedia.com/index.php/Oliver%27s_Python_Corner

It includes info on accessing attributes, using FME functions from within Python, startup and shutdown scripts plus much more.

NB: This is a great example of the sort of knowledge we’d like to be able to extract from our users - so if you are in touch with a customer doing cool stuff beg them to share their methods (on fmepedia or any other way)

4) Transit Ridership

On the subject of great user contributions, the user group had a new message this morning from Graeme Brown, a planning student from Halifax who acts as a consultant to Translink.

He has a great looking output of bus ridership in the Vancouver area - created using FME and the KML writer - that rivals Dmitri’s work in 3d displays.

The description of the workspace can be found on the user group at:

http://groups.google.com/group/fmetalk/browse_thread/thread/df6aec38810e7b15

If anyone in marketing or whatever wants to get in touch with Graeme his email address is: graeme.a.brown@gmail.com

User Group Comment: “That’s sweet… Are you going to be presenting this at the FME UC?”

5) Converting LIDAR to PDF

Having had to do this for a user I thought I’d share this example. The point is that the PDF writer is not only useful for 3d building models, a user can convert a point DEM to a TIN very easily, write it to PDF, and view it in 3D. If and when - as was talked about in yesterday’s lunch and learn - we can add textures to surfaces this would look even better!

6) CSGs

Speaking of the lunch-and-learn, if you didn’t see it you ought to know that we now (build 5137+) have a new factory and function that support CSG (Constructive Solid Geometry) boolean operations between solids. Also, as of build 5141 these CSGs are now supported by the PDF writer and the Geodatabase writer.

For a diagram that highlights this much better than I can explain see the fount of all knowledge, wikipedia…
http://en.wikipedia.org/wiki/Constructive_solid_geometry

FME User Group Comment:

“Ohhh. Does this mean that we can author Quake maps using FME?

I could see some real utility in being able to transform GIS data into online virtual worlds… :) ”

7) SQLExecutor Example

A new item on fmepedia this week is an SQLExecutor example workspace by Robyn.

It’s a good example of reading attribute data and attaching it to a set of existing spatial data - with the twist that it’s using the SQLExecutor rather than the Joiner - and how to use lists when the result of the query is more than a 1:1 relationship.

See: http://www.fmepedia.com/index.php/SQLExecutor_Example

8) Free FME FDO

A final item this week is more for support type dudes - the marketing folk know all about this, but I know some folk at this end of the office missed out on the announcement.

On November 27th Safe announced the release of a free FME FDO Provider for AutoCAD Map 3D 2008 which includes 9 formats.

The product was apparently demo’d at the Autodesk University in Las Vegas, and is available for download from http://www.safe.com/fmefdo

For more info I imagine Jaylene or Fil could help, or see the story at:

http://www.safe.com/company/news/2007/108/index.htm

Have feedback?

Email FME Evangelist, Mark Ireland at mark.ireland@safe.com.

December 7th, 2007


Feed

Add to Technorati Favorites

The FME Evangelist

Welcome! The FME Evangelist delivers insider news, cutting edge examples and the latest functional developments for Safe Software’s FME application.

Links

Archives

Categories

Tags