Jump to content

 
Photo

Clutter classes statistics

- - - - -

  • Please log in to reply
24 replies to this topic

#1
SerbanR

SerbanR

    Contributor

  • Validated Member
  • PipPip
  • 15 posts
  • Gender:Male
  • Location:Timisoara
  • Romania

Dear all

I have a vector file (MapInfo TAB format, 10000+ polygons) containing administrative divisions in France.
I also have a raster file (GRC = Vertical Mapper Classified Grid format) containing population classes (see attached picture).
The GRC file has a pixel size of 25 meters and each pixel contains a string value meaning the type of population located in that area (Dense Urban, Rural, etc)
What I need to do is to get for each of the 10000+ administrative divisions, the clutter statics like this:

Name Surface (km²) Percentage
BUILDING 0.0581 0
BLOCK BUILDING 1.3262 0.2
DENSE COLLECTIVE 6.025 0.8
MEAN COLLECTIVE 100.7175 13.5
VILLAGE 28.3581 3.8
DENSE INDIVIDUAL 0 0
MEAN INDIVIDUAL 95.9812 12.8
SCATTERED URBAN 1.7119 0.2
INDUSTRIAL 52.4487 7
FOREST 113.09 15.1
PARK 6.7544 0.9
SEA 0 0
INLAND WATER 16.185 2.2
OPEN 320.7038 42.8
OPEN IN URBAN 5.3425 0.7

I am working primarily with MapInfo 8.x/Vertical Mapper, but I also have Manifold 7.x and FME installed.
Thank you
Serban

Attached Files



#2
Hans van der Maarel

Hans van der Maarel

    CartoTalk Editor-in-Chief

  • Admin
  • PipPipPipPipPipPipPip
  • 3,868 posts
  • Gender:Male
  • Location:The Netherlands
  • Interests:Cartography, GIS, history, popular science, music.
  • Netherlands

Almost sounding like a broken record here, but FME can probabely do this. I'd like to give this a try, if you can send me a small sample of your data.
Hans van der Maarel - Cartotalk Editor
Red Geographics
Email: hans@redgeographics.com / Twitter: @redgeographics

#3
Unit Seven

Unit Seven

    Legendary Contributor

  • Moderator
  • PipPipPipPipPip
  • 266 posts
  • Gender:Male
  • Location:New Zealand
  • New Zealand

Hans when are they planning the go-get-me-coffee transformer for fme?

:rolleyes:

Seriously tho great robust program for the small bits of processing I've used it for—has been a god send for working between Microstation and Arc.
S a m B r o w n

U N I T S E V E N
unit.seven@gmail.com

Miramar, Wellington
N E W Z E A L A N D

#4
frax

frax

    Hall of Fame

  • Associate Admin
  • PipPipPipPipPipPipPip
  • 2,303 posts
  • Gender:Male
  • Location:Stockholm, Sweden
  • Interests:music, hiking, friends, nature, photography, traveling. and maps!
  • Sweden

Hans, I thought FME didn't do raster, or... ?
Hugo Ahlenius
Nordpil - custom maps and GIS
http://nordpil.com/
Twitter

#5
Hans van der Maarel

Hans van der Maarel

    CartoTalk Editor-in-Chief

  • Admin
  • PipPipPipPipPipPipPip
  • 3,868 posts
  • Gender:Male
  • Location:The Netherlands
  • Interests:Cartography, GIS, history, popular science, music.
  • Netherlands

Hans, I thought FME didn't do raster, or... ?


It does. Raster support has really improved *a lot* in FME 2007
Hans van der Maarel - Cartotalk Editor
Red Geographics
Email: hans@redgeographics.com / Twitter: @redgeographics

#6
SerbanR

SerbanR

    Contributor

  • Validated Member
  • PipPip
  • 15 posts
  • Gender:Male
  • Location:Timisoara
  • Romania

Hello Hans

Thanks again for your kind help.
Please find attached the zip files containing sample data (GRC: Vertical Mapper Classified Grid pixel size 25 meters, and MIF: MapInfo vectors; for both files projection is UTM31N, WGS84)

BR
Serban

Attached Files



#7
Hans van der Maarel

Hans van der Maarel

    CartoTalk Editor-in-Chief

  • Admin
  • PipPipPipPipPipPipPip
  • 3,868 posts
  • Gender:Male
  • Location:The Netherlands
  • Interests:Cartography, GIS, history, popular science, music.
  • Netherlands

Thanks again for your kind help.
Please find attached the zip files containing sample data (GRC: Vertical Mapper Classified Grid pixel size 25 meters, and MIF: MapInfo vectors; for both files projection is UTM31N, WGS84)


No luck so far... FME doesn't have an option yet to overlay a raster with polygons and transfer the raster attributes to the polygons, so I figured I'd give it a try through replacing the pixels with points, turn those into squares (so essentially recreating the raster as vector features) and then dissolve and overlay.

This is looking promising so far, albeit slow... Over 10 million pixels in this sample :)
Hans van der Maarel - Cartotalk Editor
Red Geographics
Email: hans@redgeographics.com / Twitter: @redgeographics

#8
SerbanR

SerbanR

    Contributor

  • Validated Member
  • PipPip
  • 15 posts
  • Gender:Male
  • Location:Timisoara
  • Romania

Hello Hans

Here is a tutorial received from a friend describing how this can be accomplished using Spatial Analyst under ArcView. I do not have this software on my computer, but I wander if these steps could be somehow made using FME or Manifold ?

1. Open the Arc view application (3.x series).
2. Then go to File menu and select the Extension tab, then an extensions list dialog box will appear, scroll down the dialog box to select the spatial analyst utility.
3. Please check on the spatial analyst utility and also check on the make default option appearing on the right side of extension list window, so that next time when you open Arc view utility will open automatically.
4. After selecting the Spatial analyst utility from extension list, a new menu will appear on the menu list next to the Theme Menu named as “Analysis”.

For calculating area statistic for each Landuse/Landcover class in clutter data as per given Administrative divisions polygons, please follow below written steps.

1. First of all set the working directory where you have kept the data in which you want to perform analysis. For setting working directory, go to file menu and select the set working directory tab, then a dialog box will appear and you have to write the path of data where you have kept the database in which you want to perform analysis.
2. Open the Landuse/landcover grid data and administrative polygon data from the work space directory. For opening grid data and polygon vector data go to View menu and select the Add theme tab, now a dialog box will appear please locate the working directory path where you have kept your clutter grid data and vector polygon administrative data.
3. Now you have two themes available in the View window, one is Landuse/Landcover grid data and another is Vector polygon administrative data.
4. Now time comes to perform analysis for getting area statistic about land use / land cover data for each administrative division.
5. Go to Analysis menu and select the Tabulate Areas tab, now a tabulate areas dialog box will appear, please select the Grid data in Row theme sub window, Value field or clutter class field in Row Field sub window and in Column Theme sub window select the Administrative polygon theme, in column field sub window select the Administrative name field. Then press ok. Now after few minutes you will get the required output. Now you can export this database file into dbf format. For exporting the data into dbf file format you can go to File menu and select the export tab option to save the dbf file.

Thanks again for your help
Serban

#9
benbakelaar

benbakelaar

    Ultimate Contributor

  • Associate Admin
  • PipPipPipPipPipPip
  • 658 posts
  • Gender:Male
  • Location:North Brunswick, NJ
  • Interests:maps, information, technology, scripting, computers
  • United States

Serban, I might be able to assist. My co-worker still has (and uses) ArcView 3.1, and we do have Spatial Analyst. Let me see how busy he is. I doubt it would be done today.

#10
Hans van der Maarel

Hans van der Maarel

    CartoTalk Editor-in-Chief

  • Admin
  • PipPipPipPipPipPipPip
  • 3,868 posts
  • Gender:Male
  • Location:The Netherlands
  • Interests:Cartography, GIS, history, popular science, music.
  • Netherlands

Here is a tutorial received from a friend describing how this can be accomplished using Spatial Analyst under ArcView. I do not have this software on my computer, but I wander if these steps could be somehow made using FME or Manifold ?


Thanks, but the tutorial is really Arc-specific (and I'm not ;) ). I got a pretty good clue as to what needs to be done and it's actually not too dissimilar to something I did with FME years ago (although that was for an automagic area generalisation thingy, but hey, it's the same...). It's just that the amount of data is a bit too much at the moment (and it's getting late over here). Don't worry, I've got a few tricks up my sleeve.
Hans van der Maarel - Cartotalk Editor
Red Geographics
Email: hans@redgeographics.com / Twitter: @redgeographics

#11
SerbanR

SerbanR

    Contributor

  • Validated Member
  • PipPip
  • 15 posts
  • Gender:Male
  • Location:Timisoara
  • Romania

Serban, I might be able to assist. My co-worker still has (and uses) ArcView 3.1, and we do have Spatial Analyst. Let me see how busy he is. I doubt it would be done today.

Actually I need a general solution which can be applied each time when needed with the software I have (that is MapInfo/Vertical Mapper, FME, Global Mapper). It is very kind of you to ask your colleague, but it will not help me too much since I can not send the data to you each time when I have to do this operation.
Thank you for your willingness to help.
Serban

#12
benbakelaar

benbakelaar

    Ultimate Contributor

  • Associate Admin
  • PipPipPipPipPipPip
  • 658 posts
  • Gender:Male
  • Location:North Brunswick, NJ
  • Interests:maps, information, technology, scripting, computers
  • United States

Sorry, I didn't read the beginning of the post. Most of the time when questions come up like this, people are looking for one-time assistance. :)

Actually I need a general solution which can be applied each time when needed with the software I have (that is MapInfo/Vertical Mapper, FME, Global Mapper). It is very kind of you to ask your colleague, but it will not help me too much since I can not send the data to you each time when I have to do this operation.
Thank you for your willingness to help.
Serban



#13
Hans van der Maarel

Hans van der Maarel

    CartoTalk Editor-in-Chief

  • Admin
  • PipPipPipPipPipPipPip
  • 3,868 posts
  • Gender:Male
  • Location:The Netherlands
  • Interests:Cartography, GIS, history, popular science, music.
  • Netherlands

Unfortunately, no luck with FME...

The trick I tried, replacing pixels with points, doesn't retain the original pixel properties (such as color and classification).
Hans van der Maarel - Cartotalk Editor
Red Geographics
Email: hans@redgeographics.com / Twitter: @redgeographics

#14
gregsd

gregsd

    Master Contributor

  • Validated Member
  • PipPipPipPip
  • 169 posts
  • Gender:Male
  • Location:Surrey, England.
  • Interests:Cycling, mostly off-road (MTB) riding.
  • United Kingdom

Hi Serban,

I don’t think that you can do much analysis within Vertical Mapper as you are using a classified grid, which has character attribute information, rather than a numeric grid (like a DEM).

You can use the Region Information tool on the VM toolbar (i within a polygon) and it will allow you to select a polygon from your admin boundary table and report back the area and percent for each classification within the selected polygon. Unfortunately, I couldn’t find a way of doing this for ALL the polygons within the table using the functions available within VM. You can do this for a numeric grid, but it only returns statistical information (like max value or standard deviation)>

The process I settled on in the end was to convert the .grc file into a vector table using the Contour option within VM. This will trace around the cell boundaries for each classification and create a region for each one. You can then use this file within MapInfo and use SQL to work out the area overlap between the admin boundary and land cover polygon tables. This query will do it for the sample data you posted:

Select FrVecSmpl_UTM31n_25m.CODE_INSEE, x_grd_contour.Class, sum(proportionoverlap(FrVecSmpl_UTM31n_25m.obj, x_grd_contour.obj)), sum(areaoverlap(FrVecSmpl_UTM31n_25m.obj, x_grd_contour.obj)) from FrVecSmpl_UTM31n_25m, x_grd_contour where FrVecSmpl_UTM31n_25m.Obj intersects x_grd_contour.Obj group by 1,2 into Selection

(Sorry, but I can't upload the x_grd_contour.tab table that I created in VM)

It does take awhile to run, so you may well be better off using FME now that you are working with 2 vector tables.

The query groups by CODE_INSEE (1) and CLASS (2) and proportionoverlap() produces the percentage of one object covered by another and areaoverlap() returns the area of overlap in the currently set area units (Map – Options – Area Unts)

Not sure if that helps you any, but I don't think there is any other way of doing it using MapInfo and Vertical Mapper.

Cheers

Greg


Greg Driver

GIS Analyst
MapInfo User...!

#15
SerbanR

SerbanR

    Contributor

  • Validated Member
  • PipPip
  • 15 posts
  • Gender:Male
  • Location:Timisoara
  • Romania

Unfortunately, no luck with FME...

The trick I tried, replacing pixels with points, doesn't retain the original pixel properties (such as color and classification).

So there is something which can not be done with FME! :(
Any other idea?
Do you know if Manifold can do this? I am more like a MapInfo user, Manifold seem really strange (and annoying) for me, but maybe a Maniflod specialist could tell if such a operation can be done using this software. I have Manifold Universal 7.1.19.2132. I suppose you are not familiar with it, but maybe you know someone which would be able to give more information on the subject. I am really lost here :(
Serban




0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users

-->