Jump to content

 
Photo

Duplicate Features

- - - - -

  • Please log in to reply
8 replies to this topic

#1
angel.spatial

angel.spatial

    Contributor

  • Validated Member
  • PipPip
  • 43 posts
  • Gender:Male
  • Location:Springdale, AR
  • United States

Hello all,

I wanted to know if there is a way to remove duplicates specifically in ArcGSI 9.2. I have a file that was merged long ago (not by me) and there is a duplicate of EVERY polygon (over 50000). I need to know how to go in and automatically delete any duplicates. I tried TypeConvert, but it will not install (of course). Any direction would be greatly appreciated!

Thanks,

angel
Share/collaborate GIS data for FREE: data.almostaccurate.com

#2
Hans van der Maarel

Hans van der Maarel

    CartoTalk Editor-in-Chief

  • Admin
  • PipPipPipPipPipPipPip
  • 3,881 posts
  • Gender:Male
  • Location:The Netherlands
  • Interests:Cartography, GIS, history, popular science, music.
  • Netherlands

I wanted to know if there is a way to remove duplicates specifically in ArcGSI 9.2. I have a file that was merged long ago (not by me) and there is a duplicate of EVERY polygon (over 50000). I need to know how to go in and automatically delete any duplicates. I tried TypeConvert, but it will not install (of course). Any direction would be greatly appreciated!


If you want, I can run it through FME for you. Just PM or email me privately if you're interested.
Hans van der Maarel - Cartotalk Editor
Red Geographics
Email: hans@redgeographics.com / Twitter: @redgeographics

#3
gregory

gregory

    Key Contributor

  • Validated Member
  • PipPipPip
  • 96 posts
  • Gender:Male
  • Location:Cracow
  • Poland

Hi,
What about using dissolve with AREA field?
If you set the declimals of that field enough to every polygon be not identical but just the same as its copy then runing dissolve should double resize the number of your records.. Just an idea.
You should easily got what are you asking for using "Remove Duplicates" function in manifold.

regards
Gregory

#4
A. Fenix

A. Fenix

    Analisa Fenix

  • Validated Member
  • PipPipPipPip
  • 175 posts
  • Gender:Female
  • Location:Cascadia
  • Interests:Cartography, PGIS, PPGIS, GIS, Urban/regional Planning, Conservation, Biodiversity/Cultural Diversity, Travel, History, Ecology, Geography, Biking, Gardening, Cooking, Physics, Permaculture, Sky diving, Green Roofs, Music (creating and enjoying), Photography, Carpentry, Film making, Writing...
  • No Country Selected

Hello Angel,

I found this script on ESRI's support site that may also do the trick:

http://arcscripts.es....asp?dbid=14811

I haven't used it personally, but it certainly sounds like it would do the trick.

Good Luck!

Analisa
Analisa Fenix
GIS Manager/Chief Cartographer
Ecotrust

#5
angel.spatial

angel.spatial

    Contributor

  • Validated Member
  • PipPip
  • 43 posts
  • Gender:Male
  • Location:Springdale, AR
  • United States

Wow I love this forum! You guys are so helpful.

I will try the script and see how it goes. I wish we used FME and Manifold here, that would make certain processes much easier. I will let you know how it goes!

angel
Share/collaborate GIS data for FREE: data.almostaccurate.com

#6
angel.spatial

angel.spatial

    Contributor

  • Validated Member
  • PipPip
  • 43 posts
  • Gender:Male
  • Location:Springdale, AR
  • United States

I tried the script and it didn't work. It cannot sort through so many polygons.

What about just automatically checking for overlaps within one layer? I know that you can do this with topology, but you cannot tell it to merge or just take the first one for ALL of them at once. Is there a tool that I don't know about.

I tried the dissolve tool and nothing seems to be happening. I need all of my attributes in the resulting table so I selected all attributes to dissolve by....was this wrong?

angel
Share/collaborate GIS data for FREE: data.almostaccurate.com

#7
gregory

gregory

    Key Contributor

  • Validated Member
  • PipPipPip
  • 96 posts
  • Gender:Male
  • Location:Cracow
  • Poland

I just tested merging using dissolve by area in manifold and it did the trick. The two individual records that you want to merge are identical so you want miss any fields just dissolving by AREA field (and only that). Using AREA came to my mind cose it's really hard to find in nature two shapes with identicall area (so epand declimals in area field as much as you can). Note that is going to work while the area of the polygons you're trying to merge will be identical just for a shape and its copy, otherwise you will not get exaclly the half of records but some more shapes will be merged into a single shape. But in that case you should try to run with something like 'decompose' in manifold - http://www.manifold....m_decompose.htm. You will have to look for such kind of tool in arcgis.

The second option. Split you shapefile into some smaller parts and then try to run the script suggested by Analisia. Maybe it will handle it.

regards
Gregory

#8
angel.spatial

angel.spatial

    Contributor

  • Validated Member
  • PipPip
  • 43 posts
  • Gender:Male
  • Location:Springdale, AR
  • United States

Thanks to everyone for all the help!

Here is what I have ultimately come up with...I decided to aggregate features in the single shapefile and that seemed to do what I need.

I will also try the other methods (just so I can learn) and see how they go. I will look for the decompose and play more with the dissolve on smaller shapefiles.

Thanks again - angel
Share/collaborate GIS data for FREE: data.almostaccurate.com

#9
pfyfield

pfyfield

    Master Contributor

  • Validated Member
  • PipPipPipPip
  • 100 posts
  • Gender:Male
  • Location:Portland, Oregon
  • United States

Dissolve by area is the way to go (unless there's a feature id that is the same for both of the duplicate polygons- then use that).

If you need to retain all your attributes save a copy of the dbf file and join it back to the output of your dissolve using the area field. That ought to work.
Paul Fyfield
Cartographer, Bureau of Land Management
Oregon State Office
Portland, Oregon
pfyfield@blm.gov




0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users

-->